Sep 09 23:15:13.238478 ip-10-0-130-161 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Sep 09 23:15:13.238489 ip-10-0-130-161 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Sep 09 23:15:13.238497 ip-10-0-130-161 systemd[1]: kubelet.service: Failed with result 'resources'. Sep 09 23:15:13.238654 ip-10-0-130-161 systemd[1]: Failed to start Kubernetes Kubelet. Sep 09 23:15:24.410966 ip-10-0-130-161 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Sep 09 23:15:24.410981 ip-10-0-130-161 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b2c57734df884c999b6b5ce65d6ce6b7 -- Sep 09 23:17:14.868805 ip-10-0-130-161 systemd[1]: Starting Kubernetes Kubelet... Sep 09 23:17:15.225105 ip-10-0-130-161 kubenswrapper[2583]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:17:15.225105 ip-10-0-130-161 kubenswrapper[2583]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Sep 09 23:17:15.225105 ip-10-0-130-161 kubenswrapper[2583]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:17:15.225666 ip-10-0-130-161 kubenswrapper[2583]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Sep 09 23:17:15.225666 ip-10-0-130-161 kubenswrapper[2583]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Sep 09 23:17:15.226901 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.226825 2583 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Sep 09 23:17:15.230650 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230634 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:17:15.230650 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230649 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230653 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230656 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230661 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230664 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230667 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230670 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230673 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230677 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230680 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230682 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230685 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230688 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230690 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230693 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230695 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230698 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230700 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230703 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:17:15.230719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230706 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230709 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230711 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230714 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230716 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230719 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230722 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230725 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230728 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230731 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230734 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230736 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230739 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230742 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230744 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230747 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230754 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230757 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230759 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:17:15.231183 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230761 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230764 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230767 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230769 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230772 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230774 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230777 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230779 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230781 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230784 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230786 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230789 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230792 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230795 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230798 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230802 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230806 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230809 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230811 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230814 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:17:15.231659 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230817 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230819 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230822 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230824 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230828 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230832 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230835 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230837 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230840 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230843 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230848 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230851 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230854 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230856 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230859 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230863 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230865 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230868 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230870 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230873 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:17:15.232163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230875 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230878 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230880 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230883 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230885 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230888 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230890 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230893 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230896 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230899 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230901 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230904 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230907 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230911 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230914 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230917 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230919 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230922 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230924 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.230927 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:17:15.232665 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231623 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231630 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231632 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231636 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231639 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231642 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231645 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231647 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231650 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231652 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231655 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231658 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231661 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231663 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231666 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231668 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231671 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231674 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231676 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231681 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:17:15.233155 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231684 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231686 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231689 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231691 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231694 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231697 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231700 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231702 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231705 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231708 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231710 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231713 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231716 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231718 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231720 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231723 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231726 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231731 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231734 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:17:15.233682 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231737 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231740 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231743 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231746 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231749 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231752 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231754 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231756 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231759 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231762 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231764 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231768 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231773 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231776 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231779 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231782 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231785 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231787 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231790 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:17:15.234158 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231792 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231795 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231798 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231800 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231825 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231829 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231832 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231835 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231838 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231841 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231843 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231846 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231849 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231851 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231854 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231856 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231859 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231862 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231864 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231866 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:17:15.234642 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231869 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231871 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231874 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231876 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231879 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231882 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231886 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231890 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231893 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231897 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231899 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231902 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231905 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231907 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231910 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231925 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231928 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231931 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231933 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231936 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:17:15.235137 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.231939 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232898 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232904 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232908 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232910 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232914 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232916 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232919 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232922 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232924 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232927 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232929 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232932 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232934 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232937 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232940 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232943 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232946 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232948 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:17:15.235641 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232951 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232953 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232956 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232958 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232961 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232964 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232966 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232969 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232971 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232974 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232976 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232979 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232981 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232984 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232986 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232989 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232991 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232995 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.232997 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233000 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:17:15.236110 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233002 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233005 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233007 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233010 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233012 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233015 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233018 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233022 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233025 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233029 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233033 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233036 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233039 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233042 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233045 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233048 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233050 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233053 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233055 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233057 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:17:15.236617 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233060 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233063 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233065 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233068 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233070 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233072 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233075 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233077 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233080 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233082 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233085 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233088 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233090 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233093 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233097 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233100 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233103 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233106 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233108 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:17:15.237109 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233111 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233114 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233117 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233119 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233122 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233124 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233127 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233129 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233132 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233134 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233137 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233139 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233142 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233144 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233147 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233149 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233151 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233155 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233157 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233160 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:17:15.237591 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233163 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233166 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233234 2583 flags.go:64] FLAG: --address="0.0.0.0" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233264 2583 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233271 2583 flags.go:64] FLAG: --anonymous-auth="true" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233275 2583 flags.go:64] FLAG: --application-metrics-count-limit="100" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233280 2583 flags.go:64] FLAG: --authentication-token-webhook="false" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233283 2583 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233287 2583 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233292 2583 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233295 2583 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233298 2583 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233301 2583 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233304 2583 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233307 2583 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233310 2583 flags.go:64] FLAG: --cgroup-root="" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233313 2583 flags.go:64] FLAG: --cgroups-per-qos="true" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233316 2583 flags.go:64] FLAG: --client-ca-file="" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233319 2583 flags.go:64] FLAG: --cloud-provider="external" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233322 2583 flags.go:64] FLAG: --cluster-dns="[]" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233326 2583 flags.go:64] FLAG: --cluster-domain="" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233328 2583 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233332 2583 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233334 2583 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Sep 09 23:17:15.238096 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233338 2583 flags.go:64] FLAG: --container-log-max-files="5" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233342 2583 flags.go:64] FLAG: --container-log-max-size="10Mi" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233344 2583 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233347 2583 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233350 2583 flags.go:64] FLAG: --containerd-namespace="k8s.io" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233354 2583 flags.go:64] FLAG: --contention-profiling="false" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233357 2583 flags.go:64] FLAG: --cpu-cfs-quota="true" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233360 2583 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233363 2583 flags.go:64] FLAG: --cpu-manager-policy="none" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233366 2583 flags.go:64] FLAG: --cpu-manager-policy-options="" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233370 2583 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233373 2583 flags.go:64] FLAG: --enable-controller-attach-detach="true" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233376 2583 flags.go:64] FLAG: --enable-debugging-handlers="true" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233380 2583 flags.go:64] FLAG: --enable-load-reader="false" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233383 2583 flags.go:64] FLAG: --enable-server="true" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233386 2583 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233390 2583 flags.go:64] FLAG: --event-burst="100" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233393 2583 flags.go:64] FLAG: --event-qps="50" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233395 2583 flags.go:64] FLAG: --event-storage-age-limit="default=0" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233398 2583 flags.go:64] FLAG: --event-storage-event-limit="default=0" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233401 2583 flags.go:64] FLAG: --eviction-hard="" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233405 2583 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233408 2583 flags.go:64] FLAG: --eviction-minimum-reclaim="" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233411 2583 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233414 2583 flags.go:64] FLAG: --eviction-soft="" Sep 09 23:17:15.238781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233416 2583 flags.go:64] FLAG: --eviction-soft-grace-period="" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233419 2583 flags.go:64] FLAG: --exit-on-lock-contention="false" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233422 2583 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233425 2583 flags.go:64] FLAG: --experimental-mounter-path="" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233428 2583 flags.go:64] FLAG: --fail-cgroupv1="false" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233431 2583 flags.go:64] FLAG: --fail-swap-on="true" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233433 2583 flags.go:64] FLAG: --feature-gates="" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233437 2583 flags.go:64] FLAG: --file-check-frequency="20s" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233440 2583 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233443 2583 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233446 2583 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233449 2583 flags.go:64] FLAG: --healthz-port="10248" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233452 2583 flags.go:64] FLAG: --help="false" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233454 2583 flags.go:64] FLAG: --hostname-override="ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233457 2583 flags.go:64] FLAG: --housekeeping-interval="10s" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233460 2583 flags.go:64] FLAG: --http-check-frequency="20s" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233463 2583 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233466 2583 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233470 2583 flags.go:64] FLAG: --image-gc-high-threshold="85" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233472 2583 flags.go:64] FLAG: --image-gc-low-threshold="80" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233475 2583 flags.go:64] FLAG: --image-service-endpoint="" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233478 2583 flags.go:64] FLAG: --kernel-memcg-notification="false" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233481 2583 flags.go:64] FLAG: --kube-api-burst="100" Sep 09 23:17:15.239421 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233485 2583 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233488 2583 flags.go:64] FLAG: --kube-api-qps="50" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233491 2583 flags.go:64] FLAG: --kube-reserved="" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233494 2583 flags.go:64] FLAG: --kube-reserved-cgroup="" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233497 2583 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233500 2583 flags.go:64] FLAG: --kubelet-cgroups="" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233503 2583 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233506 2583 flags.go:64] FLAG: --lock-file="" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233508 2583 flags.go:64] FLAG: --log-cadvisor-usage="false" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233511 2583 flags.go:64] FLAG: --log-flush-frequency="5s" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233514 2583 flags.go:64] FLAG: --log-json-info-buffer-size="0" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233532 2583 flags.go:64] FLAG: --log-json-split-stream="false" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233535 2583 flags.go:64] FLAG: --log-text-info-buffer-size="0" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233538 2583 flags.go:64] FLAG: --log-text-split-stream="false" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233541 2583 flags.go:64] FLAG: --logging-format="text" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233544 2583 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233547 2583 flags.go:64] FLAG: --make-iptables-util-chains="true" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233550 2583 flags.go:64] FLAG: --manifest-url="" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233553 2583 flags.go:64] FLAG: --manifest-url-header="" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233557 2583 flags.go:64] FLAG: --max-housekeeping-interval="15s" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233560 2583 flags.go:64] FLAG: --max-open-files="1000000" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233564 2583 flags.go:64] FLAG: --max-pods="110" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233567 2583 flags.go:64] FLAG: --maximum-dead-containers="-1" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233570 2583 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233573 2583 flags.go:64] FLAG: --memory-manager-policy="None" Sep 09 23:17:15.240023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233576 2583 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233579 2583 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233582 2583 flags.go:64] FLAG: --node-ip="0.0.0.0" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233585 2583 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233592 2583 flags.go:64] FLAG: --node-status-max-images="50" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233595 2583 flags.go:64] FLAG: --node-status-update-frequency="10s" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233598 2583 flags.go:64] FLAG: --oom-score-adj="-999" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233602 2583 flags.go:64] FLAG: --pod-cidr="" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233605 2583 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:8ccbacc999dbf9abad8f4009240188312b683f36ced4763eed166c1500c164b1" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233610 2583 flags.go:64] FLAG: --pod-manifest-path="" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233616 2583 flags.go:64] FLAG: --pod-max-pids="-1" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233619 2583 flags.go:64] FLAG: --pods-per-core="0" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233622 2583 flags.go:64] FLAG: --port="10250" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233625 2583 flags.go:64] FLAG: --protect-kernel-defaults="false" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233628 2583 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0db98a901fbf02993" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233631 2583 flags.go:64] FLAG: --qos-reserved="" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233634 2583 flags.go:64] FLAG: --read-only-port="10255" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233637 2583 flags.go:64] FLAG: --register-node="true" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233640 2583 flags.go:64] FLAG: --register-with-taints="" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233644 2583 flags.go:64] FLAG: --registry-burst="10" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233647 2583 flags.go:64] FLAG: --registry-qps="5" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233649 2583 flags.go:64] FLAG: --reserved-cpus="" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233652 2583 flags.go:64] FLAG: --reserved-memory="" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233656 2583 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233659 2583 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Sep 09 23:17:15.240638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233662 2583 flags.go:64] FLAG: --rotate-certificates="false" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233665 2583 flags.go:64] FLAG: --rotate-server-certificates="false" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233668 2583 flags.go:64] FLAG: --runonce="false" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233671 2583 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233674 2583 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233677 2583 flags.go:64] FLAG: --seccomp-default="false" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233680 2583 flags.go:64] FLAG: --serialize-image-pulls="true" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233683 2583 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233686 2583 flags.go:64] FLAG: --storage-driver-db="cadvisor" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233690 2583 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233693 2583 flags.go:64] FLAG: --storage-driver-password="root" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233696 2583 flags.go:64] FLAG: --storage-driver-secure="false" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233699 2583 flags.go:64] FLAG: --storage-driver-table="stats" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233702 2583 flags.go:64] FLAG: --storage-driver-user="root" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233705 2583 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233708 2583 flags.go:64] FLAG: --sync-frequency="1m0s" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233711 2583 flags.go:64] FLAG: --system-cgroups="" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233715 2583 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233721 2583 flags.go:64] FLAG: --system-reserved-cgroup="" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233723 2583 flags.go:64] FLAG: --tls-cert-file="" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233726 2583 flags.go:64] FLAG: --tls-cipher-suites="[]" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233730 2583 flags.go:64] FLAG: --tls-min-version="" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233733 2583 flags.go:64] FLAG: --tls-private-key-file="" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233736 2583 flags.go:64] FLAG: --topology-manager-policy="none" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233738 2583 flags.go:64] FLAG: --topology-manager-policy-options="" Sep 09 23:17:15.241269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233741 2583 flags.go:64] FLAG: --topology-manager-scope="container" Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233744 2583 flags.go:64] FLAG: --v="2" Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233748 2583 flags.go:64] FLAG: --version="false" Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233753 2583 flags.go:64] FLAG: --vmodule="" Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233756 2583 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.233759 2583 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233880 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233885 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233888 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233891 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233894 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233897 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233900 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233903 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233905 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233908 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233911 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233915 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233918 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233920 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233923 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:17:15.241914 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233926 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233929 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233931 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233935 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233937 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233940 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233943 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233945 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233949 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233953 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233956 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233958 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233961 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233963 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233966 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233968 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233971 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233974 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233976 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233979 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:17:15.242432 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233982 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233984 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233987 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233989 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233992 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233994 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.233997 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234000 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234007 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234010 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234012 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234015 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234017 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234020 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234027 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234032 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234034 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234037 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234040 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234042 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:17:15.243045 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234045 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234047 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234050 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234052 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234055 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234057 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234060 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234062 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234064 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234067 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234069 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234072 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234074 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234077 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234080 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234082 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234084 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234087 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234089 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234092 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:17:15.243789 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234096 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234098 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234101 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234103 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234106 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234108 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234111 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234116 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234120 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234123 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234125 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234128 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234130 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234133 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234136 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234138 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234141 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234143 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234146 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234148 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:17:15.244441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234150 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234161 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234165 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.234168 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.234794 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.242409 2583 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.242433 2583 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.243091 2583 watchdog_linux.go:95] "Systemd watchdog is not enabled" Sep 09 23:17:15.244983 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.243099 2583 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245119 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245145 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245151 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245156 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245161 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245166 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245171 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245175 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245179 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245185 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245192 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245196 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245201 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245210 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245214 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245218 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245223 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245227 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245232 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:17:15.245271 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245237 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245241 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245245 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245249 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245254 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245258 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245262 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245271 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245276 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245281 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245286 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245290 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245295 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245299 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245311 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245424 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245443 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245447 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245450 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:17:15.245786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245453 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245456 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245459 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245463 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245466 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245469 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245473 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245476 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245478 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245482 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245485 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245488 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245491 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245494 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245496 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245499 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245502 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245504 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245509 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:17:15.246257 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245514 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245530 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245533 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245536 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245539 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245541 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245544 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245547 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245550 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245553 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245557 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245560 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245563 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245566 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245568 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245571 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245574 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245577 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245579 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245582 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:17:15.246783 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245584 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245587 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245589 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245592 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245594 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245597 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245600 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245603 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245605 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245608 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245610 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245613 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245615 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245618 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245621 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245623 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245626 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245628 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245631 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245634 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:17:15.247280 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245636 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245639 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.245645 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245786 2583 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245790 2583 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245794 2583 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245797 2583 feature_gate.go:328] unrecognized feature gate: DualReplica Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245800 2583 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245803 2583 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245805 2583 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245808 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245811 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245814 2583 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245816 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245819 2583 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Sep 09 23:17:15.247786 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245821 2583 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245824 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245826 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245829 2583 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245833 2583 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245836 2583 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245838 2583 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245841 2583 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245843 2583 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245846 2583 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245848 2583 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245851 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPI Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245853 2583 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245855 2583 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245859 2583 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245863 2583 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245866 2583 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245870 2583 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245873 2583 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Sep 09 23:17:15.248163 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245877 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245880 2583 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245883 2583 feature_gate.go:328] unrecognized feature gate: NewOLM Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245886 2583 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245888 2583 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245891 2583 feature_gate.go:328] unrecognized feature gate: OSStreams Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245893 2583 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245896 2583 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245898 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245901 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245904 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245906 2583 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245909 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryption Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245911 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245914 2583 feature_gate.go:328] unrecognized feature gate: EventTTL Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245916 2583 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245919 2583 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245921 2583 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245924 2583 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245927 2583 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Sep 09 23:17:15.248639 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245929 2583 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245932 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245934 2583 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245937 2583 feature_gate.go:328] unrecognized feature gate: Example Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245939 2583 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245942 2583 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245944 2583 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245947 2583 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245949 2583 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245952 2583 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245955 2583 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245957 2583 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245960 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245962 2583 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245965 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245967 2583 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245970 2583 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245972 2583 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245975 2583 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Sep 09 23:17:15.249136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245977 2583 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245980 2583 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245982 2583 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245984 2583 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245987 2583 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245989 2583 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245992 2583 feature_gate.go:328] unrecognized feature gate: PinnedImages Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245994 2583 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245997 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.245999 2583 feature_gate.go:328] unrecognized feature gate: SignatureStores Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246001 2583 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246004 2583 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246007 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246009 2583 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246011 2583 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246014 2583 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246016 2583 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246019 2583 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246021 2583 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Sep 09 23:17:15.249619 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246024 2583 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246026 2583 feature_gate.go:328] unrecognized feature gate: OVNObservability Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246029 2583 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246033 2583 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246036 2583 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246039 2583 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246042 2583 feature_gate.go:328] unrecognized feature gate: Example2 Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246044 2583 feature_gate.go:328] unrecognized feature gate: InsightsConfig Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246047 2583 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:15.246049 2583 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.246054 2583 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.246145 2583 server.go:962] "Client rotation is on, will bootstrap in background" Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.248837 2583 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.249859 2583 server.go:1019] "Starting client certificate rotation" Sep 09 23:17:15.250082 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.249960 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:17:15.250437 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.249993 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Sep 09 23:17:15.252194 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.252181 2583 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:17:15.256951 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.256935 2583 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Sep 09 23:17:15.267195 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.267174 2583 log.go:25] "Validated CRI v1 runtime API" Sep 09 23:17:15.270178 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.270164 2583 log.go:25] "Validated CRI v1 image API" Sep 09 23:17:15.271062 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.271047 2583 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Sep 09 23:17:15.273258 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.273231 2583 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 accc5019-a753-4132-83e5-4c0c0a034218:/dev/nvme0n1p4 d8e1b338-4ef7-4fed-b4ed-a6e5e8fb486e:/dev/nvme0n1p3] Sep 09 23:17:15.273335 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.273257 2583 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Sep 09 23:17:15.278904 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.278765 2583 manager.go:216] Machine: {Timestamp:2026-09-09 23:17:15.277434383 +0000 UTC m=+0.305444744 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100926 MemoryCapacity:33164480512 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f0afe16d0fe4664312a19d976cab8 SystemUUID:ec2f0afe-16d0-fe46-6431-2a19d976cab8 BootID:b2c57734-df88-4c99-9b6b-5ce65d6ce6b7 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582238208 Type:vfs Inodes:4048398 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582242304 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fb:31:ad:c6:b3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fb:31:ad:c6:b3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:d6:3d:31:c8:a5 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164480512 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Sep 09 23:17:15.278904 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.278893 2583 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Sep 09 23:17:15.279058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.278984 2583 manager.go:232] Version: {KernelVersion:5.14.0-570.138.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260901-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Sep 09 23:17:15.280783 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.280745 2583 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Sep 09 23:17:15.280831 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.280812 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:17:15.280924 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.280790 2583 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-161.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Sep 09 23:17:15.281559 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.281549 2583 topology_manager.go:138] "Creating topology manager with none policy" Sep 09 23:17:15.281592 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.281561 2583 container_manager_linux.go:309] "Creating device plugin manager" Sep 09 23:17:15.281592 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.281569 2583 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:17:15.282882 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.282870 2583 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Sep 09 23:17:15.284575 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.284564 2583 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Sep 09 23:17:15.288584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.288572 2583 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:17:15.288707 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.288698 2583 server.go:1240] "Using root directory" path="/var/lib/kubelet" Sep 09 23:17:15.288737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.288728 2583 kubelet.go:486] "Attempting to sync node with API server" Sep 09 23:17:15.288764 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.288741 2583 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Sep 09 23:17:15.288764 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.288753 2583 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Sep 09 23:17:15.288764 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.288762 2583 kubelet.go:398] "Adding apiserver pod source" Sep 09 23:17:15.288848 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.288770 2583 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Sep 09 23:17:15.289087 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.289051 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:17:15.289710 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.289656 2583 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Sep 09 23:17:15.292853 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.292830 2583 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.12-5.rhaos4.21.gitd1ec63c.el9" apiVersion="v1" Sep 09 23:17:15.295254 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295240 2583 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Sep 09 23:17:15.295324 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295268 2583 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Sep 09 23:17:15.295419 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295409 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Sep 09 23:17:15.295464 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295423 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Sep 09 23:17:15.295464 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295429 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Sep 09 23:17:15.295464 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295434 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Sep 09 23:17:15.295464 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295441 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Sep 09 23:17:15.295464 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295446 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Sep 09 23:17:15.295773 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295764 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Sep 09 23:17:15.295773 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295773 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Sep 09 23:17:15.295829 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295780 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Sep 09 23:17:15.295829 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295785 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Sep 09 23:17:15.295829 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295793 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Sep 09 23:17:15.295829 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.295801 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Sep 09 23:17:15.296483 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.296474 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Sep 09 23:17:15.296483 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.296482 2583 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Sep 09 23:17:15.300117 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.300099 2583 server.go:1268] "Started kubelet" Sep 09 23:17:15.300117 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.300113 2583 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-161.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Sep 09 23:17:15.300260 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.300147 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Sep 09 23:17:15.300260 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.300186 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Sep 09 23:17:15.300260 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.300195 2583 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Sep 09 23:17:15.300409 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.300264 2583 server_v1.go:49] "podresources" method="list" useActivePods=true Sep 09 23:17:15.300409 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.300292 2583 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Sep 09 23:17:15.300825 ip-10-0-130-161 systemd[1]: Started Kubernetes Kubelet. Sep 09 23:17:15.301729 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.301711 2583 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Sep 09 23:17:15.302021 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.302004 2583 server.go:310] "Adding debug handlers to kubelet server" Sep 09 23:17:15.304063 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.304043 2583 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Sep 09 23:17:15.305054 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.305036 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xg29c" Sep 09 23:17:15.306875 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.306857 2583 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Sep 09 23:17:15.307316 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.307298 2583 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Sep 09 23:17:15.307431 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.307415 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.307624 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.306742 2583 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-161.ec2.internal.18d3ca3bd3b6d761 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-161.ec2.internal,UID:ip-10-0-130-161.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-161.ec2.internal,},FirstTimestamp:2026-09-09 23:17:15.300075361 +0000 UTC m=+0.328085722,LastTimestamp:2026-09-09 23:17:15.300075361 +0000 UTC m=+0.328085722,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-161.ec2.internal,}" Sep 09 23:17:15.307965 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.307944 2583 volume_manager.go:311] "The desired_state_of_world populator starts" Sep 09 23:17:15.308045 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.307969 2583 volume_manager.go:313] "Starting Kubelet Volume Manager" Sep 09 23:17:15.308045 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.307947 2583 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Sep 09 23:17:15.308138 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308096 2583 reconstruct.go:97] "Volume reconstruction finished" Sep 09 23:17:15.308138 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308107 2583 reconciler.go:29] "Reconciler: start to sync state" Sep 09 23:17:15.308138 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308109 2583 factory.go:55] Registering systemd factory Sep 09 23:17:15.308138 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308123 2583 factory.go:223] Registration of the systemd container factory successfully Sep 09 23:17:15.308328 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308317 2583 factory.go:153] Registering CRI-O factory Sep 09 23:17:15.308328 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308328 2583 factory.go:223] Registration of the crio container factory successfully Sep 09 23:17:15.308391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308370 2583 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Sep 09 23:17:15.308391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308384 2583 factory.go:103] Registering Raw factory Sep 09 23:17:15.308449 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308393 2583 manager.go:1196] Started watching for new ooms in manager Sep 09 23:17:15.308719 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.308704 2583 manager.go:349] Starting recovery of all containers Sep 09 23:17:15.313578 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.313556 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xg29c" Sep 09 23:17:15.315022 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.314943 2583 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Sep 09 23:17:15.315022 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.315004 2583 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-161.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Sep 09 23:17:15.315992 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.315949 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Sep 09 23:17:15.322135 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.322012 2583 manager.go:354] Recovery completed Sep 09 23:17:15.326642 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.326621 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:17:15.328809 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.328794 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:17:15.328871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.328821 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:17:15.328871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.328832 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:17:15.329384 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.329367 2583 cpu_manager.go:222] "Starting CPU manager" policy="none" Sep 09 23:17:15.329384 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.329382 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:17:15.329514 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.329381 2583 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Sep 09 23:17:15.329514 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.329419 2583 state_mem.go:36] "Initialized new in-memory state store" Sep 09 23:17:15.330088 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.330071 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:17:15.330140 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.330101 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:17:15.330140 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.330110 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:17:15.331390 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.331377 2583 policy_none.go:49] "None policy: Start" Sep 09 23:17:15.331460 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.331394 2583 memory_manager.go:187] "Starting memorymanager" policy="None" Sep 09 23:17:15.331460 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.331407 2583 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Sep 09 23:17:15.333409 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.333394 2583 policy_none.go:47] "Start" Sep 09 23:17:15.367900 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.367885 2583 manager.go:337] "Starting Device Plugin manager" Sep 09 23:17:15.367984 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.367921 2583 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Sep 09 23:17:15.367984 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.367934 2583 server.go:87] "Starting device plugin registration server" Sep 09 23:17:15.368191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.368177 2583 eviction_manager.go:189] "Eviction manager: starting control loop" Sep 09 23:17:15.368255 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.368192 2583 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Sep 09 23:17:15.368305 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.368273 2583 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Sep 09 23:17:15.368354 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.368347 2583 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Sep 09 23:17:15.368400 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.368355 2583 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Sep 09 23:17:15.368965 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.368944 2583 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Sep 09 23:17:15.369033 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.368999 2583 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.397901 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.397885 2583 container_manager_linux.go:676] "Failed to ensure state" containerName="/system.slice" err="failed to move PID 2622 into the system container \"/system.slice\": " Sep 09 23:17:15.469208 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.469186 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:17:15.471036 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.471020 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:17:15.471099 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.471047 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:17:15.471099 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.471058 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:17:15.471099 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.471080 2583 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.479304 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.479289 2583 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.500257 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.479313 2583 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-161.ec2.internal\": node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.500257 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.497968 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.523004 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.522982 2583 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Sep 09 23:17:15.523092 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.523027 2583 status_manager.go:244] "Starting to sync pod status with apiserver" Sep 09 23:17:15.523092 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.523048 2583 kubelet.go:2448] "Starting kubelet main sync loop" Sep 09 23:17:15.523200 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.523103 2583 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Sep 09 23:17:15.525188 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.525161 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:17:15.598878 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.598860 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.623333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.623312 2583 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal"] Sep 09 23:17:15.623403 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.623392 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:17:15.625013 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.624997 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:17:15.625075 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.625026 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:17:15.625075 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.625037 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:17:15.627055 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627043 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:17:15.627156 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.627192 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627170 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:17:15.627715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627701 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:17:15.627715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627707 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:17:15.627821 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627721 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:17:15.627821 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627729 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:17:15.627821 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627731 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:17:15.627821 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.627740 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:17:15.629768 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.629755 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.629810 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.629779 2583 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Sep 09 23:17:15.630430 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.630399 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientMemory" Sep 09 23:17:15.630430 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.630428 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasNoDiskPressure" Sep 09 23:17:15.630572 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.630439 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeHasSufficientPID" Sep 09 23:17:15.664083 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.664066 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-161.ec2.internal\" not found" node="ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.668797 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.668782 2583 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-161.ec2.internal\" not found" node="ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.699361 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.699344 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.710597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.710565 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cdd65af97b5510fd0cbdb7cae07a57d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-161.ec2.internal\" (UID: \"3cdd65af97b5510fd0cbdb7cae07a57d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.710669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.710612 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e195e4e5da6f6487716f095dd40c0088-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal\" (UID: \"e195e4e5da6f6487716f095dd40c0088\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.710669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.710629 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e195e4e5da6f6487716f095dd40c0088-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal\" (UID: \"e195e4e5da6f6487716f095dd40c0088\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.799801 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.799755 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.811166 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.811146 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cdd65af97b5510fd0cbdb7cae07a57d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-161.ec2.internal\" (UID: \"3cdd65af97b5510fd0cbdb7cae07a57d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.811220 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.811168 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e195e4e5da6f6487716f095dd40c0088-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal\" (UID: \"e195e4e5da6f6487716f095dd40c0088\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.811220 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.811196 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e195e4e5da6f6487716f095dd40c0088-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal\" (UID: \"e195e4e5da6f6487716f095dd40c0088\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.811294 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.811222 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e195e4e5da6f6487716f095dd40c0088-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal\" (UID: \"e195e4e5da6f6487716f095dd40c0088\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.811294 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.811235 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3cdd65af97b5510fd0cbdb7cae07a57d-config\") pod \"kube-apiserver-proxy-ip-10-0-130-161.ec2.internal\" (UID: \"3cdd65af97b5510fd0cbdb7cae07a57d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.811294 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.811249 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/e195e4e5da6f6487716f095dd40c0088-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal\" (UID: \"e195e4e5da6f6487716f095dd40c0088\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.900316 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:15.900286 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:15.967756 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.967736 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" Sep 09 23:17:15.972624 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:15.972566 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:16.000596 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:16.000569 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:16.101162 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:16.101107 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:16.201609 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:16.201580 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:16.250118 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.250103 2583 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Sep 09 23:17:16.250483 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.250237 2583 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Sep 09 23:17:16.302240 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:16.302213 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:16.316939 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.316910 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-09-08 23:12:15 +0000 UTC" deadline="2028-04-05 14:23:27.510257941 +0000 UTC" Sep 09 23:17:16.316939 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.316937 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13767h6m11.193323967s" Sep 09 23:17:16.403178 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:16.403160 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:16.458995 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.458978 2583 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:17:16.504131 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:16.504108 2583 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-161.ec2.internal\" not found" Sep 09 23:17:16.512487 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.512461 2583 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:17:16.608587 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.608565 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" Sep 09 23:17:16.617635 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:16.617594 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode195e4e5da6f6487716f095dd40c0088.slice/crio-d6e1073a80dd68c3c26f01945ccb2c08edf751f7740c75463892b255e91d0c26 WatchSource:0}: Error finding container d6e1073a80dd68c3c26f01945ccb2c08edf751f7740c75463892b255e91d0c26: Status 404 returned error can't find the container with id d6e1073a80dd68c3c26f01945ccb2c08edf751f7740c75463892b255e91d0c26 Sep 09 23:17:16.617912 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:16.617886 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cdd65af97b5510fd0cbdb7cae07a57d.slice/crio-854d86e79ac0a8572e4784a75450dd60aaca78f7c56fffcb0322b7d23302fcc0 WatchSource:0}: Error finding container 854d86e79ac0a8572e4784a75450dd60aaca78f7c56fffcb0322b7d23302fcc0: Status 404 returned error can't find the container with id 854d86e79ac0a8572e4784a75450dd60aaca78f7c56fffcb0322b7d23302fcc0 Sep 09 23:17:16.617912 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.617900 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:17:16.619626 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.619609 2583 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" Sep 09 23:17:16.624193 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.624177 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:17:16.628841 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.628824 2583 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Sep 09 23:17:16.825239 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:16.825213 2583 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:17:17.289478 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.289452 2583 apiserver.go:52] "Watching apiserver" Sep 09 23:17:17.298862 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.298838 2583 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Sep 09 23:17:17.299977 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.299949 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-xhn5n","kube-system/konnectivity-agent-2t29c","openshift-cluster-node-tuning-operator/tuned-x6hnc","openshift-dns/node-resolver-mp9pb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal","openshift-network-diagnostics/network-check-target-r99p9","openshift-ovn-kubernetes/ovnkube-node-ps2zl","kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn","openshift-image-registry/node-ca-srrdw","openshift-multus/multus-additional-cni-plugins-7pmhp","openshift-multus/multus-hq8vc","openshift-multus/network-metrics-daemon-w4v8j","openshift-network-operator/iptables-alerter-w9dbb"] Sep 09 23:17:17.303173 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.303152 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.305922 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.305898 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.306437 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.306416 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Sep 09 23:17:17.306437 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.306418 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rcnn6\"" Sep 09 23:17:17.307600 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.307534 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Sep 09 23:17:17.307600 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.307560 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Sep 09 23:17:17.307805 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.307617 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.307805 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.307799 2583 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Sep 09 23:17:17.307907 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.307816 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.309048 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.308730 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.309048 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.308749 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Sep 09 23:17:17.309048 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.308850 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Sep 09 23:17:17.309048 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.308858 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Sep 09 23:17:17.309048 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.308947 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Sep 09 23:17:17.309048 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.309004 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.309379 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.309113 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.309580 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.309561 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-z8ggh\"" Sep 09 23:17:17.310498 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.309898 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.310498 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.310018 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-fs2hq\"" Sep 09 23:17:17.310498 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.310191 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.310498 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.310285 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.312918 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.312394 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.312918 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.312695 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.313429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.313354 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-bxdbl\"" Sep 09 23:17:17.314196 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.313577 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.315543 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.315636 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.316070 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.316235 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317543 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-modprobe-d\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317580 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysctl-conf\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317611 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-run\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317642 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-node-log\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317673 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317707 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317733 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-kubernetes\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317763 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-tmp\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317793 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-kubelet\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317825 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovnkube-config\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317853 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysconfig\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317876 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-lib-modules\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317904 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-var-lib-kubelet\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.318376 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317933 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-host\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.317976 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-env-overrides\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318000 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovnkube-script-lib\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318027 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-wfndt\"" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318152 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318049 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318207 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-sys\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318246 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d959b05-e8b6-410a-ab1f-003d5e42b7db-tmp-dir\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318277 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-etc-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318301 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318335 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-cni-bin\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318337 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318572 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysctl-d\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318619 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-systemd\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq8nh\" (UniqueName: \"kubernetes.io/projected/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-kube-api-access-kq8nh\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318715 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d959b05-e8b6-410a-ab1f-003d5e42b7db-hosts-file\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318757 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92nkk\" (UniqueName: \"kubernetes.io/projected/6d959b05-e8b6-410a-ab1f-003d5e42b7db-kube-api-access-92nkk\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318789 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-run-netns\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.319295 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318814 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-tuned\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318873 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-slash\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.318937 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-var-lib-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319012 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319039 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55wvk\" (UniqueName: \"kubernetes.io/projected/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-kube-api-access-55wvk\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319071 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-system-cni-dir\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319116 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cnibin\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319172 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319221 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-systemd-units\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319263 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-systemd\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319297 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-ovn\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319400 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-log-socket\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319800 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovn-node-metrics-cert\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319831 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319856 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-cni-netd\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.319890 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66258\" (UniqueName: \"kubernetes.io/projected/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-kube-api-access-66258\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.320200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.320144 2583 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Sep 09 23:17:17.320863 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.320551 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.320863 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.320854 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-sbqmf\"" Sep 09 23:17:17.320955 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.320889 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:17.320955 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.320934 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:17.321440 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.321419 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.321557 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.321511 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Sep 09 23:17:17.323199 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.323181 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.325888 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.325451 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Sep 09 23:17:17.325888 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.325714 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q2xqz\"" Sep 09 23:17:17.325888 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.325792 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.326392 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.326362 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Sep 09 23:17:17.327754 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.327690 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.327858 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.327810 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:17.329019 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.328601 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Sep 09 23:17:17.329669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.329283 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Sep 09 23:17:17.329669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.329327 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8src2\"" Sep 09 23:17:17.329669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.329283 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Sep 09 23:17:17.330068 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.330050 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.332505 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.332490 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Sep 09 23:17:17.332621 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.332604 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-c5sq8\"" Sep 09 23:17:17.336365 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.336346 2583 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mnjjm" Sep 09 23:17:17.342364 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.342337 2583 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mnjjm" Sep 09 23:17:17.358995 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.358690 2583 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Sep 09 23:17:17.409647 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.409631 2583 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Sep 09 23:17:17.420406 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420384 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-run\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.420533 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420419 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-node-log\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.420533 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420457 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.420533 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420479 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.420533 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420505 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-cni-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.420737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420560 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-host\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.420737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420569 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-node-log\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.420737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420577 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-kubernetes\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.420737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420627 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovnkube-config\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.420737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420659 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-device-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.420737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420688 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-kubernetes\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.420737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420718 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d83c89fc-0232-4959-be96-d944ea5c8cb8-cni-binary-copy\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420746 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-lib-modules\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420769 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-host\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420778 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-run\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420835 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-conf-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d959b05-e8b6-410a-ab1f-003d5e42b7db-tmp-dir\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420871 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-etc-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420927 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-etc-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420963 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.420954 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-host\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.421052 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421025 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421060 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421087 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421105 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-lib-modules\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421143 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-cnibin\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421174 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54v57\" (UniqueName: \"kubernetes.io/projected/d83c89fc-0232-4959-be96-d944ea5c8cb8-kube-api-access-54v57\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421199 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-serviceca\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421229 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-systemd\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421274 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6d959b05-e8b6-410a-ab1f-003d5e42b7db-tmp-dir\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421304 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-systemd\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421388 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92nkk\" (UniqueName: \"kubernetes.io/projected/6d959b05-e8b6-410a-ab1f-003d5e42b7db-kube-api-access-92nkk\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.421654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421423 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-run-netns\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421447 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421825 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a25f2eb-7fd8-4e1d-b57b-beef85fe265f-agent-certs\") pod \"konnectivity-agent-2t29c\" (UID: \"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f\") " pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.422081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a25f2eb-7fd8-4e1d-b57b-beef85fe265f-konnectivity-ca\") pod \"konnectivity-agent-2t29c\" (UID: \"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f\") " pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.422081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421893 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-cni-bin\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.422081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421948 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.422081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421977 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56k8j\" (UniqueName: \"kubernetes.io/projected/7b337dc8-16e6-4ab5-a441-bc088d213673-kube-api-access-56k8j\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.422081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422034 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.422302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422042 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.422302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422133 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422154 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-daemon-config\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.422302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.421511 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-run-netns\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422193 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-multus-certs\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.422302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422282 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e269bd70-1060-4550-8573-592ee667a05d-host-slash\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.422596 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422572 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-ovn\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422649 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422599 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-ovn\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422649 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422599 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovnkube-config\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422745 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422659 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.422797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422743 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sm79f\" (UniqueName: \"kubernetes.io/projected/e269bd70-1060-4550-8573-592ee667a05d-kube-api-access-sm79f\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.422797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422772 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-cni-netd\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.422887 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422802 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-socket-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.422887 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422832 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt96z\" (UniqueName: \"kubernetes.io/projected/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-kube-api-access-lt96z\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:17.422887 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422860 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-netns\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.423012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422899 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysctl-conf\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422931 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-tmp\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.422962 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-kubelet\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.423143 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423051 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-cni-multus\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.423143 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423070 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-cni-netd\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.423143 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423093 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysconfig\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423273 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423151 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysconfig\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423273 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423184 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-var-lib-kubelet\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423273 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423257 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-env-overrides\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.423414 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423291 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysctl-conf\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423414 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423296 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovnkube-script-lib\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.423414 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423335 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.423414 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423392 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-sys\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423614 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423466 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-cni-bin\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.423614 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423500 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2fcef21-91e1-4349-bba6-6388e3afdf03-dbus\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.423614 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423552 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysctl-d\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423614 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423582 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kq8nh\" (UniqueName: \"kubernetes.io/projected/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-kube-api-access-kq8nh\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423821 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423726 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d959b05-e8b6-410a-ab1f-003d5e42b7db-hosts-file\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.423821 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423752 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55wvk\" (UniqueName: \"kubernetes.io/projected/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-kube-api-access-55wvk\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.423821 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423796 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-system-cni-dir\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.423953 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423839 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.423953 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423870 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-registration-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.423953 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423913 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-tuned\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.423953 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423940 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-slash\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.424136 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423938 2583 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Sep 09 23:17:17.424136 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.423966 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-var-lib-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.424136 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424034 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cnibin\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.424136 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424063 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-sys-fs\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.424136 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424105 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-socket-dir-parent\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.424355 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424166 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-k8s-cni-cncf-io\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.424355 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424214 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-hostroot\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.424355 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424243 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-systemd-units\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.424355 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424293 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-systemd\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.424556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424346 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-log-socket\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.424556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424472 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovn-node-metrics-cert\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.424556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424501 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e269bd70-1060-4550-8573-592ee667a05d-iptables-alerter-script\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.424556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66258\" (UniqueName: \"kubernetes.io/projected/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-kube-api-access-66258\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.424745 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424603 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2fcef21-91e1-4349-bba6-6388e3afdf03-kubelet-config\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.424745 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424631 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-system-cni-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.424745 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424657 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-kubelet\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.424745 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424719 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-etc-kubernetes\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.424924 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424743 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:17.424924 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424795 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq6rs\" (UniqueName: \"kubernetes.io/projected/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-kube-api-access-gq6rs\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.424924 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424849 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-modprobe-d\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.425068 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.424989 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-modprobe-d\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.425596 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425445 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-kubelet\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.425596 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425487 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6d959b05-e8b6-410a-ab1f-003d5e42b7db-hosts-file\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.425731 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425584 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-system-cni-dir\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.425731 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425675 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-sysctl-d\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.425854 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425832 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-var-lib-kubelet\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.425914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425873 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.425964 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425914 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-systemd-units\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.425964 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425943 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-var-lib-openvswitch\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.426058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.425964 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-run-systemd\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.426058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426017 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-log-socket\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.426058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426020 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cnibin\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.426200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426075 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-slash\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.426200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426173 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-cni-binary-copy\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.426511 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426319 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovnkube-script-lib\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.426511 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426306 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.426511 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426418 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-sys\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.426723 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426072 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-host-cni-bin\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.426723 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.426683 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-env-overrides\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.429852 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.429807 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-etc-tuned\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.429852 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.429840 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-tmp\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.429960 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.429928 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-ovn-node-metrics-cert\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.434398 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.434373 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92nkk\" (UniqueName: \"kubernetes.io/projected/6d959b05-e8b6-410a-ab1f-003d5e42b7db-kube-api-access-92nkk\") pod \"node-resolver-mp9pb\" (UID: \"6d959b05-e8b6-410a-ab1f-003d5e42b7db\") " pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.434961 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.434937 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq8nh\" (UniqueName: \"kubernetes.io/projected/4c27c7f7-514e-47bb-a6d1-d4d255dddeaa-kube-api-access-kq8nh\") pod \"tuned-x6hnc\" (UID: \"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa\") " pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.435577 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.435552 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55wvk\" (UniqueName: \"kubernetes.io/projected/a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9-kube-api-access-55wvk\") pod \"ovnkube-node-ps2zl\" (UID: \"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.435950 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.435929 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66258\" (UniqueName: \"kubernetes.io/projected/511989b6-e9ae-4dcb-ad5e-c1e9aa6de097-kube-api-access-66258\") pod \"multus-additional-cni-plugins-7pmhp\" (UID: \"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097\") " pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.525915 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.525890 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2fcef21-91e1-4349-bba6-6388e3afdf03-dbus\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.526023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.525934 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-registration-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.526023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.525959 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-sys-fs\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.526023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.525981 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-socket-dir-parent\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526003 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-k8s-cni-cncf-io\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526023 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526024 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-hostroot\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526048 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e269bd70-1060-4550-8573-592ee667a05d-iptables-alerter-script\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526073 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2fcef21-91e1-4349-bba6-6388e3afdf03-kubelet-config\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526095 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-system-cni-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526117 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-kubelet\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526153 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-etc-kubernetes\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526169 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-k8s-cni-cncf-io\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526232 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq6rs\" (UniqueName: \"kubernetes.io/projected/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-kube-api-access-gq6rs\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526250 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-hostroot\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526266 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-cni-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526291 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-host\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526318 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-device-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526343 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d83c89fc-0232-4959-be96-d944ea5c8cb8-cni-binary-copy\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526375 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-socket-dir-parent\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-conf-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526402 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-registration-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526426 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526425 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-conf-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526466 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526492 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-cnibin\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526536 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54v57\" (UniqueName: \"kubernetes.io/projected/d83c89fc-0232-4959-be96-d944ea5c8cb8-kube-api-access-54v57\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526562 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-serviceca\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526574 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-etc-selinux\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526592 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a25f2eb-7fd8-4e1d-b57b-beef85fe265f-agent-certs\") pod \"konnectivity-agent-2t29c\" (UID: \"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f\") " pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526622 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a25f2eb-7fd8-4e1d-b57b-beef85fe265f-konnectivity-ca\") pod \"konnectivity-agent-2t29c\" (UID: \"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f\") " pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526650 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-cni-bin\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526673 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.526772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526694 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-system-cni-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526711 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56k8j\" (UniqueName: \"kubernetes.io/projected/7b337dc8-16e6-4ab5-a441-bc088d213673-kube-api-access-56k8j\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526757 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/f2fcef21-91e1-4349-bba6-6388e3afdf03-kubelet-config\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526765 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-sys-fs\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526769 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e269bd70-1060-4550-8573-592ee667a05d-iptables-alerter-script\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526792 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526809 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-cni-bin\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-daemon-config\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526844 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-multus-certs\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526852 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-kubelet-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526877 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-cni-dir\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526866 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e269bd70-1060-4550-8573-592ee667a05d-host-slash\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526899 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-device-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526917 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e269bd70-1060-4550-8573-592ee667a05d-host-slash\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526924 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sm79f\" (UniqueName: \"kubernetes.io/projected/e269bd70-1060-4550-8573-592ee667a05d-kube-api-access-sm79f\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526935 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-host\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526952 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-socket-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.527625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526965 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-multus-certs\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.526980 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt96z\" (UniqueName: \"kubernetes.io/projected/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-kube-api-access-lt96z\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527000 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-etc-kubernetes\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527007 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-kubelet\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.527038 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527065 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-netns\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527076 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-cnibin\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.527110 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs podName:ecde3b41-da5a-42e3-a3b2-bf422e8e3ace nodeName:}" failed. No retries permitted until 2026-09-09 23:17:18.027078336 +0000 UTC m=+3.055088683 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs") pod "network-metrics-daemon-w4v8j" (UID: "ecde3b41-da5a-42e3-a3b2-bf422e8e3ace") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527120 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/7b337dc8-16e6-4ab5-a441-bc088d213673-socket-dir\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527146 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-run-netns\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.527174 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527190 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-cni-multus\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.527220 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret podName:f2fcef21-91e1-4349-bba6-6388e3afdf03 nodeName:}" failed. No retries permitted until 2026-09-09 23:17:18.027203217 +0000 UTC m=+3.055213579 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret") pod "global-pull-secret-syncer-xhn5n" (UID: "f2fcef21-91e1-4349-bba6-6388e3afdf03") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527250 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/f2fcef21-91e1-4349-bba6-6388e3afdf03-dbus\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527249 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d83c89fc-0232-4959-be96-d944ea5c8cb8-host-var-lib-cni-multus\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527507 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/7a25f2eb-7fd8-4e1d-b57b-beef85fe265f-konnectivity-ca\") pod \"konnectivity-agent-2t29c\" (UID: \"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f\") " pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527701 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-serviceca\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.528465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527744 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d83c89fc-0232-4959-be96-d944ea5c8cb8-cni-binary-copy\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.529345 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.527821 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d83c89fc-0232-4959-be96-d944ea5c8cb8-multus-daemon-config\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.529732 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.529713 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/7a25f2eb-7fd8-4e1d-b57b-beef85fe265f-agent-certs\") pod \"konnectivity-agent-2t29c\" (UID: \"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f\") " pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.530114 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.530058 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" event={"ID":"3cdd65af97b5510fd0cbdb7cae07a57d","Type":"ContainerStarted","Data":"854d86e79ac0a8572e4784a75450dd60aaca78f7c56fffcb0322b7d23302fcc0"} Sep 09 23:17:17.531435 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.531411 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" event={"ID":"e195e4e5da6f6487716f095dd40c0088","Type":"ContainerStarted","Data":"d6e1073a80dd68c3c26f01945ccb2c08edf751f7740c75463892b255e91d0c26"} Sep 09 23:17:17.533946 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.533900 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:17:17.534037 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.533953 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:17:17.534037 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.533969 2583 projected.go:196] Error preparing data for projected volume kube-api-access-8lpr6 for pod openshift-network-diagnostics/network-check-target-r99p9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:17.534037 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:17.534021 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6 podName:cffe2394-c868-446f-8ccc-f77072fd73bc nodeName:}" failed. No retries permitted until 2026-09-09 23:17:18.034006479 +0000 UTC m=+3.062016844 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-8lpr6" (UniqueName: "kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6") pod "network-check-target-r99p9" (UID: "cffe2394-c868-446f-8ccc-f77072fd73bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:17.535635 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.535612 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq6rs\" (UniqueName: \"kubernetes.io/projected/5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d-kube-api-access-gq6rs\") pod \"node-ca-srrdw\" (UID: \"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d\") " pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.536696 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.536673 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56k8j\" (UniqueName: \"kubernetes.io/projected/7b337dc8-16e6-4ab5-a441-bc088d213673-kube-api-access-56k8j\") pod \"aws-ebs-csi-driver-node-b2bsn\" (UID: \"7b337dc8-16e6-4ab5-a441-bc088d213673\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.536866 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.536843 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt96z\" (UniqueName: \"kubernetes.io/projected/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-kube-api-access-lt96z\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:17.537298 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.537279 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-54v57\" (UniqueName: \"kubernetes.io/projected/d83c89fc-0232-4959-be96-d944ea5c8cb8-kube-api-access-54v57\") pod \"multus-hq8vc\" (UID: \"d83c89fc-0232-4959-be96-d944ea5c8cb8\") " pod="openshift-multus/multus-hq8vc" Sep 09 23:17:17.538170 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.538131 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sm79f\" (UniqueName: \"kubernetes.io/projected/e269bd70-1060-4550-8573-592ee667a05d-kube-api-access-sm79f\") pod \"iptables-alerter-w9dbb\" (UID: \"e269bd70-1060-4550-8573-592ee667a05d\") " pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.622442 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.622384 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:17.628478 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.628460 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" Sep 09 23:17:17.634543 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:17.634504 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4dcbb85_1ce8_4b0c_9116_e24b3b26f1a9.slice/crio-0c60f12a5b0811e30b4894e83e17b36f777fc0d68b106599f19a67da149ce6a3 WatchSource:0}: Error finding container 0c60f12a5b0811e30b4894e83e17b36f777fc0d68b106599f19a67da149ce6a3: Status 404 returned error can't find the container with id 0c60f12a5b0811e30b4894e83e17b36f777fc0d68b106599f19a67da149ce6a3 Sep 09 23:17:17.638444 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.638287 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" Sep 09 23:17:17.640196 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:17.640173 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod511989b6_e9ae_4dcb_ad5e_c1e9aa6de097.slice/crio-0d70df87685e8a6094a6e501341a03842de4104fdc8d299aa4465ccfa5956b11 WatchSource:0}: Error finding container 0d70df87685e8a6094a6e501341a03842de4104fdc8d299aa4465ccfa5956b11: Status 404 returned error can't find the container with id 0d70df87685e8a6094a6e501341a03842de4104fdc8d299aa4465ccfa5956b11 Sep 09 23:17:17.644505 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.644357 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mp9pb" Sep 09 23:17:17.648596 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:17.648574 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c27c7f7_514e_47bb_a6d1_d4d255dddeaa.slice/crio-9b9fab8a4bb25a5fd047c541f8b76f46a69616e473eb01990bd8a109f46f50ae WatchSource:0}: Error finding container 9b9fab8a4bb25a5fd047c541f8b76f46a69616e473eb01990bd8a109f46f50ae: Status 404 returned error can't find the container with id 9b9fab8a4bb25a5fd047c541f8b76f46a69616e473eb01990bd8a109f46f50ae Sep 09 23:17:17.653696 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.653478 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-w9dbb" Sep 09 23:17:17.654864 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:17.654836 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d959b05_e8b6_410a_ab1f_003d5e42b7db.slice/crio-24dfd31615b37629d55476c4e0d6400e21cfa90e7a5467f61e4dd2583821a206 WatchSource:0}: Error finding container 24dfd31615b37629d55476c4e0d6400e21cfa90e7a5467f61e4dd2583821a206: Status 404 returned error can't find the container with id 24dfd31615b37629d55476c4e0d6400e21cfa90e7a5467f61e4dd2583821a206 Sep 09 23:17:17.661338 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.661318 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" Sep 09 23:17:17.664773 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:17.664744 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode269bd70_1060_4550_8573_592ee667a05d.slice/crio-9d2bdc11fff0fbf050d8e3a0762e72e33363f45ee04910accdcb77e4402cf6d2 WatchSource:0}: Error finding container 9d2bdc11fff0fbf050d8e3a0762e72e33363f45ee04910accdcb77e4402cf6d2: Status 404 returned error can't find the container with id 9d2bdc11fff0fbf050d8e3a0762e72e33363f45ee04910accdcb77e4402cf6d2 Sep 09 23:17:17.670887 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.670742 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:17.671441 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:17.671421 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b337dc8_16e6_4ab5_a441_bc088d213673.slice/crio-f5e97d2fcdc94d95fe8b7bab5c1adeb0c5b9036a8a73d4a4e1d58ac88e4f6210 WatchSource:0}: Error finding container f5e97d2fcdc94d95fe8b7bab5c1adeb0c5b9036a8a73d4a4e1d58ac88e4f6210: Status 404 returned error can't find the container with id f5e97d2fcdc94d95fe8b7bab5c1adeb0c5b9036a8a73d4a4e1d58ac88e4f6210 Sep 09 23:17:17.678552 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.678426 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-srrdw" Sep 09 23:17:17.685063 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:17.685040 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hq8vc" Sep 09 23:17:18.031016 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.030948 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:18.031016 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.030996 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:18.031193 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.031148 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:18.031228 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.031204 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:18.031228 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.031221 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs podName:ecde3b41-da5a-42e3-a3b2-bf422e8e3ace nodeName:}" failed. No retries permitted until 2026-09-09 23:17:19.03120108 +0000 UTC m=+4.059211431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs") pod "network-metrics-daemon-w4v8j" (UID: "ecde3b41-da5a-42e3-a3b2-bf422e8e3ace") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:18.031313 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.031267 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret podName:f2fcef21-91e1-4349-bba6-6388e3afdf03 nodeName:}" failed. No retries permitted until 2026-09-09 23:17:19.031248178 +0000 UTC m=+4.059258534 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret") pod "global-pull-secret-syncer-xhn5n" (UID: "f2fcef21-91e1-4349-bba6-6388e3afdf03") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:18.132241 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.132212 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:18.132411 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.132392 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:17:18.132452 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.132416 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:17:18.132452 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.132429 2583 projected.go:196] Error preparing data for projected volume kube-api-access-8lpr6 for pod openshift-network-diagnostics/network-check-target-r99p9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:18.132557 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.132494 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6 podName:cffe2394-c868-446f-8ccc-f77072fd73bc nodeName:}" failed. No retries permitted until 2026-09-09 23:17:19.132479088 +0000 UTC m=+4.160489436 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lpr6" (UniqueName: "kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6") pod "network-check-target-r99p9" (UID: "cffe2394-c868-446f-8ccc-f77072fd73bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:18.306278 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:18.306215 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7a25f2eb_7fd8_4e1d_b57b_beef85fe265f.slice/crio-0145c9860e0e1b86419fe30989c4c3bb0884a4c03637c05e02292bdb269540d9 WatchSource:0}: Error finding container 0145c9860e0e1b86419fe30989c4c3bb0884a4c03637c05e02292bdb269540d9: Status 404 returned error can't find the container with id 0145c9860e0e1b86419fe30989c4c3bb0884a4c03637c05e02292bdb269540d9 Sep 09 23:17:18.345687 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.345645 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:12:17 +0000 UTC" deadline="2028-05-11 18:55:31.786906852 +0000 UTC" Sep 09 23:17:18.345687 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.345680 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14635h38m13.441231289s" Sep 09 23:17:18.523369 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.523339 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:18.523548 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.523468 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:18.523887 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.523864 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:18.523996 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:18.523974 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:18.554215 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.554112 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" event={"ID":"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa","Type":"ContainerStarted","Data":"9b9fab8a4bb25a5fd047c541f8b76f46a69616e473eb01990bd8a109f46f50ae"} Sep 09 23:17:18.559187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.559132 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerStarted","Data":"0d70df87685e8a6094a6e501341a03842de4104fdc8d299aa4465ccfa5956b11"} Sep 09 23:17:18.563538 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.563439 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mp9pb" event={"ID":"6d959b05-e8b6-410a-ab1f-003d5e42b7db","Type":"ContainerStarted","Data":"24dfd31615b37629d55476c4e0d6400e21cfa90e7a5467f61e4dd2583821a206"} Sep 09 23:17:18.567385 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.567358 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"0c60f12a5b0811e30b4894e83e17b36f777fc0d68b106599f19a67da149ce6a3"} Sep 09 23:17:18.570946 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.570920 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2t29c" event={"ID":"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f","Type":"ContainerStarted","Data":"0145c9860e0e1b86419fe30989c4c3bb0884a4c03637c05e02292bdb269540d9"} Sep 09 23:17:18.581590 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.581567 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" event={"ID":"7b337dc8-16e6-4ab5-a441-bc088d213673","Type":"ContainerStarted","Data":"f5e97d2fcdc94d95fe8b7bab5c1adeb0c5b9036a8a73d4a4e1d58ac88e4f6210"} Sep 09 23:17:18.584323 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:18.584276 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w9dbb" event={"ID":"e269bd70-1060-4550-8573-592ee667a05d","Type":"ContainerStarted","Data":"9d2bdc11fff0fbf050d8e3a0762e72e33363f45ee04910accdcb77e4402cf6d2"} Sep 09 23:17:18.956597 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:18.956548 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a95fd43_ec7f_4f2f_bea8_a47f1af97c1d.slice/crio-a642305843a755df5f513d88c765a726a2e07eb82a8a2ef02312b6b087dbbb4a WatchSource:0}: Error finding container a642305843a755df5f513d88c765a726a2e07eb82a8a2ef02312b6b087dbbb4a: Status 404 returned error can't find the container with id a642305843a755df5f513d88c765a726a2e07eb82a8a2ef02312b6b087dbbb4a Sep 09 23:17:18.962219 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:17:18.962197 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd83c89fc_0232_4959_be96_d944ea5c8cb8.slice/crio-b1034366ddd8bb95e2b573139183a7d9db2daab7e95e4adf10729beb02a03e39 WatchSource:0}: Error finding container b1034366ddd8bb95e2b573139183a7d9db2daab7e95e4adf10729beb02a03e39: Status 404 returned error can't find the container with id b1034366ddd8bb95e2b573139183a7d9db2daab7e95e4adf10729beb02a03e39 Sep 09 23:17:19.048975 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.048944 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:19.049072 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.048997 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:19.049145 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.049114 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:19.049204 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.049177 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret podName:f2fcef21-91e1-4349-bba6-6388e3afdf03 nodeName:}" failed. No retries permitted until 2026-09-09 23:17:21.049160752 +0000 UTC m=+6.077171107 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret") pod "global-pull-secret-syncer-xhn5n" (UID: "f2fcef21-91e1-4349-bba6-6388e3afdf03") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:19.049619 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.049602 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:19.049701 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.049653 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs podName:ecde3b41-da5a-42e3-a3b2-bf422e8e3ace nodeName:}" failed. No retries permitted until 2026-09-09 23:17:21.049639107 +0000 UTC m=+6.077649461 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs") pod "network-metrics-daemon-w4v8j" (UID: "ecde3b41-da5a-42e3-a3b2-bf422e8e3ace") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:19.150371 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.150339 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:19.150510 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.150494 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:17:19.150596 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.150537 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:17:19.150596 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.150551 2583 projected.go:196] Error preparing data for projected volume kube-api-access-8lpr6 for pod openshift-network-diagnostics/network-check-target-r99p9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:19.150716 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.150610 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6 podName:cffe2394-c868-446f-8ccc-f77072fd73bc nodeName:}" failed. No retries permitted until 2026-09-09 23:17:21.150591805 +0000 UTC m=+6.178602166 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lpr6" (UniqueName: "kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6") pod "network-check-target-r99p9" (UID: "cffe2394-c868-446f-8ccc-f77072fd73bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:19.349383 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.349277 2583 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-09-08 23:12:17 +0000 UTC" deadline="2028-05-07 16:18:42.013030143 +0000 UTC" Sep 09 23:17:19.349383 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.349336 2583 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14537h1m22.663698433s" Sep 09 23:17:19.526682 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.526130 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:19.526682 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:19.526320 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:19.602732 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.601921 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" event={"ID":"3cdd65af97b5510fd0cbdb7cae07a57d","Type":"ContainerStarted","Data":"2b18e43de4768ef957898b4a2bcb56e4e5b8381bc02f9ca3668aa022a9c8e98d"} Sep 09 23:17:19.616439 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.615093 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-161.ec2.internal" podStartSLOduration=3.615073882 podStartE2EDuration="3.615073882s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:19.614953519 +0000 UTC m=+4.642963891" watchObservedRunningTime="2026-09-09 23:17:19.615073882 +0000 UTC m=+4.643084243" Sep 09 23:17:19.616439 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.616367 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hq8vc" event={"ID":"d83c89fc-0232-4959-be96-d944ea5c8cb8","Type":"ContainerStarted","Data":"b1034366ddd8bb95e2b573139183a7d9db2daab7e95e4adf10729beb02a03e39"} Sep 09 23:17:19.620742 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:19.620677 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-srrdw" event={"ID":"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d","Type":"ContainerStarted","Data":"a642305843a755df5f513d88c765a726a2e07eb82a8a2ef02312b6b087dbbb4a"} Sep 09 23:17:20.523882 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:20.523775 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:20.523882 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:20.523806 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:20.524547 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:20.523922 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:20.524547 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:20.524042 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:20.631551 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:20.630396 2583 generic.go:356] "Generic (PLEG): container finished" podID="e195e4e5da6f6487716f095dd40c0088" containerID="8fdf7235fa76a8a5b80ca2bdb32f6c58e62df149403b3c778785983c9f59b8ce" exitCode=0 Sep 09 23:17:20.631551 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:20.631281 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" event={"ID":"e195e4e5da6f6487716f095dd40c0088","Type":"ContainerDied","Data":"8fdf7235fa76a8a5b80ca2bdb32f6c58e62df149403b3c778785983c9f59b8ce"} Sep 09 23:17:21.067058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:21.066798 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:21.067058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:21.066859 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:21.067058 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.066976 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:21.067058 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.067000 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:21.067058 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.067055 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs podName:ecde3b41-da5a-42e3-a3b2-bf422e8e3ace nodeName:}" failed. No retries permitted until 2026-09-09 23:17:25.067035253 +0000 UTC m=+10.095045617 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs") pod "network-metrics-daemon-w4v8j" (UID: "ecde3b41-da5a-42e3-a3b2-bf422e8e3ace") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:21.067479 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.067076 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret podName:f2fcef21-91e1-4349-bba6-6388e3afdf03 nodeName:}" failed. No retries permitted until 2026-09-09 23:17:25.06706509 +0000 UTC m=+10.095075444 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret") pod "global-pull-secret-syncer-xhn5n" (UID: "f2fcef21-91e1-4349-bba6-6388e3afdf03") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:21.168162 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:21.168126 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:21.168382 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.168311 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:17:21.168382 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.168336 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:17:21.168382 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.168351 2583 projected.go:196] Error preparing data for projected volume kube-api-access-8lpr6 for pod openshift-network-diagnostics/network-check-target-r99p9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:21.168643 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.168406 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6 podName:cffe2394-c868-446f-8ccc-f77072fd73bc nodeName:}" failed. No retries permitted until 2026-09-09 23:17:25.168388714 +0000 UTC m=+10.196399068 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lpr6" (UniqueName: "kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6") pod "network-check-target-r99p9" (UID: "cffe2394-c868-446f-8ccc-f77072fd73bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:21.523933 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:21.523865 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:21.524451 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:21.524016 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:22.523411 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:22.523374 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:22.523563 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:22.523516 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:22.523880 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:22.523851 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:22.523980 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:22.523958 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:23.524251 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:23.524221 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:23.524657 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:23.524347 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:24.523363 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:24.523261 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:24.523509 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:24.523399 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:24.523509 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:24.523453 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:24.523652 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:24.523583 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:25.098169 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:25.098130 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:25.098620 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:25.098192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:25.098620 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.098237 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:25.098620 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.098311 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs podName:ecde3b41-da5a-42e3-a3b2-bf422e8e3ace nodeName:}" failed. No retries permitted until 2026-09-09 23:17:33.098288322 +0000 UTC m=+18.126298671 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs") pod "network-metrics-daemon-w4v8j" (UID: "ecde3b41-da5a-42e3-a3b2-bf422e8e3ace") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:25.098620 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.098311 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:25.098620 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.098368 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret podName:f2fcef21-91e1-4349-bba6-6388e3afdf03 nodeName:}" failed. No retries permitted until 2026-09-09 23:17:33.098351127 +0000 UTC m=+18.126361479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret") pod "global-pull-secret-syncer-xhn5n" (UID: "f2fcef21-91e1-4349-bba6-6388e3afdf03") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:25.199161 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:25.199034 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:25.199333 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.199216 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:17:25.199333 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.199239 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:17:25.199333 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.199254 2583 projected.go:196] Error preparing data for projected volume kube-api-access-8lpr6 for pod openshift-network-diagnostics/network-check-target-r99p9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:25.199333 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.199315 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6 podName:cffe2394-c868-446f-8ccc-f77072fd73bc nodeName:}" failed. No retries permitted until 2026-09-09 23:17:33.199296594 +0000 UTC m=+18.227306956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lpr6" (UniqueName: "kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6") pod "network-check-target-r99p9" (UID: "cffe2394-c868-446f-8ccc-f77072fd73bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:25.524666 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:25.524585 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:25.524827 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:25.524691 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:26.524165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:26.524028 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:26.524165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:26.524069 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:26.524165 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:26.524159 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:26.524781 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:26.524266 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:27.523700 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:27.523647 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:27.523877 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:27.523777 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:28.523676 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:28.523643 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:28.524116 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:28.523657 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:28.524116 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:28.523749 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:28.524116 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:28.523910 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:29.523485 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:29.523452 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:29.523653 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:29.523596 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:30.523928 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:30.523888 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:30.524339 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:30.524025 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:30.524339 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:30.524076 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:30.524339 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:30.524187 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:31.524213 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:31.524179 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:31.524649 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:31.524303 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:32.523330 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:32.523298 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:32.523565 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:32.523298 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:32.523565 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:32.523405 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:32.523565 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:32.523484 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:33.153040 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:33.153000 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:33.153456 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:33.153061 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:33.153456 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.153139 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:33.153456 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.153169 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:33.153456 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.153211 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs podName:ecde3b41-da5a-42e3-a3b2-bf422e8e3ace nodeName:}" failed. No retries permitted until 2026-09-09 23:17:49.153193948 +0000 UTC m=+34.181204309 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs") pod "network-metrics-daemon-w4v8j" (UID: "ecde3b41-da5a-42e3-a3b2-bf422e8e3ace") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:33.153456 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.153228 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret podName:f2fcef21-91e1-4349-bba6-6388e3afdf03 nodeName:}" failed. No retries permitted until 2026-09-09 23:17:49.153219762 +0000 UTC m=+34.181230116 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret") pod "global-pull-secret-syncer-xhn5n" (UID: "f2fcef21-91e1-4349-bba6-6388e3afdf03") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:33.254242 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:33.254213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:33.254410 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.254351 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:17:33.254410 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.254369 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:17:33.254410 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.254380 2583 projected.go:196] Error preparing data for projected volume kube-api-access-8lpr6 for pod openshift-network-diagnostics/network-check-target-r99p9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:33.254589 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.254439 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6 podName:cffe2394-c868-446f-8ccc-f77072fd73bc nodeName:}" failed. No retries permitted until 2026-09-09 23:17:49.254421903 +0000 UTC m=+34.282432254 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lpr6" (UniqueName: "kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6") pod "network-check-target-r99p9" (UID: "cffe2394-c868-446f-8ccc-f77072fd73bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:33.523863 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:33.523781 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:33.523992 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:33.523895 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:34.524151 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:34.524113 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:34.524151 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:34.524137 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:34.524624 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:34.524226 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:34.524624 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:34.524358 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:35.525563 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.525225 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:35.526003 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:35.525675 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:35.660425 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.660397 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-2t29c" event={"ID":"7a25f2eb-7fd8-4e1d-b57b-beef85fe265f","Type":"ContainerStarted","Data":"d525d67af5bb718c000e38aaf9e0679747b4b7bb95609bb6debb038284538257"} Sep 09 23:17:35.661881 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.661860 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" event={"ID":"7b337dc8-16e6-4ab5-a441-bc088d213673","Type":"ContainerStarted","Data":"57f398a9109931f10ad27d5da892b5223b2f21ee9c14c9c3828d5b9fdd28a798"} Sep 09 23:17:35.663155 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.663134 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" event={"ID":"4c27c7f7-514e-47bb-a6d1-d4d255dddeaa","Type":"ContainerStarted","Data":"585a95f372ec7edfdc33256885ea46e3df1dbac1b5fd8e6a59032b83efa6fa23"} Sep 09 23:17:35.664587 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.664563 2583 generic.go:356] "Generic (PLEG): container finished" podID="511989b6-e9ae-4dcb-ad5e-c1e9aa6de097" containerID="846e18dc412aa11f4aa235d114a4c333338bc35ab200a960396dc4a64ba9a0e0" exitCode=0 Sep 09 23:17:35.664663 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.664637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerDied","Data":"846e18dc412aa11f4aa235d114a4c333338bc35ab200a960396dc4a64ba9a0e0"} Sep 09 23:17:35.666426 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.666408 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" event={"ID":"e195e4e5da6f6487716f095dd40c0088","Type":"ContainerStarted","Data":"e92fbe2bf494d01c0f8a45674729becf0616d6996a35da03b7ae568bd7f4b289"} Sep 09 23:17:35.667811 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.667789 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mp9pb" event={"ID":"6d959b05-e8b6-410a-ab1f-003d5e42b7db","Type":"ContainerStarted","Data":"d2c953b8b46b3f5d4b1a0d79a48223150738d176c3ad9e35c06bd46050e9b932"} Sep 09 23:17:35.670046 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.670029 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"6b9c8946c43705bceb802ef1aad1027f11da9dc69797fccdd856a2b67b9160a2"} Sep 09 23:17:35.670131 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.670078 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"2c126835a31404b99d732c305ebe73e48d9c232bc9274c1067fca624a72a05e0"} Sep 09 23:17:35.670131 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.670108 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"acc91928075ef97cdd54205ef4235c1560e1e0a767faf92a659cf1cd1e9caa18"} Sep 09 23:17:35.670213 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.670155 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"66d55e097fa4217a0cb7eaf1ef3caf4602ce74da9e8bc1bc950d3f1b45e282b5"} Sep 09 23:17:35.671792 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.671775 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hq8vc" event={"ID":"d83c89fc-0232-4959-be96-d944ea5c8cb8","Type":"ContainerStarted","Data":"d8e7b204662ed22cb97d9d498183a217e03f5253b1662afed372b11b687d809e"} Sep 09 23:17:35.673082 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.673064 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-srrdw" event={"ID":"5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d","Type":"ContainerStarted","Data":"44b80ae1d06cac73dba8120836c5840a6c05704ca35fc1ff1607dd54da5b0f35"} Sep 09 23:17:35.675768 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.675736 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-2t29c" podStartSLOduration=11.139524863 podStartE2EDuration="20.675723895s" totalImagesPullingTime="9.536199032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:35.675140693 +0000 UTC m=+20.703151063" watchObservedRunningTime="2026-09-09 23:17:35.675723895 +0000 UTC m=+20.703734264" Sep 09 23:17:35.688242 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.688209 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-srrdw" podStartSLOduration=4.434748122 podStartE2EDuration="20.68820246s" totalImagesPullingTime="16.253454338s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:35.687838868 +0000 UTC m=+20.715849238" watchObservedRunningTime="2026-09-09 23:17:35.68820246 +0000 UTC m=+20.716212830" Sep 09 23:17:35.704929 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.704889 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hq8vc" podStartSLOduration=4.35378526 podStartE2EDuration="20.704878014s" totalImagesPullingTime="16.351092754s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:35.704582716 +0000 UTC m=+20.732593085" watchObservedRunningTime="2026-09-09 23:17:35.704878014 +0000 UTC m=+20.732888381" Sep 09 23:17:35.717659 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.717629 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-161.ec2.internal" podStartSLOduration=19.717619107 podStartE2EDuration="19.717619107s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:35.717349247 +0000 UTC m=+20.745359627" watchObservedRunningTime="2026-09-09 23:17:35.717619107 +0000 UTC m=+20.745629476" Sep 09 23:17:35.767046 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.767026 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-srrdw_5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d/node-ca/0.log" Sep 09 23:17:35.796285 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.796220 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-x6hnc" podStartSLOduration=3.22876433 podStartE2EDuration="20.796200058s" totalImagesPullingTime="17.567435728s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:35.760509606 +0000 UTC m=+20.788519979" watchObservedRunningTime="2026-09-09 23:17:35.796200058 +0000 UTC m=+20.824210427" Sep 09 23:17:35.796351 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.796309 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mp9pb" podStartSLOduration=3.263722398 podStartE2EDuration="20.796304292s" totalImagesPullingTime="17.532581894s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:35.795640517 +0000 UTC m=+20.823650887" watchObservedRunningTime="2026-09-09 23:17:35.796304292 +0000 UTC m=+20.824314663" Sep 09 23:17:35.831189 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.831167 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:35.929932 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:35.929864 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:36.293969 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.293925 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:36.395322 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.395281 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:36.494279 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.494221 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:36.523739 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.523717 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:36.523821 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:36.523803 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:36.523872 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.523855 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:36.523966 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:36.523952 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:36.562636 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.562614 2583 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Sep 09 23:17:36.678133 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.678109 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"1e42bea0f14d6834f16df3c9ee5e6da12bc0c032963b2123edb5ea789750600d"} Sep 09 23:17:36.678237 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.678222 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"15337c9a0b5da8cbeab804d8b2268c44ce4547b145460ff384998a5cb66a4a99"} Sep 09 23:17:36.679868 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.679850 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" event={"ID":"7b337dc8-16e6-4ab5-a441-bc088d213673","Type":"ContainerStarted","Data":"d26606212dc06bb1272e12bbf99d94bc2f138475c900130b88cfbce926dc2bd8"} Sep 09 23:17:36.681294 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.681268 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-w9dbb" event={"ID":"e269bd70-1060-4550-8573-592ee667a05d","Type":"ContainerStarted","Data":"d6163944f171fc55653ccc9527a4bd132699e34840d057c81cbbba3fc1758d03"} Sep 09 23:17:36.697566 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.697512 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-w9dbb" podStartSLOduration=4.149605206 podStartE2EDuration="21.697500327s" totalImagesPullingTime="17.547895121s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:36.697148179 +0000 UTC m=+21.725158528" watchObservedRunningTime="2026-09-09 23:17:36.697500327 +0000 UTC m=+21.725510697" Sep 09 23:17:36.927969 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:36.927905 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:37.285646 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.285317 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:37.286039 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.286015 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:37.382612 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.382455 2583 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-09-09T23:17:36.562632143Z","UUID":"18fb2aa3-b478-478e-a44f-3de436a73523","Handler":null,"Name":"","Endpoint":""} Sep 09 23:17:37.384639 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.384613 2583 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Sep 09 23:17:37.384785 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.384652 2583 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Sep 09 23:17:37.528139 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.528100 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:37.528304 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:37.528237 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:37.684070 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.684044 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:37.684734 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:37.684571 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-2t29c" Sep 09 23:17:38.523958 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:38.523931 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:38.524138 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:38.523932 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:38.524138 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:38.524068 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:38.524222 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:38.524140 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:38.668019 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:38.667978 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:38.689506 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:38.689477 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"7bcf7cb138cf35408d3bf674498eda84c0cb98abed9c02ffa85c368eb66a9314"} Sep 09 23:17:38.691907 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:38.691881 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" event={"ID":"7b337dc8-16e6-4ab5-a441-bc088d213673","Type":"ContainerStarted","Data":"00ae297cf8dfa15dd15b388f679926dd612c075dea82e5962967cfd981ff83e7"} Sep 09 23:17:38.710009 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:38.709964 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-b2bsn" podStartSLOduration=4.163731523 podStartE2EDuration="23.709949809s" totalImagesPullingTime="19.546218286s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:38.709457635 +0000 UTC m=+23.737468010" watchObservedRunningTime="2026-09-09 23:17:38.709949809 +0000 UTC m=+23.737960178" Sep 09 23:17:38.918413 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:38.918280 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.018389 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:39.018360 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.119709 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:39.119678 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.219913 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:39.219840 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.320807 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:39.320770 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.421848 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:39.421821 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:39.524201 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:39.524144 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:39.524340 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:39.524245 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:39.970436 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:39.970409 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:40.524094 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.523912 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:40.524179 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.523912 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:40.524179 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:40.524136 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:40.524253 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:40.524236 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:40.568714 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.568690 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:40.700095 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.700069 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" event={"ID":"a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9","Type":"ContainerStarted","Data":"cb47e487297103cbaed0b11ae924178617bbee656a1804178f29114149f97cf7"} Sep 09 23:17:40.700351 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.700335 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:40.700442 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.700412 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:40.700499 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.700466 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:40.702324 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.702299 2583 generic.go:356] "Generic (PLEG): container finished" podID="511989b6-e9ae-4dcb-ad5e-c1e9aa6de097" containerID="da5d0a31652da7e3a49269b02fac7b2fa8ec49c7c9ee39fbf8803011da7f2c8b" exitCode=0 Sep 09 23:17:40.702414 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.702346 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerDied","Data":"da5d0a31652da7e3a49269b02fac7b2fa8ec49c7c9ee39fbf8803011da7f2c8b"} Sep 09 23:17:40.716008 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.715987 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:40.716149 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.716136 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:17:40.731323 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.731288 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" podStartSLOduration=8.129684244 podStartE2EDuration="25.731277751s" totalImagesPullingTime="17.601593507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:40.731130115 +0000 UTC m=+25.759140507" watchObservedRunningTime="2026-09-09 23:17:40.731277751 +0000 UTC m=+25.759288119" Sep 09 23:17:40.973209 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:40.973152 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:41.372981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:41.372906 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:41.523833 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:41.523798 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:41.523998 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:41.523911 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:41.573125 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:41.573096 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:41.969002 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:41.968973 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:42.365313 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.365281 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:42.524119 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.524084 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:42.524263 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.524086 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:42.524263 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:42.524186 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:42.524377 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:42.524285 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:42.708773 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.708716 2583 generic.go:356] "Generic (PLEG): container finished" podID="511989b6-e9ae-4dcb-ad5e-c1e9aa6de097" containerID="f8483b282ed26591eac9e5a3c20390d9d01dd6fcc9fd4f20d4b3a7d5ac408a7a" exitCode=0 Sep 09 23:17:42.708873 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.708797 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerDied","Data":"f8483b282ed26591eac9e5a3c20390d9d01dd6fcc9fd4f20d4b3a7d5ac408a7a"} Sep 09 23:17:42.735441 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.735414 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:42.788100 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.788079 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:42.967962 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:42.967901 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:43.180360 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:43.180334 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:43.444004 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:43.443976 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:43.523489 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:43.523465 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:43.523652 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:43.523629 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:43.543791 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:43.543764 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:43.713700 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:43.713630 2583 generic.go:356] "Generic (PLEG): container finished" podID="511989b6-e9ae-4dcb-ad5e-c1e9aa6de097" containerID="dd6b3d705b464949df82adb10e45488229f4aca6c55c1ed6dd3ba7cdc83e2a1e" exitCode=0 Sep 09 23:17:43.713799 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:43.713695 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerDied","Data":"dd6b3d705b464949df82adb10e45488229f4aca6c55c1ed6dd3ba7cdc83e2a1e"} Sep 09 23:17:44.372868 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:44.372792 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:44.524231 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:44.524200 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:44.524664 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:44.524200 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:44.524664 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:44.524304 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:44.524664 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:44.524373 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:44.567272 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:44.567241 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:44.765866 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:44.765791 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:44.935387 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:44.935355 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:44.993221 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:44.993183 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:45.524772 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:45.524743 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:45.525190 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:45.524851 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:45.583597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:45.583571 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:45.635991 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:45.635958 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:45.969493 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:45.969417 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:46.364183 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:46.364092 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:46.523224 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:46.523198 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:46.523224 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:46.523211 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:46.523415 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:46.523314 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:46.523415 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:46.523395 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:46.568948 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:46.568907 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:46.770768 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:46.770706 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:47.172173 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:47.172101 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:47.523786 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:47.523707 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:47.523938 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:47.523848 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:47.763053 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:47.763012 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:48.368956 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:48.368921 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:48.523774 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:48.523748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:48.523896 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:48.523748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:48.523896 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:48.523842 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:48.523971 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:48.523924 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:48.535771 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:48.535746 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:48.636826 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:48.636774 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:48.971019 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:48.970991 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:49.166077 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.166050 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:49.176848 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.176807 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:49.176848 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.176836 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:49.176948 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.176936 2583 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:49.176986 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.176942 2583 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:49.177019 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.176987 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret podName:f2fcef21-91e1-4349-bba6-6388e3afdf03 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:21.176972797 +0000 UTC m=+66.204983148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret") pod "global-pull-secret-syncer-xhn5n" (UID: "f2fcef21-91e1-4349-bba6-6388e3afdf03") : object "kube-system"/"original-pull-secret" not registered Sep 09 23:17:49.177019 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.177000 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs podName:ecde3b41-da5a-42e3-a3b2-bf422e8e3ace nodeName:}" failed. No retries permitted until 2026-09-09 23:18:21.176994727 +0000 UTC m=+66.205005074 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs") pod "network-metrics-daemon-w4v8j" (UID: "ecde3b41-da5a-42e3-a3b2-bf422e8e3ace") : object "openshift-multus"/"metrics-daemon-secret" not registered Sep 09 23:17:49.277238 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.277206 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:49.277374 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.277359 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Sep 09 23:17:49.277417 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.277380 2583 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Sep 09 23:17:49.277417 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.277388 2583 projected.go:196] Error preparing data for projected volume kube-api-access-8lpr6 for pod openshift-network-diagnostics/network-check-target-r99p9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:49.277472 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.277432 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6 podName:cffe2394-c868-446f-8ccc-f77072fd73bc nodeName:}" failed. No retries permitted until 2026-09-09 23:18:21.277417041 +0000 UTC m=+66.305427393 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-8lpr6" (UniqueName: "kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6") pod "network-check-target-r99p9" (UID: "cffe2394-c868-446f-8ccc-f77072fd73bc") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Sep 09 23:17:49.367794 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.367770 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:49.523892 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.523832 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:49.524005 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:49.523949 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:49.729186 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.729154 2583 generic.go:356] "Generic (PLEG): container finished" podID="511989b6-e9ae-4dcb-ad5e-c1e9aa6de097" containerID="ee36ce96d9bccc9abdaa5b792ef8ff87eb19f4043a6de726b5310ee413c94709" exitCode=0 Sep 09 23:17:49.729282 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:49.729203 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerDied","Data":"ee36ce96d9bccc9abdaa5b792ef8ff87eb19f4043a6de726b5310ee413c94709"} Sep 09 23:17:50.523411 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:50.523383 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:50.523868 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:50.523388 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:50.523868 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:50.523475 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:50.523868 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:50.523569 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:50.734190 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:50.734163 2583 generic.go:356] "Generic (PLEG): container finished" podID="511989b6-e9ae-4dcb-ad5e-c1e9aa6de097" containerID="32892d168057ef19e97e487035d029e1682d50d62610eae9b709a56ea2aff1df" exitCode=0 Sep 09 23:17:50.734370 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:50.734195 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerDied","Data":"32892d168057ef19e97e487035d029e1682d50d62610eae9b709a56ea2aff1df"} Sep 09 23:17:51.523587 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:51.523552 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:51.523958 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:51.523665 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:51.739802 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:51.739770 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" event={"ID":"511989b6-e9ae-4dcb-ad5e-c1e9aa6de097","Type":"ContainerStarted","Data":"16f7c9497324302d29827af7fdd1652f399bd896a3a23755c2122198367b01de"} Sep 09 23:17:51.760313 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:51.760272 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7pmhp" podStartSLOduration=7.894248505 podStartE2EDuration="36.760257075s" totalImagesPullingTime="28.86600857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:17:51.759697129 +0000 UTC m=+36.787707498" watchObservedRunningTime="2026-09-09 23:17:51.760257075 +0000 UTC m=+36.788267479" Sep 09 23:17:52.340659 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:52.340627 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:52.431147 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:52.431117 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:52.490463 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:52.490440 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:52.523989 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:52.523963 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:52.524291 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:52.524060 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:52.524291 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:52.524110 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:52.524291 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:52.524201 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:52.824191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:52.824165 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:53.012931 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:53.012900 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:53.065173 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:53.065149 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:53.216304 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:53.216280 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:53.523486 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:53.523422 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:53.523616 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:53.523568 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:53.811830 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:53.811768 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:53.939298 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:53.939272 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:54.039830 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:54.039804 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:54.094988 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:54.094931 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:54.523219 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:54.523190 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:54.523361 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:54.523286 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:54.523361 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:54.523339 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:54.523444 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:54.523427 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:55.525460 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:55.525424 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:55.525844 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:55.525547 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:55.726394 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:55.726363 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:55.810308 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:55.810248 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:55.907462 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:55.907440 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:56.006164 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.006145 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:56.106849 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.106802 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:56.461636 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.461363 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:56.523206 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.523181 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:56.523206 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.523192 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:56.523372 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:56.523275 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:56.523412 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:56.523386 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:56.542833 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.542806 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:56.700458 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.700434 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:56.804794 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.804702 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:56.896649 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:56.896620 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:57.094738 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.094714 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:57.189145 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.189112 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:57.256836 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.256799 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r99p9"] Sep 09 23:17:57.256973 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.256958 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:57.257092 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:57.257068 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:57.258867 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.258844 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4v8j"] Sep 09 23:17:57.258992 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.258959 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:57.259088 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:57.259067 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:17:57.270111 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.270084 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xhn5n"] Sep 09 23:17:57.270195 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.270177 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:57.270285 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:57.270266 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:57.292715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.292691 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:57.890067 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:57.890036 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:58.283194 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:58.283170 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:58.339301 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:58.339279 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:17:58.523584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:58.523532 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:17:58.523663 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:58.523535 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:17:58.523663 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:58.523632 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:17:58.523734 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:58.523697 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:17:59.523401 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:17:59.523369 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:17:59.523808 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:17:59.523485 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:18:00.523231 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:00.523152 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:18:00.523391 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:00.523248 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-xhn5n" podUID="f2fcef21-91e1-4349-bba6-6388e3afdf03" Sep 09 23:18:00.523391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:00.523273 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:18:00.523391 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:00.523319 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-r99p9" podUID="cffe2394-c868-446f-8ccc-f77072fd73bc" Sep 09 23:18:00.583357 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:00.583330 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:00.635063 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:00.635038 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:01.526506 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:01.526474 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:18:01.526889 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:01.526595 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-w4v8j" podUID="ecde3b41-da5a-42e3-a3b2-bf422e8e3ace" Sep 09 23:18:01.879200 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:01.879156 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:01.954469 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:01.954439 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:02.034756 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.034735 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:02.292307 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.292288 2583 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-161.ec2.internal" event="NodeReady" Sep 09 23:18:02.292396 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.292387 2583 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Sep 09 23:18:02.336844 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.336822 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7s27k"] Sep 09 23:18:02.354427 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.354407 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dwmrc"] Sep 09 23:18:02.354552 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.354535 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.356995 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.356968 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7vc5\"" Sep 09 23:18:02.357078 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.357033 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Sep 09 23:18:02.357150 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.357082 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Sep 09 23:18:02.368383 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.368364 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7s27k"] Sep 09 23:18:02.368487 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.368403 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dwmrc"] Sep 09 23:18:02.368487 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.368431 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-fg6v7"] Sep 09 23:18:02.368620 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.368494 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.371629 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.371432 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Sep 09 23:18:02.371629 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.371555 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Sep 09 23:18:02.371832 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.371810 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Sep 09 23:18:02.371937 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.371838 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wxhvm\"" Sep 09 23:18:02.384455 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.384436 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fg6v7"] Sep 09 23:18:02.384554 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.384540 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.386914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.386893 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Sep 09 23:18:02.387008 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.386972 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Sep 09 23:18:02.387108 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.387091 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Sep 09 23:18:02.387261 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.387232 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-lnpcr\"" Sep 09 23:18:02.387381 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.387233 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Sep 09 23:18:02.459929 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.459903 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:02.472882 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.472859 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6225d32-9afa-481d-833a-546c7e8048b2-cert\") pod \"ingress-canary-dwmrc\" (UID: \"b6225d32-9afa-481d-833a-546c7e8048b2\") " pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.472947 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.472909 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e139a1-a104-4c18-810e-5247b3ba69b1-config-volume\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.472947 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.472939 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5xhv\" (UniqueName: \"kubernetes.io/projected/b6225d32-9afa-481d-833a-546c7e8048b2-kube-api-access-b5xhv\") pod \"ingress-canary-dwmrc\" (UID: \"b6225d32-9afa-481d-833a-546c7e8048b2\") " pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.473027 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.473012 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e139a1-a104-4c18-810e-5247b3ba69b1-metrics-tls\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.473062 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.473036 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e139a1-a104-4c18-810e-5247b3ba69b1-tmp-dir\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.473062 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.473055 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4v5j\" (UniqueName: \"kubernetes.io/projected/b5e139a1-a104-4c18-810e-5247b3ba69b1-kube-api-access-p4v5j\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.523903 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.523879 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:18:02.524083 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.524066 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:18:02.526303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.526285 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snlxf\"" Sep 09 23:18:02.526383 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.526332 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:18:02.526383 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.526350 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:18:02.526383 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.526322 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:18:02.532266 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.532246 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:02.573908 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.573867 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e139a1-a104-4c18-810e-5247b3ba69b1-config-volume\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.573908 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.573891 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5xhv\" (UniqueName: \"kubernetes.io/projected/b6225d32-9afa-481d-833a-546c7e8048b2-kube-api-access-b5xhv\") pod \"ingress-canary-dwmrc\" (UID: \"b6225d32-9afa-481d-833a-546c7e8048b2\") " pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.574020 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.573909 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t49gz\" (UniqueName: \"kubernetes.io/projected/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-kube-api-access-t49gz\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.574020 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.573944 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.574081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574051 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e139a1-a104-4c18-810e-5247b3ba69b1-metrics-tls\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.574081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574072 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e139a1-a104-4c18-810e-5247b3ba69b1-tmp-dir\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.574141 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574089 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4v5j\" (UniqueName: \"kubernetes.io/projected/b5e139a1-a104-4c18-810e-5247b3ba69b1-kube-api-access-p4v5j\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.574141 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574111 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.574141 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574137 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-crio-socket\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.574289 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574269 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6225d32-9afa-481d-833a-546c7e8048b2-cert\") pod \"ingress-canary-dwmrc\" (UID: \"b6225d32-9afa-481d-833a-546c7e8048b2\") " pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.574347 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574310 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-data-volume\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.574493 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574478 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e139a1-a104-4c18-810e-5247b3ba69b1-tmp-dir\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.574611 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.574597 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e139a1-a104-4c18-810e-5247b3ba69b1-config-volume\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.577879 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.577788 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e139a1-a104-4c18-810e-5247b3ba69b1-metrics-tls\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.577962 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.577820 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b6225d32-9afa-481d-833a-546c7e8048b2-cert\") pod \"ingress-canary-dwmrc\" (UID: \"b6225d32-9afa-481d-833a-546c7e8048b2\") " pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.584024 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.584003 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4v5j\" (UniqueName: \"kubernetes.io/projected/b5e139a1-a104-4c18-810e-5247b3ba69b1-kube-api-access-p4v5j\") pod \"dns-default-7s27k\" (UID: \"b5e139a1-a104-4c18-810e-5247b3ba69b1\") " pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.584116 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.584043 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5xhv\" (UniqueName: \"kubernetes.io/projected/b6225d32-9afa-481d-833a-546c7e8048b2-kube-api-access-b5xhv\") pod \"ingress-canary-dwmrc\" (UID: \"b6225d32-9afa-481d-833a-546c7e8048b2\") " pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.665081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.665065 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:02.675296 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675272 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-data-volume\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.675397 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675320 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t49gz\" (UniqueName: \"kubernetes.io/projected/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-kube-api-access-t49gz\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.675397 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675366 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.675397 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675385 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.675587 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675405 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-crio-socket\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.675587 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675578 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-crio-socket\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.675687 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675647 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-data-volume\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.675875 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.675856 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.677142 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.677120 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dwmrc" Sep 09 23:18:02.677307 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.677292 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.686615 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.686596 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t49gz\" (UniqueName: \"kubernetes.io/projected/fc3c03a8-0af9-46b5-b922-f93d46f1adaf-kube-api-access-t49gz\") pod \"insights-runtime-extractor-fg6v7\" (UID: \"fc3c03a8-0af9-46b5-b922-f93d46f1adaf\") " pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.693534 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.693508 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-fg6v7" Sep 09 23:18:02.983811 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:02.983777 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7s27k"] Sep 09 23:18:02.987415 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:02.987388 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e139a1_a104_4c18_810e_5247b3ba69b1.slice/crio-bf9d5cf291d3f82d080e620811baa3db9b85bde6250477ac984c82b6c466c606 WatchSource:0}: Error finding container bf9d5cf291d3f82d080e620811baa3db9b85bde6250477ac984c82b6c466c606: Status 404 returned error can't find the container with id bf9d5cf291d3f82d080e620811baa3db9b85bde6250477ac984c82b6c466c606 Sep 09 23:18:03.001211 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.001190 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dwmrc"] Sep 09 23:18:03.003719 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:03.003696 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6225d32_9afa_481d_833a_546c7e8048b2.slice/crio-7653adbd8222d4e5674ba24dfadfcf044499ce6ee844c2210066ce472697fed1 WatchSource:0}: Error finding container 7653adbd8222d4e5674ba24dfadfcf044499ce6ee844c2210066ce472697fed1: Status 404 returned error can't find the container with id 7653adbd8222d4e5674ba24dfadfcf044499ce6ee844c2210066ce472697fed1 Sep 09 23:18:03.034122 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.034072 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-fg6v7"] Sep 09 23:18:03.036291 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:03.036263 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc3c03a8_0af9_46b5_b922_f93d46f1adaf.slice/crio-d60a368fa03ac871b13a3ccd412eeaa1361a45d7b932e81f5f2796c968ebba6d WatchSource:0}: Error finding container d60a368fa03ac871b13a3ccd412eeaa1361a45d7b932e81f5f2796c968ebba6d: Status 404 returned error can't find the container with id d60a368fa03ac871b13a3ccd412eeaa1361a45d7b932e81f5f2796c968ebba6d Sep 09 23:18:03.528190 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.528160 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:18:03.532320 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.532086 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n28fd\"" Sep 09 23:18:03.532320 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.532104 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:18:03.769637 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.769507 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fg6v7" event={"ID":"fc3c03a8-0af9-46b5-b922-f93d46f1adaf","Type":"ContainerStarted","Data":"27a403d420189c48738bd7f57eb30789d2c8d184eb4c3815fc02cb067f823327"} Sep 09 23:18:03.769637 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.769593 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fg6v7" event={"ID":"fc3c03a8-0af9-46b5-b922-f93d46f1adaf","Type":"ContainerStarted","Data":"d60a368fa03ac871b13a3ccd412eeaa1361a45d7b932e81f5f2796c968ebba6d"} Sep 09 23:18:03.771108 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.771075 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dwmrc" event={"ID":"b6225d32-9afa-481d-833a-546c7e8048b2","Type":"ContainerStarted","Data":"7653adbd8222d4e5674ba24dfadfcf044499ce6ee844c2210066ce472697fed1"} Sep 09 23:18:03.772633 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:03.772565 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7s27k" event={"ID":"b5e139a1-a104-4c18-810e-5247b3ba69b1","Type":"ContainerStarted","Data":"bf9d5cf291d3f82d080e620811baa3db9b85bde6250477ac984c82b6c466c606"} Sep 09 23:18:04.239015 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:04.238967 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:04.288569 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:04.288509 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:05.779473 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:05.779227 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7s27k" event={"ID":"b5e139a1-a104-4c18-810e-5247b3ba69b1","Type":"ContainerStarted","Data":"3606a6822b6038e61601ea5fcd7ad0cc63ff8fffff9eaa796d2a5d595f8a13cf"} Sep 09 23:18:05.779473 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:05.779463 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:05.779907 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:05.779494 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7s27k" event={"ID":"b5e139a1-a104-4c18-810e-5247b3ba69b1","Type":"ContainerStarted","Data":"02f8e5dc7d19853722fac30462d7393108eedb564e72296f069138bbf82604ad"} Sep 09 23:18:05.781133 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:05.781094 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fg6v7" event={"ID":"fc3c03a8-0af9-46b5-b922-f93d46f1adaf","Type":"ContainerStarted","Data":"510df3643feb32878377b752eb35f70aa4af63e6394d00754a5451bc04ff0871"} Sep 09 23:18:05.782473 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:05.782452 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dwmrc" event={"ID":"b6225d32-9afa-481d-833a-546c7e8048b2","Type":"ContainerStarted","Data":"5f7d93dc8f6077c34e7ab37009298913d3dfef9cdf15a73732be1641b9c2ae34"} Sep 09 23:18:05.795124 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:05.795086 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7s27k" podStartSLOduration=1.258708264 podStartE2EDuration="3.79507326s" totalImagesPullingTime="2.536364996s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:05.793872743 +0000 UTC m=+50.821883113" watchObservedRunningTime="2026-09-09 23:18:05.79507326 +0000 UTC m=+50.823083630" Sep 09 23:18:05.807909 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:05.807869 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dwmrc" podStartSLOduration=1.284769986 podStartE2EDuration="3.807853975s" totalImagesPullingTime="2.523083989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:05.80733568 +0000 UTC m=+50.835346049" watchObservedRunningTime="2026-09-09 23:18:05.807853975 +0000 UTC m=+50.835864386" Sep 09 23:18:06.597716 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:06.597678 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:07.791327 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:07.791285 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-fg6v7" event={"ID":"fc3c03a8-0af9-46b5-b922-f93d46f1adaf","Type":"ContainerStarted","Data":"b4bfb009833c1f140a6ee9d7a9bf39327143a81613362ac620cf9d386f725369"} Sep 09 23:18:07.807270 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:07.807226 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-fg6v7" podStartSLOduration=2.295028813 podStartE2EDuration="5.807211743s" totalImagesPullingTime="3.51218293s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:18:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:07.806141044 +0000 UTC m=+52.834151414" watchObservedRunningTime="2026-09-09 23:18:07.807211743 +0000 UTC m=+52.835222112" Sep 09 23:18:07.939141 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:07.939114 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.042272 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:08.042218 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.143683 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:08.143661 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.388582 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:08.388498 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.486422 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:08.486390 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.626665 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:08.626634 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:08.679927 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:08.679901 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.068497 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.068425 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.254012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.253982 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.269116 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.269077 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx"] Sep 09 23:18:09.271192 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.271173 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.273610 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.273585 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Sep 09 23:18:09.273610 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.273608 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:18:09.273769 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.273664 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Sep 09 23:18:09.274698 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.274678 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Sep 09 23:18:09.274780 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.274681 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Sep 09 23:18:09.274780 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.274681 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-hzxm5\"" Sep 09 23:18:09.282307 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.282282 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx"] Sep 09 23:18:09.300268 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.300244 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk"] Sep 09 23:18:09.302128 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.302111 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.303884 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.303863 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-nr2wm"] Sep 09 23:18:09.304584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.304560 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Sep 09 23:18:09.304691 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.304563 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Sep 09 23:18:09.304761 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.304692 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-hx7tw\"" Sep 09 23:18:09.304839 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.304818 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Sep 09 23:18:09.305942 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.305926 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.307881 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.307863 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Sep 09 23:18:09.308105 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.308007 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Sep 09 23:18:09.308228 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.308211 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Sep 09 23:18:09.308447 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.308427 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-bt9rk\"" Sep 09 23:18:09.312632 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.312612 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk"] Sep 09 23:18:09.318809 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.318757 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c8b9e6b-5b44-40f5-868e-532e59e1240b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.318809 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.318800 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-textfile\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.318952 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.318863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.318952 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.318897 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-accelerators-collector-config\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.318952 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.318916 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjwgd\" (UniqueName: \"kubernetes.io/projected/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-api-access-cjwgd\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.318952 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.318938 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76jtx\" (UniqueName: \"kubernetes.io/projected/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-kube-api-access-76jtx\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.319100 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.318954 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06c5e-8bf7-498a-b783-c236723f7ea9-metrics-client-ca\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.319100 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319049 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9wrs\" (UniqueName: \"kubernetes.io/projected/b6c06c5e-8bf7-498a-b783-c236723f7ea9-kube-api-access-c9wrs\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.319100 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319074 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.319191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319113 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.319191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319131 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c8b9e6b-5b44-40f5-868e-532e59e1240b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.319191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319147 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.319191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319164 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.319191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319183 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-sys\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.319332 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319200 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.319332 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319218 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-wtmp\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.319332 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319232 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-root\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.319332 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319278 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.319332 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.319303 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.338230 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.338208 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.420262 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420241 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76jtx\" (UniqueName: \"kubernetes.io/projected/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-kube-api-access-76jtx\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.420364 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420268 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06c5e-8bf7-498a-b783-c236723f7ea9-metrics-client-ca\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420364 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420304 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9wrs\" (UniqueName: \"kubernetes.io/projected/b6c06c5e-8bf7-498a-b783-c236723f7ea9-kube-api-access-c9wrs\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420364 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420321 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.420364 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420345 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420372 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c8b9e6b-5b44-40f5-868e-532e59e1240b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420444 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.420466 2583 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420473 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420501 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-sys\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.420558 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-tls podName:0c8b9e6b-5b44-40f5-868e-532e59e1240b nodeName:}" failed. No retries permitted until 2026-09-09 23:18:09.920518417 +0000 UTC m=+54.948528767 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-tls") pod "kube-state-metrics-74cb57df7-vtxkk" (UID: "0c8b9e6b-5b44-40f5-868e-532e59e1240b") : secret "kube-state-metrics-tls" not found Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420580 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-sys\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420580 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420627 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-wtmp\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420651 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-root\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.420665 2583 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420683 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420705 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.420728 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-tls podName:e442bba4-d5d7-49e1-a5ce-cf51f6666fa3 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:09.920710033 +0000 UTC m=+54.948720413 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-tls") pod "openshift-state-metrics-657fd6c54-vnvwx" (UID: "e442bba4-d5d7-49e1-a5ce-cf51f6666fa3") : secret "openshift-state-metrics-tls" not found Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.420781 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420795 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c8b9e6b-5b44-40f5-868e-532e59e1240b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.420834 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls podName:b6c06c5e-8bf7-498a-b783-c236723f7ea9 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:09.920820166 +0000 UTC m=+54.948830529 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls") pod "node-exporter-nr2wm" (UID: "b6c06c5e-8bf7-498a-b783-c236723f7ea9") : secret "node-exporter-tls" not found Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420861 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-textfile\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420889 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420916 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-accelerators-collector-config\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420939 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjwgd\" (UniqueName: \"kubernetes.io/projected/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-api-access-cjwgd\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.420981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420859 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-root\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.421688 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.421027 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6c06c5e-8bf7-498a-b783-c236723f7ea9-metrics-client-ca\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.421688 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.421062 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0c8b9e6b-5b44-40f5-868e-532e59e1240b-volume-directive-shadow\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.421688 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.421206 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0c8b9e6b-5b44-40f5-868e-532e59e1240b-metrics-client-ca\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.421688 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.421236 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-textfile\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.421688 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.420940 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-wtmp\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.421688 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.421673 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-accelerators-collector-config\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.421924 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.421731 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-metrics-client-ca\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.421924 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.421750 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.424256 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.424228 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.424354 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.424333 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.424458 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.424443 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.431176 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.431157 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76jtx\" (UniqueName: \"kubernetes.io/projected/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-kube-api-access-76jtx\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.431617 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.431598 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjwgd\" (UniqueName: \"kubernetes.io/projected/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-api-access-cjwgd\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.431770 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.431750 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9wrs\" (UniqueName: \"kubernetes.io/projected/b6c06c5e-8bf7-498a-b783-c236723f7ea9-kube-api-access-c9wrs\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.444250 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.444232 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.545291 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.545263 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.646174 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.646115 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.746039 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.746015 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.909660 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.909636 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:09.925116 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.925090 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.925174 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.925125 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:09.925174 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.925150 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:09.925280 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.925264 2583 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Sep 09 23:18:09.925339 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:18:09.925328 2583 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls podName:b6c06c5e-8bf7-498a-b783-c236723f7ea9 nodeName:}" failed. No retries permitted until 2026-09-09 23:18:10.925311544 +0000 UTC m=+55.953321892 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls") pod "node-exporter-nr2wm" (UID: "b6c06c5e-8bf7-498a-b783-c236723f7ea9") : secret "node-exporter-tls" not found Sep 09 23:18:09.927487 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.927457 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0c8b9e6b-5b44-40f5-868e-532e59e1240b-kube-state-metrics-tls\") pod \"kube-state-metrics-74cb57df7-vtxkk\" (UID: \"0c8b9e6b-5b44-40f5-868e-532e59e1240b\") " pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:09.927673 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:09.927650 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e442bba4-d5d7-49e1-a5ce-cf51f6666fa3-openshift-state-metrics-tls\") pod \"openshift-state-metrics-657fd6c54-vnvwx\" (UID: \"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3\") " pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:10.133624 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.133597 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:10.180747 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.180702 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" Sep 09 23:18:10.212505 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.212484 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" Sep 09 23:18:10.270831 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.270764 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:10.337237 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.337196 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:10.425876 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.425855 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:10.448963 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.448838 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx"] Sep 09 23:18:10.451230 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:10.451207 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode442bba4_d5d7_49e1_a5ce_cf51f6666fa3.slice/crio-03fd14f6a07f2f92382045210fd2e43eff9451545411a66b96789cfab695751e WatchSource:0}: Error finding container 03fd14f6a07f2f92382045210fd2e43eff9451545411a66b96789cfab695751e: Status 404 returned error can't find the container with id 03fd14f6a07f2f92382045210fd2e43eff9451545411a66b96789cfab695751e Sep 09 23:18:10.487330 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.487310 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk"] Sep 09 23:18:10.489968 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:10.489946 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c8b9e6b_5b44_40f5_868e_532e59e1240b.slice/crio-17d58a26d600d549854c70e1907f8c4b98f35036622bedf0bdd9837f409015da WatchSource:0}: Error finding container 17d58a26d600d549854c70e1907f8c4b98f35036622bedf0bdd9837f409015da: Status 404 returned error can't find the container with id 17d58a26d600d549854c70e1907f8c4b98f35036622bedf0bdd9837f409015da Sep 09 23:18:10.803768 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.803699 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" event={"ID":"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3","Type":"ContainerStarted","Data":"a95566b9da9692cc27d1fb6e21cbe799cb34ef0d730e6abfaeac7c046093ac60"} Sep 09 23:18:10.803768 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.803761 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" event={"ID":"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3","Type":"ContainerStarted","Data":"3d5a05f25e35671578e4e6186475b701a445a41dc623e31dd90d2bfc615740a0"} Sep 09 23:18:10.803946 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.803785 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" event={"ID":"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3","Type":"ContainerStarted","Data":"03fd14f6a07f2f92382045210fd2e43eff9451545411a66b96789cfab695751e"} Sep 09 23:18:10.804865 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.804842 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" event={"ID":"0c8b9e6b-5b44-40f5-868e-532e59e1240b","Type":"ContainerStarted","Data":"17d58a26d600d549854c70e1907f8c4b98f35036622bedf0bdd9837f409015da"} Sep 09 23:18:10.932739 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.932715 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:10.934837 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:10.934819 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/b6c06c5e-8bf7-498a-b783-c236723f7ea9-node-exporter-tls\") pod \"node-exporter-nr2wm\" (UID: \"b6c06c5e-8bf7-498a-b783-c236723f7ea9\") " pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:11.117352 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.117299 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-nr2wm" Sep 09 23:18:11.164862 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:11.164840 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c06c5e_8bf7_498a_b783_c236723f7ea9.slice/crio-cb6a849d36bcca2418873c8122914f716e883064d2fc17b760144fe3b9583a08 WatchSource:0}: Error finding container cb6a849d36bcca2418873c8122914f716e883064d2fc17b760144fe3b9583a08: Status 404 returned error can't find the container with id cb6a849d36bcca2418873c8122914f716e883064d2fc17b760144fe3b9583a08 Sep 09 23:18:11.264388 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.264360 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-856999bfd7-cjfst"] Sep 09 23:18:11.280308 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.280241 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856999bfd7-cjfst"] Sep 09 23:18:11.280419 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.280389 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.283402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.282888 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Sep 09 23:18:11.283402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.283021 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Sep 09 23:18:11.283402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.283048 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-2aqbmhagpbna8\"" Sep 09 23:18:11.283402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.283123 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-cxdxk\"" Sep 09 23:18:11.283402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.283331 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Sep 09 23:18:11.283402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.283379 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Sep 09 23:18:11.283717 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.283604 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Sep 09 23:18:11.336659 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336630 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-metrics-client-ca\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.336760 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336671 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.336760 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336699 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.336850 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336773 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.336902 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336862 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdchk\" (UniqueName: \"kubernetes.io/projected/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-kube-api-access-fdchk\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.336964 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336918 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.337018 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336964 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-tls\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.337018 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.336979 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-grpc-tls\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.437971 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.437950 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-tls\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438101 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.437988 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-grpc-tls\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438190 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.438171 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-metrics-client-ca\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438248 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.438213 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.438244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438302 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.438274 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438417 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.438389 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdchk\" (UniqueName: \"kubernetes.io/projected/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-kube-api-access-fdchk\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438498 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.438474 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.438991 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.438951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-metrics-client-ca\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.441006 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.440973 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-tls\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.441113 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.441036 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.441176 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.441141 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-grpc-tls\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.441483 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.441443 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.441680 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.441658 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.441967 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.441945 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.447387 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.447366 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdchk\" (UniqueName: \"kubernetes.io/projected/9b264fcc-5f78-455e-9fbe-eeb09cd1eca1-kube-api-access-fdchk\") pod \"thanos-querier-856999bfd7-cjfst\" (UID: \"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1\") " pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.590941 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.590914 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:11.811049 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:11.810964 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr2wm" event={"ID":"b6c06c5e-8bf7-498a-b783-c236723f7ea9","Type":"ContainerStarted","Data":"cb6a849d36bcca2418873c8122914f716e883064d2fc17b760144fe3b9583a08"} Sep 09 23:18:12.220390 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.220359 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.307892 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.307858 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.502784 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.502711 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.604359 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.604326 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.704706 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.704679 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.721205 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.721186 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-ps2zl" Sep 09 23:18:12.815907 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.815875 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" event={"ID":"0c8b9e6b-5b44-40f5-868e-532e59e1240b","Type":"ContainerStarted","Data":"9efff2aea6aeee587ba02f8dc2391ab332954992ce7af595bc50ff50337f523f"} Sep 09 23:18:12.820049 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.820021 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" event={"ID":"e442bba4-d5d7-49e1-a5ce-cf51f6666fa3","Type":"ContainerStarted","Data":"c0d41fbbc66d07644092978d3d61f6a109bbe7f5acb75f0f34617daa181340f1"} Sep 09 23:18:12.822604 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.822183 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr2wm" event={"ID":"b6c06c5e-8bf7-498a-b783-c236723f7ea9","Type":"ContainerStarted","Data":"27eefe83b622ba88eaf960839af968813940864b7fc4c4afb77e70d0ae6008da"} Sep 09 23:18:12.838742 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.838323 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-657fd6c54-vnvwx" podStartSLOduration=1.687977213 podStartE2EDuration="3.838300642s" totalImagesPullingTime="2.150323429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:12.837645996 +0000 UTC m=+57.865656367" watchObservedRunningTime="2026-09-09 23:18:12.838300642 +0000 UTC m=+57.866311013" Sep 09 23:18:12.906468 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.906437 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.967308 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.967286 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:12.980486 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:12.980458 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-856999bfd7-cjfst"] Sep 09 23:18:12.984072 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:12.984047 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9b264fcc_5f78_455e_9fbe_eeb09cd1eca1.slice/crio-a1dd4ada3a631aaf6209985a1a2ae63f94fd13c098710edd16c03248833fe069 WatchSource:0}: Error finding container a1dd4ada3a631aaf6209985a1a2ae63f94fd13c098710edd16c03248833fe069: Status 404 returned error can't find the container with id a1dd4ada3a631aaf6209985a1a2ae63f94fd13c098710edd16c03248833fe069 Sep 09 23:18:13.827786 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:13.827752 2583 generic.go:356] "Generic (PLEG): container finished" podID="b6c06c5e-8bf7-498a-b783-c236723f7ea9" containerID="27eefe83b622ba88eaf960839af968813940864b7fc4c4afb77e70d0ae6008da" exitCode=0 Sep 09 23:18:13.828228 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:13.827842 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr2wm" event={"ID":"b6c06c5e-8bf7-498a-b783-c236723f7ea9","Type":"ContainerDied","Data":"27eefe83b622ba88eaf960839af968813940864b7fc4c4afb77e70d0ae6008da"} Sep 09 23:18:13.830748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:13.830480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" event={"ID":"0c8b9e6b-5b44-40f5-868e-532e59e1240b","Type":"ContainerStarted","Data":"55cad4f7b4cb30145fe4ab1b50930d0b04e65790ae6a1e6bc353fe28a7c3e4c3"} Sep 09 23:18:13.830748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:13.830551 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" event={"ID":"0c8b9e6b-5b44-40f5-868e-532e59e1240b","Type":"ContainerStarted","Data":"8f1c2a010d9eabcaa43de41cd93f93d3ab634035da32512071c158f01aa61c43"} Sep 09 23:18:13.832265 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:13.832239 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" event={"ID":"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1","Type":"ContainerStarted","Data":"a1dd4ada3a631aaf6209985a1a2ae63f94fd13c098710edd16c03248833fe069"} Sep 09 23:18:13.861214 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:13.861175 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-74cb57df7-vtxkk" podStartSLOduration=2.644307184 podStartE2EDuration="4.861157478s" totalImagesPullingTime="2.216850294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:13.860410975 +0000 UTC m=+58.888421345" watchObservedRunningTime="2026-09-09 23:18:13.861157478 +0000 UTC m=+58.889167851" Sep 09 23:18:14.052427 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.052396 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf"] Sep 09 23:18:14.054341 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.054319 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.056116 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.056057 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:14.056844 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.056824 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Sep 09 23:18:14.056951 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.056882 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mqtkm\"" Sep 09 23:18:14.062752 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.062731 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf"] Sep 09 23:18:14.154942 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.154914 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:14.158088 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.158064 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs4bp\" (UniqueName: \"kubernetes.io/projected/a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f-kube-api-access-fs4bp\") pod \"monitoring-plugin-85bbbbbf4-zpzgf\" (UID: \"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.158202 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.158170 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-zpzgf\" (UID: \"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.256259 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.256227 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:14.259348 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.259327 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs4bp\" (UniqueName: \"kubernetes.io/projected/a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f-kube-api-access-fs4bp\") pod \"monitoring-plugin-85bbbbbf4-zpzgf\" (UID: \"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.259418 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.259406 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-zpzgf\" (UID: \"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.261828 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.261810 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f-monitoring-plugin-cert\") pod \"monitoring-plugin-85bbbbbf4-zpzgf\" (UID: \"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.267855 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.267832 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs4bp\" (UniqueName: \"kubernetes.io/projected/a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f-kube-api-access-fs4bp\") pod \"monitoring-plugin-85bbbbbf4-zpzgf\" (UID: \"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f\") " pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.356298 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.356254 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:14.365082 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.365047 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:14.838996 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.838958 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr2wm" event={"ID":"b6c06c5e-8bf7-498a-b783-c236723f7ea9","Type":"ContainerStarted","Data":"e6e12c240801aa4bcc3ca0d986a4e52013c59aa144ce42bac02cd2a413dd7c54"} Sep 09 23:18:14.839310 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.839069 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-nr2wm" event={"ID":"b6c06c5e-8bf7-498a-b783-c236723f7ea9","Type":"ContainerStarted","Data":"314b1ff601dd91caabda4e4e173a6c1f881e148996d8a54e3622481423551269"} Sep 09 23:18:14.859428 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:14.858869 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-nr2wm" podStartSLOduration=4.232585908 podStartE2EDuration="5.85884647s" totalImagesPullingTime="1.544811018s" totalInitContainerRuntime="81.449544ms" isStatefulPod=true podCreationTimestamp="2026-09-09 23:18:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:14.857266905 +0000 UTC m=+59.885277274" watchObservedRunningTime="2026-09-09 23:18:14.85884647 +0000 UTC m=+59.886856841" Sep 09 23:18:15.079995 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.079932 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf"] Sep 09 23:18:15.082301 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:15.082277 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6dfc81b_2cd1_4c8b_9f3f_177f7677b77f.slice/crio-b64e19a58ed3f85b8001e94e00f26aa0da3e14ebf90718265febbb4d54b36a9f WatchSource:0}: Error finding container b64e19a58ed3f85b8001e94e00f26aa0da3e14ebf90718265febbb4d54b36a9f: Status 404 returned error can't find the container with id b64e19a58ed3f85b8001e94e00f26aa0da3e14ebf90718265febbb4d54b36a9f Sep 09 23:18:15.481369 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.481340 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:18:15.481767 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.481744 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:15.486192 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.486173 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.488683 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.488665 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-35pef8du6khqn\"" Sep 09 23:18:15.488915 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.488898 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 23:18:15.488985 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.488898 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 23:18:15.489097 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.489080 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 23:18:15.489097 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.489089 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 23:18:15.489215 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.489100 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 23:18:15.489215 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.489120 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fpp54\"" Sep 09 23:18:15.489663 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.489648 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 23:18:15.489736 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.489651 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 23:18:15.490455 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.490416 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 23:18:15.490455 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.490415 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 23:18:15.490606 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.490501 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 23:18:15.490792 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.490773 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:18:15.490792 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.490784 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 23:18:15.490909 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.490773 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 23:18:15.491140 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.491125 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 23:18:15.493646 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.493625 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 23:18:15.495610 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.495592 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:18:15.571049 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571023 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571053 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571070 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571103 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6nv4\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-kube-api-access-p6nv4\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571125 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571282 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571160 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571282 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571188 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571282 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571222 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571282 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571243 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571399 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571294 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571399 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571319 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571399 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571345 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571399 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571363 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571399 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571386 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571567 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571404 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571567 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571435 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571567 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571450 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571567 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571469 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571567 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.571743 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.571574 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.642413 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.642380 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:15.672709 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672678 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.672833 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672716 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.672833 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672746 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.672833 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672775 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.672833 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672818 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672851 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672883 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672946 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.672977 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673005 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673046 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673078 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673101 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673168 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6nv4\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-kube-api-access-p6nv4\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673200 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673226 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673244 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673290 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.673333 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.673323 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.674404 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.674372 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.674871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.674848 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.675861 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.675836 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.676118 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.676089 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config-out\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.676673 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.676493 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.676673 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.676646 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.677672 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.677059 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.677672 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.677413 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.677878 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.677854 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.678025 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.678000 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.678316 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.678291 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.678486 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.678463 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-web-config\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.679044 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.679003 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.680123 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.680082 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.680813 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.680499 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.680813 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.680773 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.681257 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.681211 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.681348 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.681281 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.682761 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.682730 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.684969 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.684949 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6nv4\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-kube-api-access-p6nv4\") pod \"prometheus-k8s-0\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.766664 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.766608 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:15.787580 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.787530 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7s27k" Sep 09 23:18:15.796768 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.796748 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:15.848367 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.848305 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" event={"ID":"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f","Type":"ContainerStarted","Data":"b64e19a58ed3f85b8001e94e00f26aa0da3e14ebf90718265febbb4d54b36a9f"} Sep 09 23:18:15.852694 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.852458 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" event={"ID":"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1","Type":"ContainerStarted","Data":"db3dfe8c7ce5cff455dd19984197c3f625cb715df13f4442d166a4bfef28e7c0"} Sep 09 23:18:15.852694 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.852586 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" event={"ID":"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1","Type":"ContainerStarted","Data":"7cafe9ab9a5494cf58596026c15259ab5c162b90dcaa731eb38e1be3f2979e48"} Sep 09 23:18:15.852694 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:15.852637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" event={"ID":"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1","Type":"ContainerStarted","Data":"5c580dee8bd09ec170bfc3071c034b4b8ca4e82d0afa20be92bdd01bf7b730ec"} Sep 09 23:18:16.195091 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.195058 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:16.233482 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.233400 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:18:16.297313 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.297245 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:16.486269 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:16.486239 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60bd6a5e_7516_41b5_ad0d_120008a11c3d.slice/crio-9af9123d8724b2f4a15a7feb686a10ad4b841ab1e6fcbb3ec8109a4101446ace WatchSource:0}: Error finding container 9af9123d8724b2f4a15a7feb686a10ad4b841ab1e6fcbb3ec8109a4101446ace: Status 404 returned error can't find the container with id 9af9123d8724b2f4a15a7feb686a10ad4b841ab1e6fcbb3ec8109a4101446ace Sep 09 23:18:16.859212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.859124 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" event={"ID":"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1","Type":"ContainerStarted","Data":"c9d2a93edfb7569b5e1bf1eeb3698459bf1e237f6c9a496a30762dabdf838757"} Sep 09 23:18:16.859608 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.859220 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" event={"ID":"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1","Type":"ContainerStarted","Data":"02ccd4e2007a1c5591d4c085b2b765dabcbf84e51841ba43545f112338e3c93b"} Sep 09 23:18:16.859608 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.859270 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:16.859608 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.859311 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" event={"ID":"9b264fcc-5f78-455e-9fbe-eeb09cd1eca1","Type":"ContainerStarted","Data":"ca4603f7f9f67f2aba051f7904d8e0a5ed92be3f84ba1f533d0366e6bcc18d84"} Sep 09 23:18:16.860679 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.860651 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerStarted","Data":"9af9123d8724b2f4a15a7feb686a10ad4b841ab1e6fcbb3ec8109a4101446ace"} Sep 09 23:18:16.862287 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.862257 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" event={"ID":"a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f","Type":"ContainerStarted","Data":"992b609dd958b4d0e424e02f118f6947e618dbbc0eaba61470c25661f34f5dba"} Sep 09 23:18:16.862492 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.862471 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:16.867651 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.867628 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" Sep 09 23:18:16.878840 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.878792 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" podStartSLOduration=3.023930991 podStartE2EDuration="5.878774748s" totalImagesPullingTime="2.854843757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:16.877784617 +0000 UTC m=+61.905794988" watchObservedRunningTime="2026-09-09 23:18:16.878774748 +0000 UTC m=+61.906785118" Sep 09 23:18:16.893214 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:16.893170 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-85bbbbbf4-zpzgf" podStartSLOduration=1.447013006 podStartE2EDuration="2.89315274s" totalImagesPullingTime="1.446139734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:16.892229308 +0000 UTC m=+61.920239681" watchObservedRunningTime="2026-09-09 23:18:16.89315274 +0000 UTC m=+61.921163111" Sep 09 23:18:17.242597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:17.242561 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:17.296964 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:17.296931 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:17.419463 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:17.419440 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:17.520285 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:17.520229 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:17.867330 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:17.867273 2583 generic.go:356] "Generic (PLEG): container finished" podID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" exitCode=0 Sep 09 23:18:17.867699 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:17.867357 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251"} Sep 09 23:18:19.764204 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:19.764165 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:19.815655 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:19.815627 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:21.221392 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.221363 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:18:21.221793 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.221438 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:18:21.223985 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.223964 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Sep 09 23:18:21.224093 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.224063 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Sep 09 23:18:21.234123 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.234076 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ecde3b41-da5a-42e3-a3b2-bf422e8e3ace-metrics-certs\") pod \"network-metrics-daemon-w4v8j\" (UID: \"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace\") " pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:18:21.234190 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.234171 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/f2fcef21-91e1-4349-bba6-6388e3afdf03-original-pull-secret\") pod \"global-pull-secret-syncer-xhn5n\" (UID: \"f2fcef21-91e1-4349-bba6-6388e3afdf03\") " pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:18:21.242043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.242023 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-n28fd\"" Sep 09 23:18:21.250085 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.250060 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-w4v8j" Sep 09 23:18:21.322111 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.322081 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:18:21.324827 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.324808 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Sep 09 23:18:21.334511 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.334468 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Sep 09 23:18:21.345509 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.345478 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lpr6\" (UniqueName: \"kubernetes.io/projected/cffe2394-c868-446f-8ccc-f77072fd73bc-kube-api-access-8lpr6\") pod \"network-check-target-r99p9\" (UID: \"cffe2394-c868-446f-8ccc-f77072fd73bc\") " pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:18:21.434957 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.434936 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-snlxf\"" Sep 09 23:18:21.437826 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.437811 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-xhn5n" Sep 09 23:18:21.443402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.443388 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:18:21.528908 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:21.528880 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecde3b41_da5a_42e3_a3b2_bf422e8e3ace.slice/crio-762be06841775c83f5509e720fca308abe5a822d5bea46f889203b843f8bbb70 WatchSource:0}: Error finding container 762be06841775c83f5509e720fca308abe5a822d5bea46f889203b843f8bbb70: Status 404 returned error can't find the container with id 762be06841775c83f5509e720fca308abe5a822d5bea46f889203b843f8bbb70 Sep 09 23:18:21.529074 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.529055 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-w4v8j"] Sep 09 23:18:21.702919 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.702889 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-xhn5n"] Sep 09 23:18:21.706037 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:21.706005 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2fcef21_91e1_4349_bba6_6388e3afdf03.slice/crio-a803a62829b97143fc9023f0250e8af13b91ed841e9291bc43c47360e706b42a WatchSource:0}: Error finding container a803a62829b97143fc9023f0250e8af13b91ed841e9291bc43c47360e706b42a: Status 404 returned error can't find the container with id a803a62829b97143fc9023f0250e8af13b91ed841e9291bc43c47360e706b42a Sep 09 23:18:21.707426 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.707405 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-r99p9"] Sep 09 23:18:21.710381 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:18:21.710360 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcffe2394_c868_446f_8ccc_f77072fd73bc.slice/crio-c051b5602387dcb47495cab3012a9672532a6ab31fe8619c2e4ff0f57743ef65 WatchSource:0}: Error finding container c051b5602387dcb47495cab3012a9672532a6ab31fe8619c2e4ff0f57743ef65: Status 404 returned error can't find the container with id c051b5602387dcb47495cab3012a9672532a6ab31fe8619c2e4ff0f57743ef65 Sep 09 23:18:21.882843 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.882789 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4v8j" event={"ID":"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace","Type":"ContainerStarted","Data":"762be06841775c83f5509e720fca308abe5a822d5bea46f889203b843f8bbb70"} Sep 09 23:18:21.886270 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.886248 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerStarted","Data":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} Sep 09 23:18:21.886362 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.886300 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerStarted","Data":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} Sep 09 23:18:21.886362 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.886326 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerStarted","Data":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} Sep 09 23:18:21.886456 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.886362 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerStarted","Data":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} Sep 09 23:18:21.886456 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.886394 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerStarted","Data":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} Sep 09 23:18:21.886456 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.886417 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerStarted","Data":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} Sep 09 23:18:21.887489 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.887470 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xhn5n" event={"ID":"f2fcef21-91e1-4349-bba6-6388e3afdf03","Type":"ContainerStarted","Data":"a803a62829b97143fc9023f0250e8af13b91ed841e9291bc43c47360e706b42a"} Sep 09 23:18:21.888620 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.888595 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r99p9" event={"ID":"cffe2394-c868-446f-8ccc-f77072fd73bc","Type":"ContainerStarted","Data":"c051b5602387dcb47495cab3012a9672532a6ab31fe8619c2e4ff0f57743ef65"} Sep 09 23:18:21.912798 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:21.912759 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.908474271 podStartE2EDuration="6.912730672s" totalImagesPullingTime="3.985586356s" totalInitContainerRuntime="18.670045ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:18:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:21.91082744 +0000 UTC m=+66.938837837" watchObservedRunningTime="2026-09-09 23:18:21.912730672 +0000 UTC m=+66.940741041" Sep 09 23:18:22.876674 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:22.876588 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-856999bfd7-cjfst" Sep 09 23:18:22.895221 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:22.895187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4v8j" event={"ID":"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace","Type":"ContainerStarted","Data":"61f609435adbc9db7d2c4fc3ba8b3212acbbfe7bb6dc7cb76332385f2c815ca2"} Sep 09 23:18:22.895366 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:22.895248 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-w4v8j" event={"ID":"ecde3b41-da5a-42e3-a3b2-bf422e8e3ace","Type":"ContainerStarted","Data":"179d1dac249f37615a918630cde08d8a94a8a5141586a95a0ee5b54b2e42fa8f"} Sep 09 23:18:22.953037 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:22.952979 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-w4v8j" podStartSLOduration=66.942669322 podStartE2EDuration="1m7.952954035s" totalImagesPullingTime="1.010284713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:22.9527867 +0000 UTC m=+67.980797072" watchObservedRunningTime="2026-09-09 23:18:22.952954035 +0000 UTC m=+67.980964406" Sep 09 23:18:23.042584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:23.042482 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:23.144440 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:23.144365 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:24.120202 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:24.120112 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:24.225045 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:24.225005 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:24.322069 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:24.322039 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:24.476862 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:24.476823 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:24.577801 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:24.577763 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:24.678451 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:24.678420 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:25.223392 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:25.223359 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:25.328318 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:25.328289 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:25.642455 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:25.642364 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:25.743781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:25.743750 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:25.797076 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:25.797034 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:18:26.866413 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:26.866331 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:26.918910 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:26.918874 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-xhn5n" event={"ID":"f2fcef21-91e1-4349-bba6-6388e3afdf03","Type":"ContainerStarted","Data":"fa64bbb76ce3b175b5a8f1e0c16392de5c19bbabb0539aa0e3b1889ebafbafc5"} Sep 09 23:18:26.920702 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:26.920677 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-r99p9" event={"ID":"cffe2394-c868-446f-8ccc-f77072fd73bc","Type":"ContainerStarted","Data":"f5b439c3b40da51221ea4f505ce399215af3e05dce37cefd08385468c0d4c40f"} Sep 09 23:18:26.920797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:26.920734 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:18:26.934401 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:26.934362 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-xhn5n" podStartSLOduration=67.09333305 podStartE2EDuration="1m11.934347286s" totalImagesPullingTime="4.841014236s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:26.933233144 +0000 UTC m=+71.961243519" watchObservedRunningTime="2026-09-09 23:18:26.934347286 +0000 UTC m=+71.962357955" Sep 09 23:18:26.940487 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:26.940467 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:26.954459 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:26.954416 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-r99p9" podStartSLOduration=67.122638474 podStartE2EDuration="1m11.954399514s" totalImagesPullingTime="4.83176104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:17:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:18:26.954333489 +0000 UTC m=+71.982343871" watchObservedRunningTime="2026-09-09 23:18:26.954399514 +0000 UTC m=+71.982409885" Sep 09 23:18:27.580148 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:27.580114 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:27.635752 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:27.635727 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:27.688409 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:27.688380 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:28.833244 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:28.833202 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:28.933687 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:28.933655 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:30.582956 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:30.582916 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:30.682850 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:30.682823 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:34.212648 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:34.212612 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:45.582704 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:45.582581 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:45.634186 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:45.634162 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:18:57.927309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:18:57.927274 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-r99p9" Sep 09 23:19:15.797480 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:15.797446 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:15.815729 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:15.815703 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:16.133673 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:16.133598 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:28.285942 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:28.285908 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:28.449181 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:28.449141 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:28.650983 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:28.650953 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:33.813375 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:33.813342 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:19:33.813896 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:33.813632 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="prometheus" containerID="cri-o://d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" gracePeriod=600 Sep 09 23:19:33.813896 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:33.813692 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="thanos-sidecar" containerID="cri-o://9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" gracePeriod=600 Sep 09 23:19:33.813896 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:33.813709 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="config-reloader" containerID="cri-o://69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" gracePeriod=600 Sep 09 23:19:33.813896 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:33.813671 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy" containerID="cri-o://ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" gracePeriod=600 Sep 09 23:19:33.813896 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:33.813772 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-web" containerID="cri-o://fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" gracePeriod=600 Sep 09 23:19:33.813896 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:33.813746 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-thanos" containerID="cri-o://67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" gracePeriod=600 Sep 09 23:19:34.046687 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.046664 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.188119 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188083 2583 generic.go:356] "Generic (PLEG): container finished" podID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" exitCode=0 Sep 09 23:19:34.188119 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188110 2583 generic.go:356] "Generic (PLEG): container finished" podID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" exitCode=0 Sep 09 23:19:34.188119 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188119 2583 generic.go:356] "Generic (PLEG): container finished" podID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" exitCode=0 Sep 09 23:19:34.188119 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188125 2583 generic.go:356] "Generic (PLEG): container finished" podID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" exitCode=0 Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188132 2583 generic.go:356] "Generic (PLEG): container finished" podID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" exitCode=0 Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188139 2583 generic.go:356] "Generic (PLEG): container finished" podID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" exitCode=0 Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188162 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188178 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188266 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188309 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188347 2583 scope.go:117] "RemoveContainer" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.188429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188351 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} Sep 09 23:19:34.188781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188480 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} Sep 09 23:19:34.188781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188540 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} Sep 09 23:19:34.188781 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.188581 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"60bd6a5e-7516-41b5-ad0d-120008a11c3d","Type":"ContainerDied","Data":"9af9123d8724b2f4a15a7feb686a10ad4b841ab1e6fcbb3ec8109a4101446ace"} Sep 09 23:19:34.195693 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.195677 2583 scope.go:117] "RemoveContainer" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.202140 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.202125 2583 scope.go:117] "RemoveContainer" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.208915 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.208899 2583 scope.go:117] "RemoveContainer" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.214915 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.214900 2583 scope.go:117] "RemoveContainer" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.223148 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.223132 2583 scope.go:117] "RemoveContainer" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.229637 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.229624 2583 scope.go:117] "RemoveContainer" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.235566 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.235549 2583 scope.go:117] "RemoveContainer" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.235829 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:19:34.235809 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": container with ID starting with 67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492 not found: ID does not exist" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.235873 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.235837 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} err="failed to get container status \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": rpc error: code = NotFound desc = could not find container \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": container with ID starting with 67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492 not found: ID does not exist" Sep 09 23:19:34.235873 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.235867 2583 scope.go:117] "RemoveContainer" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.236105 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:19:34.236088 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": container with ID starting with ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43 not found: ID does not exist" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.236141 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236114 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} err="failed to get container status \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": rpc error: code = NotFound desc = could not find container \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": container with ID starting with ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43 not found: ID does not exist" Sep 09 23:19:34.236141 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236135 2583 scope.go:117] "RemoveContainer" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.236337 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:19:34.236321 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": container with ID starting with fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0 not found: ID does not exist" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.236390 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236343 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} err="failed to get container status \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": rpc error: code = NotFound desc = could not find container \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": container with ID starting with fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0 not found: ID does not exist" Sep 09 23:19:34.236390 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236357 2583 scope.go:117] "RemoveContainer" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.236656 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:19:34.236639 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": container with ID starting with 9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c not found: ID does not exist" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.236713 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236661 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} err="failed to get container status \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": rpc error: code = NotFound desc = could not find container \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": container with ID starting with 9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c not found: ID does not exist" Sep 09 23:19:34.236713 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236679 2583 scope.go:117] "RemoveContainer" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.236934 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:19:34.236917 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": container with ID starting with 69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147 not found: ID does not exist" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.236979 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236939 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} err="failed to get container status \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": rpc error: code = NotFound desc = could not find container \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": container with ID starting with 69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147 not found: ID does not exist" Sep 09 23:19:34.236979 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236952 2583 scope.go:117] "RemoveContainer" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.236979 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236952 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p6nv4\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-kube-api-access-p6nv4\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237094 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.236979 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237094 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237012 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-thanos-prometheus-http-client-file\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237094 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237037 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-web-config\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237094 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237060 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-serving-certs-ca-bundle\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237094 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237089 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-tls\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237111 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-1\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237136 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-2\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237162 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-metrics-client-ca\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237196 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-trusted-ca-bundle\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237226 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-metrics-client-certs\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237254 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237288 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-tls-assets\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237329 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-kube-rbac-proxy\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237368 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-grpc-tls\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237393 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config-out\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237415 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-db\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237454 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-kubelet-serving-ca-bundle\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237463 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237484 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-0\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237504 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config\") pod \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\" (UID: \"60bd6a5e-7516-41b5-ad0d-120008a11c3d\") " Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:19:34.237591 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": container with ID starting with d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e not found: ID does not exist" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237624 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} err="failed to get container status \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": rpc error: code = NotFound desc = could not find container \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": container with ID starting with d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e not found: ID does not exist" Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237645 2583 scope.go:117] "RemoveContainer" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.237748 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.237750 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.239387 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.238490 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:19:34.239387 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:19:34.238510 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": container with ID starting with c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251 not found: ID does not exist" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.239387 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.238567 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251"} err="failed to get container status \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": rpc error: code = NotFound desc = could not find container \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": container with ID starting with c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251 not found: ID does not exist" Sep 09 23:19:34.239387 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.238589 2583 scope.go:117] "RemoveContainer" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.239387 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.238923 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:19:34.239979 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.239665 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:34.239979 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.239798 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:19:34.239979 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.239813 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:19:34.240133 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240003 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} err="failed to get container status \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": rpc error: code = NotFound desc = could not find container \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": container with ID starting with 67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492 not found: ID does not exist" Sep 09 23:19:34.240133 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240031 2583 scope.go:117] "RemoveContainer" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.240346 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240316 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:19:34.240436 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240407 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} err="failed to get container status \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": rpc error: code = NotFound desc = could not find container \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": container with ID starting with ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43 not found: ID does not exist" Sep 09 23:19:34.240499 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240439 2583 scope.go:117] "RemoveContainer" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.240837 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240810 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} err="failed to get container status \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": rpc error: code = NotFound desc = could not find container \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": container with ID starting with fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0 not found: ID does not exist" Sep 09 23:19:34.240918 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240841 2583 scope.go:117] "RemoveContainer" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.240918 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240846 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.241012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240931 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.241012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.240994 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:19:34.241211 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.241189 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:34.241273 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.241195 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} err="failed to get container status \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": rpc error: code = NotFound desc = could not find container \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": container with ID starting with 9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c not found: ID does not exist" Sep 09 23:19:34.241273 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.241227 2583 scope.go:117] "RemoveContainer" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.241708 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.241660 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} err="failed to get container status \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": rpc error: code = NotFound desc = could not find container \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": container with ID starting with 69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147 not found: ID does not exist" Sep 09 23:19:34.241804 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.241711 2583 scope.go:117] "RemoveContainer" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.241804 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.241764 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.241916 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.241816 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-kube-api-access-p6nv4" (OuterVolumeSpecName: "kube-api-access-p6nv4") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "kube-api-access-p6nv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:19:34.242109 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.242081 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} err="failed to get container status \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": rpc error: code = NotFound desc = could not find container \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": container with ID starting with d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e not found: ID does not exist" Sep 09 23:19:34.242183 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.242109 2583 scope.go:117] "RemoveContainer" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.242330 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.242305 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.242424 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.242373 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251"} err="failed to get container status \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": rpc error: code = NotFound desc = could not find container \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": container with ID starting with c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251 not found: ID does not exist" Sep 09 23:19:34.242424 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.242399 2583 scope.go:117] "RemoveContainer" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.243059 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243035 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} err="failed to get container status \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": rpc error: code = NotFound desc = could not find container \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": container with ID starting with 67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492 not found: ID does not exist" Sep 09 23:19:34.243153 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243060 2583 scope.go:117] "RemoveContainer" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.243153 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243116 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config-out" (OuterVolumeSpecName: "config-out") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:19:34.243153 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243123 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.243342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243206 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.243342 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243294 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.243448 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243339 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} err="failed to get container status \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": rpc error: code = NotFound desc = could not find container \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": container with ID starting with ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43 not found: ID does not exist" Sep 09 23:19:34.243448 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243360 2583 scope.go:117] "RemoveContainer" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.243644 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243561 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config" (OuterVolumeSpecName: "config") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.243644 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243625 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} err="failed to get container status \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": rpc error: code = NotFound desc = could not find container \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": container with ID starting with fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0 not found: ID does not exist" Sep 09 23:19:34.243746 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243646 2583 scope.go:117] "RemoveContainer" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.243871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243853 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} err="failed to get container status \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": rpc error: code = NotFound desc = could not find container \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": container with ID starting with 9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c not found: ID does not exist" Sep 09 23:19:34.243871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.243870 2583 scope.go:117] "RemoveContainer" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.244110 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244092 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} err="failed to get container status \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": rpc error: code = NotFound desc = could not find container \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": container with ID starting with 69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147 not found: ID does not exist" Sep 09 23:19:34.244179 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244110 2583 scope.go:117] "RemoveContainer" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.244353 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244327 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} err="failed to get container status \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": rpc error: code = NotFound desc = could not find container \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": container with ID starting with d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e not found: ID does not exist" Sep 09 23:19:34.244353 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244352 2583 scope.go:117] "RemoveContainer" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.244612 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244589 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251"} err="failed to get container status \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": rpc error: code = NotFound desc = could not find container \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": container with ID starting with c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251 not found: ID does not exist" Sep 09 23:19:34.244680 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244615 2583 scope.go:117] "RemoveContainer" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.244879 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244862 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} err="failed to get container status \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": rpc error: code = NotFound desc = could not find container \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": container with ID starting with 67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492 not found: ID does not exist" Sep 09 23:19:34.244926 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.244880 2583 scope.go:117] "RemoveContainer" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.245140 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245122 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} err="failed to get container status \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": rpc error: code = NotFound desc = could not find container \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": container with ID starting with ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43 not found: ID does not exist" Sep 09 23:19:34.245189 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245143 2583 scope.go:117] "RemoveContainer" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.245391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245375 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} err="failed to get container status \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": rpc error: code = NotFound desc = could not find container \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": container with ID starting with fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0 not found: ID does not exist" Sep 09 23:19:34.245391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245390 2583 scope.go:117] "RemoveContainer" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.245642 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245616 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} err="failed to get container status \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": rpc error: code = NotFound desc = could not find container \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": container with ID starting with 9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c not found: ID does not exist" Sep 09 23:19:34.245692 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245646 2583 scope.go:117] "RemoveContainer" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.245915 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245891 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} err="failed to get container status \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": rpc error: code = NotFound desc = could not find container \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": container with ID starting with 69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147 not found: ID does not exist" Sep 09 23:19:34.246006 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.245917 2583 scope.go:117] "RemoveContainer" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.246165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246138 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} err="failed to get container status \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": rpc error: code = NotFound desc = could not find container \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": container with ID starting with d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e not found: ID does not exist" Sep 09 23:19:34.246233 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246166 2583 scope.go:117] "RemoveContainer" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.246400 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246379 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251"} err="failed to get container status \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": rpc error: code = NotFound desc = could not find container \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": container with ID starting with c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251 not found: ID does not exist" Sep 09 23:19:34.246473 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246401 2583 scope.go:117] "RemoveContainer" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.246701 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246683 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} err="failed to get container status \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": rpc error: code = NotFound desc = could not find container \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": container with ID starting with 67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492 not found: ID does not exist" Sep 09 23:19:34.246758 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246702 2583 scope.go:117] "RemoveContainer" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.246920 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246900 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} err="failed to get container status \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": rpc error: code = NotFound desc = could not find container \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": container with ID starting with ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43 not found: ID does not exist" Sep 09 23:19:34.246920 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.246918 2583 scope.go:117] "RemoveContainer" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.247151 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247134 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} err="failed to get container status \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": rpc error: code = NotFound desc = could not find container \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": container with ID starting with fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0 not found: ID does not exist" Sep 09 23:19:34.247204 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247152 2583 scope.go:117] "RemoveContainer" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.247393 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247376 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} err="failed to get container status \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": rpc error: code = NotFound desc = could not find container \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": container with ID starting with 9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c not found: ID does not exist" Sep 09 23:19:34.247438 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247393 2583 scope.go:117] "RemoveContainer" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.247631 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247614 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} err="failed to get container status \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": rpc error: code = NotFound desc = could not find container \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": container with ID starting with 69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147 not found: ID does not exist" Sep 09 23:19:34.247693 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247631 2583 scope.go:117] "RemoveContainer" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.247886 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247866 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} err="failed to get container status \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": rpc error: code = NotFound desc = could not find container \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": container with ID starting with d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e not found: ID does not exist" Sep 09 23:19:34.247968 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.247888 2583 scope.go:117] "RemoveContainer" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.248188 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.248169 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251"} err="failed to get container status \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": rpc error: code = NotFound desc = could not find container \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": container with ID starting with c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251 not found: ID does not exist" Sep 09 23:19:34.248244 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.248189 2583 scope.go:117] "RemoveContainer" containerID="67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492" Sep 09 23:19:34.248461 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.248436 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492"} err="failed to get container status \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": rpc error: code = NotFound desc = could not find container \"67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492\": container with ID starting with 67ebcd7d7bea30c074adef27e7055923d95d80c69db2894e642bd0705b934492 not found: ID does not exist" Sep 09 23:19:34.248535 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.248464 2583 scope.go:117] "RemoveContainer" containerID="ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43" Sep 09 23:19:34.248770 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.248749 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43"} err="failed to get container status \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": rpc error: code = NotFound desc = could not find container \"ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43\": container with ID starting with ab932723bda02c30e795f9da47570eafac81c14cb5b4ff7f13fc509e289b8e43 not found: ID does not exist" Sep 09 23:19:34.248813 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.248771 2583 scope.go:117] "RemoveContainer" containerID="fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0" Sep 09 23:19:34.249016 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249000 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0"} err="failed to get container status \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": rpc error: code = NotFound desc = could not find container \"fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0\": container with ID starting with fbc4cca979bd5913e1c05d16a2fb8d578cec6cba56242da3f6c427c3479d10c0 not found: ID does not exist" Sep 09 23:19:34.249078 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249015 2583 scope.go:117] "RemoveContainer" containerID="9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c" Sep 09 23:19:34.249267 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249250 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c"} err="failed to get container status \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": rpc error: code = NotFound desc = could not find container \"9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c\": container with ID starting with 9d0d42c660c4fd84d384913cbd8debd1f9544aca8ae97e41801485e1cb5da37c not found: ID does not exist" Sep 09 23:19:34.249267 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249267 2583 scope.go:117] "RemoveContainer" containerID="69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147" Sep 09 23:19:34.249495 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249479 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147"} err="failed to get container status \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": rpc error: code = NotFound desc = could not find container \"69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147\": container with ID starting with 69bdc1f920b9876eceb09aa0aa3a7023c09ebe4f5b10d233e43817c7b3cef147 not found: ID does not exist" Sep 09 23:19:34.249659 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249496 2583 scope.go:117] "RemoveContainer" containerID="d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e" Sep 09 23:19:34.249820 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249802 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e"} err="failed to get container status \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": rpc error: code = NotFound desc = could not find container \"d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e\": container with ID starting with d5eabd7c5554130c2672a24220f286283bd24c9a9e656517116c7673368ce88e not found: ID does not exist" Sep 09 23:19:34.249888 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.249822 2583 scope.go:117] "RemoveContainer" containerID="c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251" Sep 09 23:19:34.250073 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.250054 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251"} err="failed to get container status \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": rpc error: code = NotFound desc = could not find container \"c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251\": container with ID starting with c4c8874e4a70f8cb7e325220d64229c1fb213311b540f0dfff0f926b2f36a251 not found: ID does not exist" Sep 09 23:19:34.252645 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.252628 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-web-config" (OuterVolumeSpecName: "web-config") pod "60bd6a5e-7516-41b5-ad0d-120008a11c3d" (UID: "60bd6a5e-7516-41b5-ad0d-120008a11c3d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:19:34.339007 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.338972 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339007 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339006 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339021 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339035 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-metrics-client-ca\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339047 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339061 2583 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-metrics-client-certs\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339075 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339089 2583 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-tls-assets\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339101 2583 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-kube-rbac-proxy\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339114 2583 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-grpc-tls\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339128 2583 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config-out\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339139 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-db\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339152 2583 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339166 2583 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/60bd6a5e-7516-41b5-ad0d-120008a11c3d-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339179 2583 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-config\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339195 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p6nv4\" (UniqueName: \"kubernetes.io/projected/60bd6a5e-7516-41b5-ad0d-120008a11c3d-kube-api-access-p6nv4\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339209 2583 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339675 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339222 2583 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.339675 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.339261 2583 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/60bd6a5e-7516-41b5-ad0d-120008a11c3d-web-config\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:19:34.511894 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.511869 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:19:34.517617 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.517594 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:19:34.554831 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.554808 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:19:34.555120 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555106 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="init-config-reloader" Sep 09 23:19:34.555167 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555123 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="init-config-reloader" Sep 09 23:19:34.555167 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555130 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-web" Sep 09 23:19:34.555167 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555136 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-web" Sep 09 23:19:34.555167 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555153 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy" Sep 09 23:19:34.555167 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555162 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555174 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="prometheus" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555181 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="prometheus" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555186 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="config-reloader" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555191 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="config-reloader" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555197 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-thanos" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555204 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-thanos" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555215 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="thanos-sidecar" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555220 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="thanos-sidecar" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555264 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555272 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="config-reloader" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555279 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-thanos" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555284 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="prometheus" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555290 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="thanos-sidecar" Sep 09 23:19:34.555309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.555294 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" containerName="kube-rbac-proxy-web" Sep 09 23:19:34.558756 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.558738 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.565473 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565450 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Sep 09 23:19:34.565590 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565483 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Sep 09 23:19:34.565658 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565599 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Sep 09 23:19:34.565658 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565607 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Sep 09 23:19:34.565856 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565832 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Sep 09 23:19:34.565958 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565884 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Sep 09 23:19:34.565958 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565890 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Sep 09 23:19:34.566068 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565994 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Sep 09 23:19:34.566068 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.565996 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Sep 09 23:19:34.566282 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.566262 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Sep 09 23:19:34.566355 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.566262 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-35pef8du6khqn\"" Sep 09 23:19:34.566491 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.566475 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Sep 09 23:19:34.566577 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.566478 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fpp54\"" Sep 09 23:19:34.566737 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.566723 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Sep 09 23:19:34.571939 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.571923 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Sep 09 23:19:34.577361 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.577344 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Sep 09 23:19:34.580152 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.580136 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Sep 09 23:19:34.591254 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.591230 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:19:34.743129 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743089 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743137 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqfpf\" (UniqueName: \"kubernetes.io/projected/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-kube-api-access-dqfpf\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743169 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743203 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743228 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743258 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-config\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743279 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743303 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743293 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743318 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-config-out\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743343 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743363 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743386 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743430 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743468 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743489 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743508 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-web-config\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743543 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743583 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743568 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743865 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743593 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.743865 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.743626 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844367 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844398 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844416 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-web-config\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844439 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844500 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844546 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844576 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844638 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqfpf\" (UniqueName: \"kubernetes.io/projected/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-kube-api-access-dqfpf\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844676 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.844715 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844708 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844733 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844764 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-config\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844789 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844819 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844856 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-config-out\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844879 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844903 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844942 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845187 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.844973 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.845239 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.845346 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.845379 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.845638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.845428 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.847751 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.847625 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-web-config\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.847751 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.847632 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.847751 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.847731 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.848248 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.848055 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.848248 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.848074 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.848353 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.848315 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.849033 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.849008 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.849033 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.849011 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.849185 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.849013 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.849289 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.849262 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.849784 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.849760 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.850223 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.850197 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.850372 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.850346 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-config-out\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.850574 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.850555 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.851155 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.851133 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-config\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.856237 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.856217 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqfpf\" (UniqueName: \"kubernetes.io/projected/22f8a672-e1c3-4f81-997f-ccf7f97b3be9-kube-api-access-dqfpf\") pod \"prometheus-k8s-0\" (UID: \"22f8a672-e1c3-4f81-997f-ccf7f97b3be9\") " pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:34.868136 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:34.868119 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:35.147129 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:35.147105 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Sep 09 23:19:35.148535 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:19:35.148497 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f8a672_e1c3_4f81_997f_ccf7f97b3be9.slice/crio-65e7a2d885dfa23f8fcd922050713e0130eac8ba6453fdbd7574c846d9ed33a6 WatchSource:0}: Error finding container 65e7a2d885dfa23f8fcd922050713e0130eac8ba6453fdbd7574c846d9ed33a6: Status 404 returned error can't find the container with id 65e7a2d885dfa23f8fcd922050713e0130eac8ba6453fdbd7574c846d9ed33a6 Sep 09 23:19:35.192403 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:35.192376 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerStarted","Data":"65e7a2d885dfa23f8fcd922050713e0130eac8ba6453fdbd7574c846d9ed33a6"} Sep 09 23:19:35.527571 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:35.527512 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="60bd6a5e-7516-41b5-ad0d-120008a11c3d" path="/var/lib/kubelet/pods/60bd6a5e-7516-41b5-ad0d-120008a11c3d/volumes" Sep 09 23:19:36.198225 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:36.198187 2583 generic.go:356] "Generic (PLEG): container finished" podID="22f8a672-e1c3-4f81-997f-ccf7f97b3be9" containerID="2620db43128d79a8825b28ad2c4237cc06039648a45ab7ec8819122dc12165ad" exitCode=0 Sep 09 23:19:36.198590 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:36.198277 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerDied","Data":"2620db43128d79a8825b28ad2c4237cc06039648a45ab7ec8819122dc12165ad"} Sep 09 23:19:36.936581 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:36.936552 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:36.987252 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:36.987215 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:37.205440 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:37.205375 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerStarted","Data":"ecd816196ac297d1912755c2fffc8ed6cef469b5e65efe0cdd45bcdfa55c480e"} Sep 09 23:19:37.205440 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:37.205435 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerStarted","Data":"e51639f990d51407cd7126a4242308b7e9272609c65bc5c6b282cebcb28609ff"} Sep 09 23:19:37.205797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:37.205462 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerStarted","Data":"d7430ae4041e38cca6b07a1b5d6e487789dba5d2d707b765a9b9c828be66ab15"} Sep 09 23:19:37.205797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:37.205487 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerStarted","Data":"ee0f6d8bee538399a24d69de387479d1b3bb1b804dc42b34ea0daf77049f9748"} Sep 09 23:19:37.205797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:37.205510 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerStarted","Data":"eb2f1a3fb62770f565593677c821458557a654f72a0a666692ec04a8586cddfe"} Sep 09 23:19:37.205797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:37.205549 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"22f8a672-e1c3-4f81-997f-ccf7f97b3be9","Type":"ContainerStarted","Data":"3257d3d146f7deabc6374bc62b5f9c3a9e3cff31e14e018c90212d50acbf01f5"} Sep 09 23:19:37.233866 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:37.233825 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.218041863 podStartE2EDuration="3.233812047s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.770184ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:19:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:19:37.231483035 +0000 UTC m=+142.259493413" watchObservedRunningTime="2026-09-09 23:19:37.233812047 +0000 UTC m=+142.261822416" Sep 09 23:19:39.868902 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:39.868865 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:19:47.951119 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:47.951086 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:48.003581 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:48.003551 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:48.053035 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:48.053004 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:19:48.153246 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:19:48.153213 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:24.592805 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:24.592763 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:24.647371 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:24.647339 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:34.869172 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:34.869126 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:20:34.886437 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:34.886410 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:20:35.442946 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:35.442907 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Sep 09 23:20:43.667270 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:43.667216 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:43.764205 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:43.764155 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:50.816708 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:50.816678 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:50.874074 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:50.874038 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:50.961740 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:50.961718 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:51.010967 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:51.010920 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:51.570536 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:51.570476 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:55.614535 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:55.614503 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:20:55.661646 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:20:55.661618 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:00.594418 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:00.594369 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:00.692464 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:00.692430 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:02.216267 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:02.216231 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:02.316803 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:02.316778 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:02.371993 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:02.371967 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:07.940969 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:07.940939 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:35.123099 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:35.123062 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:36.601159 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:36.601127 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:49.673298 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:49.673202 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:56.600124 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:56.600085 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:21:57.935474 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:21:57.935438 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:00.173136 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:00.173096 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:00.273043 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:00.273018 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:02.360561 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:02.360512 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:02.462794 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:02.462751 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:02.685532 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:02.685504 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:02.793281 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:02.793250 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:04.569348 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:04.569314 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:04.766926 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:04.766901 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:07.169099 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:07.169069 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:07.225487 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:07.225460 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:10.159920 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:10.159880 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:10.209491 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:10.209463 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:12.971002 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:12.970968 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:15.069406 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.069375 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:15.169926 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.169900 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:15.201137 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.201112 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ptqh2"] Sep 09 23:22:15.204179 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.204164 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.206527 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.206505 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:22:15.206654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.206615 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:22:15.207502 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.207486 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wnrbz\"" Sep 09 23:22:15.211550 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.211512 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ptqh2"] Sep 09 23:22:15.328745 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.328681 2583 kubelet.go:1648] "Image garbage collection succeeded" Sep 09 23:22:15.340847 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.340823 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7efb31f-3be8-4d3b-881f-75415f226d7f-bound-sa-token\") pod \"cert-manager-55b4d954d5-ptqh2\" (UID: \"d7efb31f-3be8-4d3b-881f-75415f226d7f\") " pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.340966 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.340863 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9jmnt\" (UniqueName: \"kubernetes.io/projected/d7efb31f-3be8-4d3b-881f-75415f226d7f-kube-api-access-9jmnt\") pod \"cert-manager-55b4d954d5-ptqh2\" (UID: \"d7efb31f-3be8-4d3b-881f-75415f226d7f\") " pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.441176 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.441155 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7efb31f-3be8-4d3b-881f-75415f226d7f-bound-sa-token\") pod \"cert-manager-55b4d954d5-ptqh2\" (UID: \"d7efb31f-3be8-4d3b-881f-75415f226d7f\") " pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.441282 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.441192 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9jmnt\" (UniqueName: \"kubernetes.io/projected/d7efb31f-3be8-4d3b-881f-75415f226d7f-kube-api-access-9jmnt\") pod \"cert-manager-55b4d954d5-ptqh2\" (UID: \"d7efb31f-3be8-4d3b-881f-75415f226d7f\") " pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.449936 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.449917 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Sep 09 23:22:15.450084 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.450064 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d7efb31f-3be8-4d3b-881f-75415f226d7f-bound-sa-token\") pod \"cert-manager-55b4d954d5-ptqh2\" (UID: \"d7efb31f-3be8-4d3b-881f-75415f226d7f\") " pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.459981 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.459964 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Sep 09 23:22:15.470122 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.470102 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9jmnt\" (UniqueName: \"kubernetes.io/projected/d7efb31f-3be8-4d3b-881f-75415f226d7f-kube-api-access-9jmnt\") pod \"cert-manager-55b4d954d5-ptqh2\" (UID: \"d7efb31f-3be8-4d3b-881f-75415f226d7f\") " pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.531185 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.531068 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-wnrbz\"" Sep 09 23:22:15.539321 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.539299 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-ptqh2" Sep 09 23:22:15.830278 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:15.830243 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-ptqh2"] Sep 09 23:22:15.833397 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:22:15.833337 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7efb31f_3be8_4d3b_881f_75415f226d7f.slice/crio-5fdce50fccd7c245d9098213f108f29dc299d73b8f2212ac51f67942aef2b92f WatchSource:0}: Error finding container 5fdce50fccd7c245d9098213f108f29dc299d73b8f2212ac51f67942aef2b92f: Status 404 returned error can't find the container with id 5fdce50fccd7c245d9098213f108f29dc299d73b8f2212ac51f67942aef2b92f Sep 09 23:22:16.790842 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:16.790806 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ptqh2" event={"ID":"d7efb31f-3be8-4d3b-881f-75415f226d7f","Type":"ContainerStarted","Data":"5fdce50fccd7c245d9098213f108f29dc299d73b8f2212ac51f67942aef2b92f"} Sep 09 23:22:19.803862 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:19.803813 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-ptqh2" event={"ID":"d7efb31f-3be8-4d3b-881f-75415f226d7f","Type":"ContainerStarted","Data":"334f590bc1bfff22aa900e522454698c9ffb79da291272d90b978d0a58a2f391"} Sep 09 23:22:19.825055 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:19.825001 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-ptqh2" podStartSLOduration=1.869398897 podStartE2EDuration="4.824984065s" totalImagesPullingTime="2.955585168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:19.823874233 +0000 UTC m=+304.851884604" watchObservedRunningTime="2026-09-09 23:22:19.824984065 +0000 UTC m=+304.852994434" Sep 09 23:22:20.036316 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:20.036286 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:20.140732 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:20.140661 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:22.215579 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:22.215546 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:38.818188 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:38.818158 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:38.929451 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:38.929422 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:39.424208 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.424179 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:39.616504 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.616476 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:39.717362 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.717293 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:39.745247 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.745221 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms"] Sep 09 23:22:39.748407 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.748391 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:39.751503 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.751084 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Sep 09 23:22:39.751503 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.751208 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7xcjn\"" Sep 09 23:22:39.751503 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.751325 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Sep 09 23:22:39.751503 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.751462 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Sep 09 23:22:39.751774 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.751729 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Sep 09 23:22:39.766048 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.766029 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms"] Sep 09 23:22:39.904356 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.904322 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bc8nh\" (UniqueName: \"kubernetes.io/projected/514990db-f69a-4791-aefc-92c3dbd66c5d-kube-api-access-bc8nh\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:39.904356 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.904368 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514990db-f69a-4791-aefc-92c3dbd66c5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:39.904871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.904440 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/514990db-f69a-4791-aefc-92c3dbd66c5d-manifests\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:39.904871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.904504 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/514990db-f69a-4791-aefc-92c3dbd66c5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:39.904871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.904543 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/514990db-f69a-4791-aefc-92c3dbd66c5d-tmp\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:39.940109 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:39.940077 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.004972 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.004910 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/514990db-f69a-4791-aefc-92c3dbd66c5d-tmp\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.005079 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.004974 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bc8nh\" (UniqueName: \"kubernetes.io/projected/514990db-f69a-4791-aefc-92c3dbd66c5d-kube-api-access-bc8nh\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.005079 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.005001 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514990db-f69a-4791-aefc-92c3dbd66c5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.005165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.005145 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/514990db-f69a-4791-aefc-92c3dbd66c5d-manifests\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.005416 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.005193 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/514990db-f69a-4791-aefc-92c3dbd66c5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.005507 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.005450 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/514990db-f69a-4791-aefc-92c3dbd66c5d-manifests\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.007177 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.007151 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/514990db-f69a-4791-aefc-92c3dbd66c5d-tmp\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.007472 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.007455 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/514990db-f69a-4791-aefc-92c3dbd66c5d-webhook-cert\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.007514 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.007495 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/514990db-f69a-4791-aefc-92c3dbd66c5d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.012589 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.012568 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bc8nh\" (UniqueName: \"kubernetes.io/projected/514990db-f69a-4791-aefc-92c3dbd66c5d-kube-api-access-bc8nh\") pod \"opendatahub-operator-controller-manager-8c5c8967d-xknms\" (UID: \"514990db-f69a-4791-aefc-92c3dbd66c5d\") " pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.040198 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.040163 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.059181 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.059158 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:40.141433 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.141407 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.241489 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.241460 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.335477 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.335455 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms"] Sep 09 23:22:40.337508 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:22:40.337477 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod514990db_f69a_4791_aefc_92c3dbd66c5d.slice/crio-9cd8552edeccb8ed6e989fc4d3d8f28c17cfb5efe87f509c4ea2b7e9b4072fab WatchSource:0}: Error finding container 9cd8552edeccb8ed6e989fc4d3d8f28c17cfb5efe87f509c4ea2b7e9b4072fab: Status 404 returned error can't find the container with id 9cd8552edeccb8ed6e989fc4d3d8f28c17cfb5efe87f509c4ea2b7e9b4072fab Sep 09 23:22:40.338601 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.338480 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.339416 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.339399 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:22:40.395725 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.395703 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.497099 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.497076 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.596308 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.596247 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:40.885452 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:40.885368 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" event={"ID":"514990db-f69a-4791-aefc-92c3dbd66c5d","Type":"ContainerStarted","Data":"9cd8552edeccb8ed6e989fc4d3d8f28c17cfb5efe87f509c4ea2b7e9b4072fab"} Sep 09 23:22:43.900188 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:43.900144 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" event={"ID":"514990db-f69a-4791-aefc-92c3dbd66c5d","Type":"ContainerStarted","Data":"7d4a33ae43665b63405790687d73667aae4cca6bee1755ad60edc6aaf38baced"} Sep 09 23:22:44.905851 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:44.905821 2583 generic.go:356] "Generic (PLEG): container finished" podID="514990db-f69a-4791-aefc-92c3dbd66c5d" containerID="7d4a33ae43665b63405790687d73667aae4cca6bee1755ad60edc6aaf38baced" exitCode=0 Sep 09 23:22:44.906185 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:44.905907 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" event={"ID":"514990db-f69a-4791-aefc-92c3dbd66c5d","Type":"ContainerDied","Data":"7d4a33ae43665b63405790687d73667aae4cca6bee1755ad60edc6aaf38baced"} Sep 09 23:22:45.911227 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:45.911187 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" event={"ID":"514990db-f69a-4791-aefc-92c3dbd66c5d","Type":"ContainerStarted","Data":"b197fef4b29217ca21d5c20eae311dcdb31f5d8ee26f0046ee0023d70d6a39c7"} Sep 09 23:22:45.911654 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:45.911333 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:45.932276 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:45.932218 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" podStartSLOduration=2.56533544 podStartE2EDuration="6.932201933s" totalImagesPullingTime="3.369750256s" totalInitContainerRuntime="997.116237ms" isStatefulPod=false podCreationTimestamp="2026-09-09 23:22:39 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:22:45.930633076 +0000 UTC m=+330.958643446" watchObservedRunningTime="2026-09-09 23:22:45.932201933 +0000 UTC m=+330.960212321" Sep 09 23:22:48.427682 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:48.427651 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:48.539551 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:48.539491 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:51.671647 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:51.671586 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:51.768629 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:51.768602 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:56.916860 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:56.916822 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-8c5c8967d-xknms" Sep 09 23:22:58.394755 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:58.394717 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:22:58.502614 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:22:58.502581 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:00.122656 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.122618 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:00.150818 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.150788 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb"] Sep 09 23:23:00.159340 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.159317 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.162148 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.162123 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Sep 09 23:23:00.163486 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.163465 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Sep 09 23:23:00.163606 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.163504 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Sep 09 23:23:00.163606 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.163557 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9rn7m\"" Sep 09 23:23:00.163695 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.163642 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Sep 09 23:23:00.167541 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.167500 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb"] Sep 09 23:23:00.214255 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.214228 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:00.249281 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.249257 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e9dffc-f652-4567-b2e0-e4de914de268-tls-certs\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.249433 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.249292 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m42fx\" (UniqueName: \"kubernetes.io/projected/f8e9dffc-f652-4567-b2e0-e4de914de268-kube-api-access-m42fx\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.249433 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.249318 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8e9dffc-f652-4567-b2e0-e4de914de268-tmp\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.350645 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.350612 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e9dffc-f652-4567-b2e0-e4de914de268-tls-certs\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.350735 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.350656 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m42fx\" (UniqueName: \"kubernetes.io/projected/f8e9dffc-f652-4567-b2e0-e4de914de268-kube-api-access-m42fx\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.350735 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.350680 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8e9dffc-f652-4567-b2e0-e4de914de268-tmp\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.352869 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.352848 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f8e9dffc-f652-4567-b2e0-e4de914de268-tmp\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.353086 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.353069 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f8e9dffc-f652-4567-b2e0-e4de914de268-tls-certs\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.358268 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.358244 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m42fx\" (UniqueName: \"kubernetes.io/projected/f8e9dffc-f652-4567-b2e0-e4de914de268-kube-api-access-m42fx\") pod \"kube-auth-proxy-7bd8cf678b-jvqqb\" (UID: \"f8e9dffc-f652-4567-b2e0-e4de914de268\") " pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.469516 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.469493 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" Sep 09 23:23:00.739210 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.739138 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb"] Sep 09 23:23:00.743060 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:23:00.743024 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8e9dffc_f652_4567_b2e0_e4de914de268.slice/crio-d40f91ab57e27875eb3afd1d9ca7d2f0dd8b3c8bcd61c295147bf456a28ff758 WatchSource:0}: Error finding container d40f91ab57e27875eb3afd1d9ca7d2f0dd8b3c8bcd61c295147bf456a28ff758: Status 404 returned error can't find the container with id d40f91ab57e27875eb3afd1d9ca7d2f0dd8b3c8bcd61c295147bf456a28ff758 Sep 09 23:23:00.973186 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:00.973145 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" event={"ID":"f8e9dffc-f652-4567-b2e0-e4de914de268","Type":"ContainerStarted","Data":"d40f91ab57e27875eb3afd1d9ca7d2f0dd8b3c8bcd61c295147bf456a28ff758"} Sep 09 23:23:01.259966 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.259934 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:01.263739 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.263716 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr"] Sep 09 23:23:01.266852 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.266836 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.269316 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.269285 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Sep 09 23:23:01.269431 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.269363 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-fdckl\"" Sep 09 23:23:01.269556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.269541 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Sep 09 23:23:01.269556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.269547 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Sep 09 23:23:01.269735 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.269584 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Sep 09 23:23:01.278000 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.277980 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr"] Sep 09 23:23:01.358112 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.358083 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.358232 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.358149 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7zds\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-kube-api-access-k7zds\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.358232 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.358187 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586542c2-de24-4f5e-9cca-a55d806bb9ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.358232 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.358217 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.358406 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.358299 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.358406 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.358360 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.358491 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.358413 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.360402 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.360361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:01.459704 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.459663 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.459834 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.459743 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.459834 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.459790 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7zds\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-kube-api-access-k7zds\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.459834 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.459821 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586542c2-de24-4f5e-9cca-a55d806bb9ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.459993 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.459852 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.459993 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.459880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.459993 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.459909 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.460907 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.460864 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.463091 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.463047 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.463196 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.463165 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.463374 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.463351 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586542c2-de24-4f5e-9cca-a55d806bb9ec-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.463822 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.463801 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.468028 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.467995 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.469171 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.469144 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7zds\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-kube-api-access-k7zds\") pod \"istiod-openshift-gateway-7b7995d5cd-rsgmr\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.579012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.578946 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:01.862138 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.862112 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr"] Sep 09 23:23:01.864349 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:23:01.864317 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod586542c2_de24_4f5e_9cca_a55d806bb9ec.slice/crio-5d4868118e929d9b88b8eb296c27865280842a441d8443365cd90c3e6d30e2bf WatchSource:0}: Error finding container 5d4868118e929d9b88b8eb296c27865280842a441d8443365cd90c3e6d30e2bf: Status 404 returned error can't find the container with id 5d4868118e929d9b88b8eb296c27865280842a441d8443365cd90c3e6d30e2bf Sep 09 23:23:01.979820 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:01.979766 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" event={"ID":"586542c2-de24-4f5e-9cca-a55d806bb9ec","Type":"ContainerStarted","Data":"5d4868118e929d9b88b8eb296c27865280842a441d8443365cd90c3e6d30e2bf"} Sep 09 23:23:02.220817 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:02.220782 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:03.041553 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:03.041492 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:03.139174 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:03.139140 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:03.991582 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:03.991399 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" event={"ID":"f8e9dffc-f652-4567-b2e0-e4de914de268","Type":"ContainerStarted","Data":"8059da2c97a2af4e8364b7bdea9c498586a89ee7455403cca0e79be719a7196c"} Sep 09 23:23:04.007399 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:04.007350 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bd8cf678b-jvqqb" podStartSLOduration=1.31740299 podStartE2EDuration="4.007332965s" totalImagesPullingTime="2.689929975s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:04.006249766 +0000 UTC m=+349.034260137" watchObservedRunningTime="2026-09-09 23:23:04.007332965 +0000 UTC m=+349.035343335" Sep 09 23:23:05.229005 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:05.228968 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 09 23:23:05.229279 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:05.229041 2583 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236212Ki","pods":"250"} Sep 09 23:23:05.919900 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:05.919866 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:06.001995 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.001958 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" event={"ID":"586542c2-de24-4f5e-9cca-a55d806bb9ec","Type":"ContainerStarted","Data":"47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178"} Sep 09 23:23:06.002177 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.002144 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:06.008209 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.008163 2583 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-rsgmr container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Sep 09 23:23:06.008380 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.008249 2583 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" podUID="586542c2-de24-4f5e-9cca-a55d806bb9ec" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Sep 09 23:23:06.032310 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.032280 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:06.048638 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.048596 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" podStartSLOduration=1.6870838209999999 podStartE2EDuration="5.048581061s" totalImagesPullingTime="3.36149724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:06.047487943 +0000 UTC m=+351.075498316" watchObservedRunningTime="2026-09-09 23:23:06.048581061 +0000 UTC m=+351.076591430" Sep 09 23:23:06.705911 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.705882 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:06.905119 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:06.905077 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:07.006594 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:07.006485 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:07.006936 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:07.006918 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:08.472741 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:08.472653 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:08.572993 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:08.572945 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:09.528391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:09.528362 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:09.634357 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:09.634325 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:09.729456 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:09.729421 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:09.829493 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:09.829432 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:10.011915 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:10.011885 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:10.100312 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:10.100236 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:13.850239 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:13.850205 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:13.903234 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:13.903206 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:13.965500 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:13.965474 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:17.314703 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.314668 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-67998c845-9x6g6"] Sep 09 23:23:17.322070 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.322042 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.327120 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.327097 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-4x7sb\"" Sep 09 23:23:17.327120 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.327116 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Sep 09 23:23:17.327338 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.327121 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Sep 09 23:23:17.327449 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.327432 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Sep 09 23:23:17.327541 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.327486 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Sep 09 23:23:17.328102 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.328082 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Sep 09 23:23:17.335135 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.335110 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67998c845-9x6g6"] Sep 09 23:23:17.383899 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.383874 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-cert\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.384012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.383924 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-manager-config\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.384012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.383994 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-metrics-cert\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.384012 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.384009 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncqrc\" (UniqueName: \"kubernetes.io/projected/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-kube-api-access-ncqrc\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.485306 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.485262 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-manager-config\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.485474 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.485316 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-metrics-cert\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.485474 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.485428 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncqrc\" (UniqueName: \"kubernetes.io/projected/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-kube-api-access-ncqrc\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.485631 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.485471 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-cert\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.486014 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.485989 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-manager-config\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.487815 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.487797 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-cert\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.487954 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.487804 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-metrics-cert\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.498888 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.498861 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncqrc\" (UniqueName: \"kubernetes.io/projected/cc39e1a9-d08e-4a52-b1a3-da58f1b080e8-kube-api-access-ncqrc\") pod \"lws-controller-manager-67998c845-9x6g6\" (UID: \"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8\") " pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.631257 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.631202 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:17.931622 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:23:17.931578 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc39e1a9_d08e_4a52_b1a3_da58f1b080e8.slice/crio-e87719249a255b780eeb493e3ee803f817b3f8f944e46be42f3dab3e2a4ecd6f WatchSource:0}: Error finding container e87719249a255b780eeb493e3ee803f817b3f8f944e46be42f3dab3e2a4ecd6f: Status 404 returned error can't find the container with id e87719249a255b780eeb493e3ee803f817b3f8f944e46be42f3dab3e2a4ecd6f Sep 09 23:23:17.932491 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:17.932465 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-67998c845-9x6g6"] Sep 09 23:23:18.050285 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:18.050257 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" event={"ID":"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8","Type":"ContainerStarted","Data":"e87719249a255b780eeb493e3ee803f817b3f8f944e46be42f3dab3e2a4ecd6f"} Sep 09 23:23:18.676435 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:18.676405 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:18.795159 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:18.795073 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:19.192493 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:19.192442 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:19.596572 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:19.596505 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:19.966608 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:19.966571 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:20.070003 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:20.069974 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:20.166908 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:20.166875 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:20.807489 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:20.807417 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr"] Sep 09 23:23:20.807649 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:20.807628 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" podUID="586542c2-de24-4f5e-9cca-a55d806bb9ec" containerName="discovery" containerID="cri-o://47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178" gracePeriod=30 Sep 09 23:23:21.037964 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.037939 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:21.079368 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.079301 2583 generic.go:356] "Generic (PLEG): container finished" podID="586542c2-de24-4f5e-9cca-a55d806bb9ec" containerID="47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178" exitCode=0 Sep 09 23:23:21.079368 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.079345 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" Sep 09 23:23:21.079562 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.079380 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" event={"ID":"586542c2-de24-4f5e-9cca-a55d806bb9ec","Type":"ContainerDied","Data":"47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178"} Sep 09 23:23:21.079562 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.079446 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr" event={"ID":"586542c2-de24-4f5e-9cca-a55d806bb9ec","Type":"ContainerDied","Data":"5d4868118e929d9b88b8eb296c27865280842a441d8443365cd90c3e6d30e2bf"} Sep 09 23:23:21.079562 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.079476 2583 scope.go:117] "RemoveContainer" containerID="47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178" Sep 09 23:23:21.081156 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.081135 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" event={"ID":"cc39e1a9-d08e-4a52-b1a3-da58f1b080e8","Type":"ContainerStarted","Data":"0b2e433e3ec71927f0a37957221d7c4b5b98f8e2b322fba517b2195cca1aaaca"} Sep 09 23:23:21.081292 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.081278 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:21.087423 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.087406 2583 scope.go:117] "RemoveContainer" containerID="47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178" Sep 09 23:23:21.087754 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:23:21.087734 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178\": container with ID starting with 47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178 not found: ID does not exist" containerID="47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178" Sep 09 23:23:21.087849 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.087759 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178"} err="failed to get container status \"47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178\": rpc error: code = NotFound desc = could not find container \"47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178\": container with ID starting with 47e8ef921ef4eeb4aa3a5b1dc2a000e551a68a8332451931f81479cd0336c178 not found: ID does not exist" Sep 09 23:23:21.118073 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118050 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-ca-configmap\") pod \"586542c2-de24-4f5e-9cca-a55d806bb9ec\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " Sep 09 23:23:21.118165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118082 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-kubeconfig\") pod \"586542c2-de24-4f5e-9cca-a55d806bb9ec\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " Sep 09 23:23:21.118165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118112 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-dns-cert\") pod \"586542c2-de24-4f5e-9cca-a55d806bb9ec\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " Sep 09 23:23:21.118165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118136 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-cacerts\") pod \"586542c2-de24-4f5e-9cca-a55d806bb9ec\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " Sep 09 23:23:21.118165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118164 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k7zds\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-kube-api-access-k7zds\") pod \"586542c2-de24-4f5e-9cca-a55d806bb9ec\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " Sep 09 23:23:21.118372 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118185 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586542c2-de24-4f5e-9cca-a55d806bb9ec-local-certs\") pod \"586542c2-de24-4f5e-9cca-a55d806bb9ec\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " Sep 09 23:23:21.118372 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118227 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-token\") pod \"586542c2-de24-4f5e-9cca-a55d806bb9ec\" (UID: \"586542c2-de24-4f5e-9cca-a55d806bb9ec\") " Sep 09 23:23:21.118470 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118445 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "586542c2-de24-4f5e-9cca-a55d806bb9ec" (UID: "586542c2-de24-4f5e-9cca-a55d806bb9ec"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Sep 09 23:23:21.118588 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.118565 2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-ca-configmap\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:23:21.120359 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.120330 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "586542c2-de24-4f5e-9cca-a55d806bb9ec" (UID: "586542c2-de24-4f5e-9cca-a55d806bb9ec"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:23:21.120470 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.120433 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-cacerts" (OuterVolumeSpecName: "cacerts") pod "586542c2-de24-4f5e-9cca-a55d806bb9ec" (UID: "586542c2-de24-4f5e-9cca-a55d806bb9ec"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:23:21.120676 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.120651 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "586542c2-de24-4f5e-9cca-a55d806bb9ec" (UID: "586542c2-de24-4f5e-9cca-a55d806bb9ec"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:23:21.120676 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.120661 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/586542c2-de24-4f5e-9cca-a55d806bb9ec-local-certs" (OuterVolumeSpecName: "local-certs") pod "586542c2-de24-4f5e-9cca-a55d806bb9ec" (UID: "586542c2-de24-4f5e-9cca-a55d806bb9ec"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Sep 09 23:23:21.120797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.120677 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-kube-api-access-k7zds" (OuterVolumeSpecName: "kube-api-access-k7zds") pod "586542c2-de24-4f5e-9cca-a55d806bb9ec" (UID: "586542c2-de24-4f5e-9cca-a55d806bb9ec"). InnerVolumeSpecName "kube-api-access-k7zds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:23:21.120836 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.120802 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-token" (OuterVolumeSpecName: "istio-token") pod "586542c2-de24-4f5e-9cca-a55d806bb9ec" (UID: "586542c2-de24-4f5e-9cca-a55d806bb9ec"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:23:21.219875 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.219851 2583 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-kubeconfig\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:23:21.219875 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.219872 2583 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-csr-dns-cert\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:23:21.219988 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.219884 2583 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/586542c2-de24-4f5e-9cca-a55d806bb9ec-cacerts\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:23:21.219988 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.219893 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k7zds\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-kube-api-access-k7zds\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:23:21.219988 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.219902 2583 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/586542c2-de24-4f5e-9cca-a55d806bb9ec-local-certs\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:23:21.219988 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.219910 2583 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/586542c2-de24-4f5e-9cca-a55d806bb9ec-istio-token\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:23:21.398951 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.398910 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" podStartSLOduration=1.8665084950000002 podStartE2EDuration="4.39889613s" totalImagesPullingTime="2.532387635s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:23:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:23:21.115855744 +0000 UTC m=+366.143866137" watchObservedRunningTime="2026-09-09 23:23:21.39889613 +0000 UTC m=+366.426906503" Sep 09 23:23:21.399497 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.399482 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr"] Sep 09 23:23:21.402893 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.402873 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-rsgmr"] Sep 09 23:23:21.528284 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:21.528256 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="586542c2-de24-4f5e-9cca-a55d806bb9ec" path="/var/lib/kubelet/pods/586542c2-de24-4f5e-9cca-a55d806bb9ec/volumes" Sep 09 23:23:32.088996 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:32.088959 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-67998c845-9x6g6" Sep 09 23:23:36.276115 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:36.276078 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:23:36.327463 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:23:36.327433 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:10.421036 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:10.420995 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:10.522263 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:10.522235 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:24.415607 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:24.415574 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:27.011560 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:27.011509 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:27.413995 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:27.413962 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:27.814820 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:27.814729 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:30.242390 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:30.242358 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:31.284323 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:31.284291 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:31.496111 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:31.496078 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:32.791354 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.791321 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh"] Sep 09 23:24:32.791756 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.791645 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="586542c2-de24-4f5e-9cca-a55d806bb9ec" containerName="discovery" Sep 09 23:24:32.791756 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.791657 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="586542c2-de24-4f5e-9cca-a55d806bb9ec" containerName="discovery" Sep 09 23:24:32.791756 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.791705 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="586542c2-de24-4f5e-9cca-a55d806bb9ec" containerName="discovery" Sep 09 23:24:32.795724 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.795704 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" Sep 09 23:24:32.798156 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.798134 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-tgvtq\"" Sep 09 23:24:32.798156 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.798147 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Sep 09 23:24:32.798156 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.798150 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Sep 09 23:24:32.798370 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.798197 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Sep 09 23:24:32.804063 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.804043 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh"] Sep 09 23:24:32.909314 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.909291 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zz75n\" (UniqueName: \"kubernetes.io/projected/f366c939-e211-4c9b-87cf-b30dbab1da73-kube-api-access-zz75n\") pod \"dns-operator-controller-manager-7b84cd7c9c-6gflh\" (UID: \"f366c939-e211-4c9b-87cf-b30dbab1da73\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" Sep 09 23:24:32.998344 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:32.998320 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:33.010458 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:33.010437 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zz75n\" (UniqueName: \"kubernetes.io/projected/f366c939-e211-4c9b-87cf-b30dbab1da73-kube-api-access-zz75n\") pod \"dns-operator-controller-manager-7b84cd7c9c-6gflh\" (UID: \"f366c939-e211-4c9b-87cf-b30dbab1da73\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" Sep 09 23:24:33.024354 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:33.024329 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zz75n\" (UniqueName: \"kubernetes.io/projected/f366c939-e211-4c9b-87cf-b30dbab1da73-kube-api-access-zz75n\") pod \"dns-operator-controller-manager-7b84cd7c9c-6gflh\" (UID: \"f366c939-e211-4c9b-87cf-b30dbab1da73\") " pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" Sep 09 23:24:33.106168 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:33.106116 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" Sep 09 23:24:33.378329 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:33.378260 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh"] Sep 09 23:24:33.382136 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:24:33.382110 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf366c939_e211_4c9b_87cf_b30dbab1da73.slice/crio-52b7fad928427b7b6db9467f7e8033e385dd1144e61b407a5640b03d4d0ebce0 WatchSource:0}: Error finding container 52b7fad928427b7b6db9467f7e8033e385dd1144e61b407a5640b03d4d0ebce0: Status 404 returned error can't find the container with id 52b7fad928427b7b6db9467f7e8033e385dd1144e61b407a5640b03d4d0ebce0 Sep 09 23:24:33.391243 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:33.391214 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" event={"ID":"f366c939-e211-4c9b-87cf-b30dbab1da73","Type":"ContainerStarted","Data":"52b7fad928427b7b6db9467f7e8033e385dd1144e61b407a5640b03d4d0ebce0"} Sep 09 23:24:33.411479 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:33.411453 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:33.654957 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:33.654934 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:35.445317 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.445286 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hj8tl"] Sep 09 23:24:35.448897 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.448877 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" Sep 09 23:24:35.451238 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.451214 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-bmf4k\"" Sep 09 23:24:35.458552 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.458508 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hj8tl"] Sep 09 23:24:35.633572 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.633535 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmzq8\" (UniqueName: \"kubernetes.io/projected/3db4c5d8-38df-4d3c-822f-879079d18c92-kube-api-access-lmzq8\") pod \"authorino-operator-76b478bd78-hj8tl\" (UID: \"3db4c5d8-38df-4d3c-822f-879079d18c92\") " pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" Sep 09 23:24:35.734847 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.734798 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmzq8\" (UniqueName: \"kubernetes.io/projected/3db4c5d8-38df-4d3c-822f-879079d18c92-kube-api-access-lmzq8\") pod \"authorino-operator-76b478bd78-hj8tl\" (UID: \"3db4c5d8-38df-4d3c-822f-879079d18c92\") " pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" Sep 09 23:24:35.742398 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.742375 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmzq8\" (UniqueName: \"kubernetes.io/projected/3db4c5d8-38df-4d3c-822f-879079d18c92-kube-api-access-lmzq8\") pod \"authorino-operator-76b478bd78-hj8tl\" (UID: \"3db4c5d8-38df-4d3c-822f-879079d18c92\") " pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" Sep 09 23:24:35.762441 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:35.762419 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" Sep 09 23:24:36.031413 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:36.031335 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-76b478bd78-hj8tl"] Sep 09 23:24:36.034595 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:24:36.034569 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db4c5d8_38df_4d3c_822f_879079d18c92.slice/crio-9a6c04afeb454bd82fce8f6863380d0fb6b2caad3c843a1e97abd9bc05b1f1c7 WatchSource:0}: Error finding container 9a6c04afeb454bd82fce8f6863380d0fb6b2caad3c843a1e97abd9bc05b1f1c7: Status 404 returned error can't find the container with id 9a6c04afeb454bd82fce8f6863380d0fb6b2caad3c843a1e97abd9bc05b1f1c7 Sep 09 23:24:36.248771 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:36.248723 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:36.405904 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:36.405875 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" event={"ID":"3db4c5d8-38df-4d3c-822f-879079d18c92","Type":"ContainerStarted","Data":"9a6c04afeb454bd82fce8f6863380d0fb6b2caad3c843a1e97abd9bc05b1f1c7"} Sep 09 23:24:36.407557 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:36.407516 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" event={"ID":"f366c939-e211-4c9b-87cf-b30dbab1da73","Type":"ContainerStarted","Data":"508fca1ea1bdd116a13016f8bb8a1eb74a74f265333bdc8bdd3dae218ce2e916"} Sep 09 23:24:36.407672 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:36.407657 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" Sep 09 23:24:36.427120 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:36.427082 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" podStartSLOduration=2.181359933 podStartE2EDuration="4.427066928s" totalImagesPullingTime="2.245706995s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:36.426503232 +0000 UTC m=+441.454513602" watchObservedRunningTime="2026-09-09 23:24:36.427066928 +0000 UTC m=+441.455077298" Sep 09 23:24:37.015509 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.015471 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:37.116126 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.116090 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:37.413957 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.413929 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" event={"ID":"3db4c5d8-38df-4d3c-822f-879079d18c92","Type":"ContainerStarted","Data":"5309446294d8f54239c04dab2c3696832aa601d022ec93bcd33984f92b0553dd"} Sep 09 23:24:37.429918 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.429877 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" podStartSLOduration=1.27158508 podStartE2EDuration="2.429860769s" totalImagesPullingTime="1.158275689s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:37.428483943 +0000 UTC m=+442.456494304" watchObservedRunningTime="2026-09-09 23:24:37.429860769 +0000 UTC m=+442.457871138" Sep 09 23:24:37.558029 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.557997 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86"] Sep 09 23:24:37.561166 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.561146 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.563425 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.563403 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Sep 09 23:24:37.563531 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.563443 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Sep 09 23:24:37.563621 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.563602 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-7nt94\"" Sep 09 23:24:37.568754 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.568729 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86"] Sep 09 23:24:37.568837 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.568816 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:37.663002 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.662982 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:37.752231 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.752182 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.752394 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.752233 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krgsp\" (UniqueName: \"kubernetes.io/projected/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-kube-api-access-krgsp\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.752394 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.752286 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.853566 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.853547 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.853655 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.853595 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krgsp\" (UniqueName: \"kubernetes.io/projected/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-kube-api-access-krgsp\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.853738 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.853716 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.854219 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.854193 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-nginx-conf\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.856058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.856042 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-plugin-serving-cert\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.861636 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.861614 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krgsp\" (UniqueName: \"kubernetes.io/projected/ad44cb4c-2373-49f7-990c-2fdfd8eeb740-kube-api-access-krgsp\") pod \"kuadrant-console-plugin-fbdd4f445-jzz86\" (UID: \"ad44cb4c-2373-49f7-990c-2fdfd8eeb740\") " pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:37.870608 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:37.870588 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" Sep 09 23:24:38.137135 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:38.137107 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86"] Sep 09 23:24:38.139324 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:24:38.139291 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podad44cb4c_2373_49f7_990c_2fdfd8eeb740.slice/crio-1fac211b8d2338c634122105a4ceca25c6c33f7ab791f09cf24460bace67b7c6 WatchSource:0}: Error finding container 1fac211b8d2338c634122105a4ceca25c6c33f7ab791f09cf24460bace67b7c6: Status 404 returned error can't find the container with id 1fac211b8d2338c634122105a4ceca25c6c33f7ab791f09cf24460bace67b7c6 Sep 09 23:24:38.422146 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:38.422112 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" event={"ID":"ad44cb4c-2373-49f7-990c-2fdfd8eeb740","Type":"ContainerStarted","Data":"1fac211b8d2338c634122105a4ceca25c6c33f7ab791f09cf24460bace67b7c6"} Sep 09 23:24:38.422273 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:38.422256 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" Sep 09 23:24:41.004765 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:41.004733 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:41.056368 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:41.056335 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:41.430126 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:41.430094 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:41.532869 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:41.532811 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:41.891297 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:41.891219 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:41.987009 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:41.986969 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:43.449971 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:43.449932 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" event={"ID":"ad44cb4c-2373-49f7-990c-2fdfd8eeb740","Type":"ContainerStarted","Data":"902f64b6a3c5717e2b6b6fc4e3bac5e2ed54d98b6edcdec7696852a47e51de2a"} Sep 09 23:24:43.465814 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:43.465760 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-fbdd4f445-jzz86" podStartSLOduration=2.217874325 podStartE2EDuration="6.465744042s" totalImagesPullingTime="4.247869717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:24:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:24:43.464250907 +0000 UTC m=+448.492261279" watchObservedRunningTime="2026-09-09 23:24:43.465744042 +0000 UTC m=+448.493754411" Sep 09 23:24:47.416316 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:47.416288 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-7b84cd7c9c-6gflh" Sep 09 23:24:47.576105 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:47.576059 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:47.682391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:47.682301 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:49.430536 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:49.430502 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-76b478bd78-hj8tl" Sep 09 23:24:52.345502 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:52.345467 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:52.445306 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:52.445268 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:54.023514 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:54.023476 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:54.124675 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:54.124636 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:55.286381 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:55.286336 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:55.353783 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:55.353758 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:56.623802 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:56.623771 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:56.724486 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:56.724454 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:57.232825 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:57.232787 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:57.332854 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:57.332826 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:24:59.935201 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:24:59.935167 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:00.034606 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:00.034576 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:00.134943 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:00.134910 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:06.402826 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:06.402796 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:06.503084 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:06.503052 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:12.961343 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:12.961307 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:13.058750 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:13.058715 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:15.569219 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:15.569181 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:15.672886 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:15.672854 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:17.254603 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:17.254571 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:17.429980 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:17.429928 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:19.366673 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:19.366640 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:19.433832 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:19.433790 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:19.531147 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:19.531109 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:19.632143 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:19.632073 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:20.131058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.131028 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kgzp9"] Sep 09 23:25:20.135269 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.135247 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" Sep 09 23:25:20.137728 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.137707 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-djw7j\"" Sep 09 23:25:20.141166 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.141146 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kgzp9"] Sep 09 23:25:20.162225 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.162201 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:20.239874 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.239852 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:20.243471 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.243453 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-59c974bd48-cqv2f"] Sep 09 23:25:20.245438 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.245419 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cqv2f" Sep 09 23:25:20.253146 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.253122 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cqv2f"] Sep 09 23:25:20.264220 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.264194 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m64wn\" (UniqueName: \"kubernetes.io/projected/4f375c28-91cf-40f3-bf84-43aae78e9e8e-kube-api-access-m64wn\") pod \"authorino-7bcfd8f9cd-kgzp9\" (UID: \"4f375c28-91cf-40f3-bf84-43aae78e9e8e\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" Sep 09 23:25:20.364800 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.364779 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m64wn\" (UniqueName: \"kubernetes.io/projected/4f375c28-91cf-40f3-bf84-43aae78e9e8e-kube-api-access-m64wn\") pod \"authorino-7bcfd8f9cd-kgzp9\" (UID: \"4f375c28-91cf-40f3-bf84-43aae78e9e8e\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" Sep 09 23:25:20.364920 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.364836 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49qtx\" (UniqueName: \"kubernetes.io/projected/7874b01b-6992-4f6a-8c48-02dad7819ed0-kube-api-access-49qtx\") pod \"authorino-59c974bd48-cqv2f\" (UID: \"7874b01b-6992-4f6a-8c48-02dad7819ed0\") " pod="kuadrant-system/authorino-59c974bd48-cqv2f" Sep 09 23:25:20.372960 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.372938 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m64wn\" (UniqueName: \"kubernetes.io/projected/4f375c28-91cf-40f3-bf84-43aae78e9e8e-kube-api-access-m64wn\") pod \"authorino-7bcfd8f9cd-kgzp9\" (UID: \"4f375c28-91cf-40f3-bf84-43aae78e9e8e\") " pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" Sep 09 23:25:20.445081 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.445060 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" Sep 09 23:25:20.466069 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.466043 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-49qtx\" (UniqueName: \"kubernetes.io/projected/7874b01b-6992-4f6a-8c48-02dad7819ed0-kube-api-access-49qtx\") pod \"authorino-59c974bd48-cqv2f\" (UID: \"7874b01b-6992-4f6a-8c48-02dad7819ed0\") " pod="kuadrant-system/authorino-59c974bd48-cqv2f" Sep 09 23:25:20.475175 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.475147 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-49qtx\" (UniqueName: \"kubernetes.io/projected/7874b01b-6992-4f6a-8c48-02dad7819ed0-kube-api-access-49qtx\") pod \"authorino-59c974bd48-cqv2f\" (UID: \"7874b01b-6992-4f6a-8c48-02dad7819ed0\") " pod="kuadrant-system/authorino-59c974bd48-cqv2f" Sep 09 23:25:20.553643 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.553618 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cqv2f" Sep 09 23:25:20.568579 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.568554 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:20.679083 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.679056 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:20.714568 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.714495 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kgzp9"] Sep 09 23:25:20.717567 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:25:20.717544 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4f375c28_91cf_40f3_bf84_43aae78e9e8e.slice/crio-3b17777ed5e15bea4c9099732bc756c56146edcb5981b23bb3844b46dedf81b3 WatchSource:0}: Error finding container 3b17777ed5e15bea4c9099732bc756c56146edcb5981b23bb3844b46dedf81b3: Status 404 returned error can't find the container with id 3b17777ed5e15bea4c9099732bc756c56146edcb5981b23bb3844b46dedf81b3 Sep 09 23:25:20.821111 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:20.821086 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cqv2f"] Sep 09 23:25:20.823567 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:25:20.823547 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7874b01b_6992_4f6a_8c48_02dad7819ed0.slice/crio-e94338e436993e331cc76cebed1d16d84e5e5f8e03ea56496a371c5a3bc7a718 WatchSource:0}: Error finding container e94338e436993e331cc76cebed1d16d84e5e5f8e03ea56496a371c5a3bc7a718: Status 404 returned error can't find the container with id e94338e436993e331cc76cebed1d16d84e5e5f8e03ea56496a371c5a3bc7a718 Sep 09 23:25:21.606827 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:21.606767 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cqv2f" event={"ID":"7874b01b-6992-4f6a-8c48-02dad7819ed0","Type":"ContainerStarted","Data":"e94338e436993e331cc76cebed1d16d84e5e5f8e03ea56496a371c5a3bc7a718"} Sep 09 23:25:21.608263 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:21.608232 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" event={"ID":"4f375c28-91cf-40f3-bf84-43aae78e9e8e","Type":"ContainerStarted","Data":"3b17777ed5e15bea4c9099732bc756c56146edcb5981b23bb3844b46dedf81b3"} Sep 09 23:25:22.614375 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:22.614341 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cqv2f" event={"ID":"7874b01b-6992-4f6a-8c48-02dad7819ed0","Type":"ContainerStarted","Data":"f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488"} Sep 09 23:25:22.615961 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:22.615933 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" event={"ID":"4f375c28-91cf-40f3-bf84-43aae78e9e8e","Type":"ContainerStarted","Data":"83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6"} Sep 09 23:25:22.629366 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:22.629290 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-59c974bd48-cqv2f" podStartSLOduration=1.063472238 podStartE2EDuration="2.629277651s" totalImagesPullingTime="1.565805413s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:25:22.628260756 +0000 UTC m=+487.656271127" watchObservedRunningTime="2026-09-09 23:25:22.629277651 +0000 UTC m=+487.657288021" Sep 09 23:25:22.642752 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:22.642703 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" podStartSLOduration=0.975076797 podStartE2EDuration="2.642683114s" totalImagesPullingTime="1.667606317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:25:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:25:22.641045288 +0000 UTC m=+487.669055658" watchObservedRunningTime="2026-09-09 23:25:22.642683114 +0000 UTC m=+487.670693485" Sep 09 23:25:22.664309 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:22.664286 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kgzp9"] Sep 09 23:25:24.624669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:24.624616 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" podUID="4f375c28-91cf-40f3-bf84-43aae78e9e8e" containerName="authorino" containerID="cri-o://83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6" gracePeriod=30 Sep 09 23:25:24.865861 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:24.865841 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" Sep 09 23:25:25.007756 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.007728 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m64wn\" (UniqueName: \"kubernetes.io/projected/4f375c28-91cf-40f3-bf84-43aae78e9e8e-kube-api-access-m64wn\") pod \"4f375c28-91cf-40f3-bf84-43aae78e9e8e\" (UID: \"4f375c28-91cf-40f3-bf84-43aae78e9e8e\") " Sep 09 23:25:25.009841 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.009808 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f375c28-91cf-40f3-bf84-43aae78e9e8e-kube-api-access-m64wn" (OuterVolumeSpecName: "kube-api-access-m64wn") pod "4f375c28-91cf-40f3-bf84-43aae78e9e8e" (UID: "4f375c28-91cf-40f3-bf84-43aae78e9e8e"). InnerVolumeSpecName "kube-api-access-m64wn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:25:25.108347 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.108319 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m64wn\" (UniqueName: \"kubernetes.io/projected/4f375c28-91cf-40f3-bf84-43aae78e9e8e-kube-api-access-m64wn\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:25:25.629142 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.629104 2583 generic.go:356] "Generic (PLEG): container finished" podID="4f375c28-91cf-40f3-bf84-43aae78e9e8e" containerID="83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6" exitCode=0 Sep 09 23:25:25.629584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.629153 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" Sep 09 23:25:25.629584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.629149 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" event={"ID":"4f375c28-91cf-40f3-bf84-43aae78e9e8e","Type":"ContainerDied","Data":"83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6"} Sep 09 23:25:25.629584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.629211 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7bcfd8f9cd-kgzp9" event={"ID":"4f375c28-91cf-40f3-bf84-43aae78e9e8e","Type":"ContainerDied","Data":"3b17777ed5e15bea4c9099732bc756c56146edcb5981b23bb3844b46dedf81b3"} Sep 09 23:25:25.629584 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.629236 2583 scope.go:117] "RemoveContainer" containerID="83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6" Sep 09 23:25:25.639079 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.639061 2583 scope.go:117] "RemoveContainer" containerID="83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6" Sep 09 23:25:25.639597 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:25:25.639573 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6\": container with ID starting with 83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6 not found: ID does not exist" containerID="83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6" Sep 09 23:25:25.639686 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.639607 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6"} err="failed to get container status \"83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6\": rpc error: code = NotFound desc = could not find container \"83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6\": container with ID starting with 83574043f3f8b7da98e6fd12d5223207bf7ff57e8f57a421baa022d6087f1bb6 not found: ID does not exist" Sep 09 23:25:25.643937 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.643914 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kgzp9"] Sep 09 23:25:25.645516 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:25.645496 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7bcfd8f9cd-kgzp9"] Sep 09 23:25:27.421050 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:27.421007 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:27.477117 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:27.477084 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:27.531503 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:27.531474 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f375c28-91cf-40f3-bf84-43aae78e9e8e" path="/var/lib/kubelet/pods/4f375c28-91cf-40f3-bf84-43aae78e9e8e/volumes" Sep 09 23:25:33.972211 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:33.972173 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:34.072540 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:34.072495 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:35.430391 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:35.430359 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:35.528855 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:35.528818 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:35.913851 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:35.913819 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:48.476399 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.476361 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:48.690556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.690508 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-557f876f69-9hg2p"] Sep 09 23:25:48.690854 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.690842 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f375c28-91cf-40f3-bf84-43aae78e9e8e" containerName="authorino" Sep 09 23:25:48.690897 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.690856 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f375c28-91cf-40f3-bf84-43aae78e9e8e" containerName="authorino" Sep 09 23:25:48.690934 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.690907 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f375c28-91cf-40f3-bf84-43aae78e9e8e" containerName="authorino" Sep 09 23:25:48.693818 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.693796 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9hg2p" Sep 09 23:25:48.699177 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.699152 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-557f876f69-9hg2p"] Sep 09 23:25:48.801615 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.801531 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:48.831969 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.831942 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-9hg2p"] Sep 09 23:25:48.832162 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:25:48.832144 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-d9lbl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-557f876f69-9hg2p" podUID="b7211a4c-cc5a-4daa-889d-3d88a8f492c9" Sep 09 23:25:48.854174 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.854148 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-dqn79"] Sep 09 23:25:48.857072 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.857057 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:48.859241 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.859221 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Sep 09 23:25:48.863825 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.863802 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-dqn79"] Sep 09 23:25:48.884467 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.884444 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9lbl\" (UniqueName: \"kubernetes.io/projected/b7211a4c-cc5a-4daa-889d-3d88a8f492c9-kube-api-access-d9lbl\") pod \"authorino-557f876f69-9hg2p\" (UID: \"b7211a4c-cc5a-4daa-889d-3d88a8f492c9\") " pod="kuadrant-system/authorino-557f876f69-9hg2p" Sep 09 23:25:48.908120 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.908101 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-dqn79"] Sep 09 23:25:48.908311 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:25:48.908292 2583 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-rt649 tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-6d4dfc649f-dqn79" podUID="a8ce0188-7a99-495d-8e2a-3929125d5330" Sep 09 23:25:48.933894 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.933870 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-54f8d7b44-h5jhh"] Sep 09 23:25:48.936871 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.936855 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:48.943474 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.943455 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f8d7b44-h5jhh"] Sep 09 23:25:48.985648 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.985627 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8ce0188-7a99-495d-8e2a-3929125d5330-tls-cert\") pod \"authorino-6d4dfc649f-dqn79\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:48.985754 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.985694 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9lbl\" (UniqueName: \"kubernetes.io/projected/b7211a4c-cc5a-4daa-889d-3d88a8f492c9-kube-api-access-d9lbl\") pod \"authorino-557f876f69-9hg2p\" (UID: \"b7211a4c-cc5a-4daa-889d-3d88a8f492c9\") " pod="kuadrant-system/authorino-557f876f69-9hg2p" Sep 09 23:25:48.985754 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.985729 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rt649\" (UniqueName: \"kubernetes.io/projected/a8ce0188-7a99-495d-8e2a-3929125d5330-kube-api-access-rt649\") pod \"authorino-6d4dfc649f-dqn79\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:48.992573 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:48.992553 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9lbl\" (UniqueName: \"kubernetes.io/projected/b7211a4c-cc5a-4daa-889d-3d88a8f492c9-kube-api-access-d9lbl\") pod \"authorino-557f876f69-9hg2p\" (UID: \"b7211a4c-cc5a-4daa-889d-3d88a8f492c9\") " pod="kuadrant-system/authorino-557f876f69-9hg2p" Sep 09 23:25:49.086797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.086729 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pndqr\" (UniqueName: \"kubernetes.io/projected/4887b468-7065-4f77-9104-d8006787d79d-kube-api-access-pndqr\") pod \"authorino-54f8d7b44-h5jhh\" (UID: \"4887b468-7065-4f77-9104-d8006787d79d\") " pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:49.086797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.086784 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rt649\" (UniqueName: \"kubernetes.io/projected/a8ce0188-7a99-495d-8e2a-3929125d5330-kube-api-access-rt649\") pod \"authorino-6d4dfc649f-dqn79\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:49.086943 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.086811 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4887b468-7065-4f77-9104-d8006787d79d-tls-cert\") pod \"authorino-54f8d7b44-h5jhh\" (UID: \"4887b468-7065-4f77-9104-d8006787d79d\") " pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:49.086943 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.086838 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8ce0188-7a99-495d-8e2a-3929125d5330-tls-cert\") pod \"authorino-6d4dfc649f-dqn79\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:49.089056 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.089029 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8ce0188-7a99-495d-8e2a-3929125d5330-tls-cert\") pod \"authorino-6d4dfc649f-dqn79\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:49.093839 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.093820 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rt649\" (UniqueName: \"kubernetes.io/projected/a8ce0188-7a99-495d-8e2a-3929125d5330-kube-api-access-rt649\") pod \"authorino-6d4dfc649f-dqn79\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:49.188080 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.188054 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pndqr\" (UniqueName: \"kubernetes.io/projected/4887b468-7065-4f77-9104-d8006787d79d-kube-api-access-pndqr\") pod \"authorino-54f8d7b44-h5jhh\" (UID: \"4887b468-7065-4f77-9104-d8006787d79d\") " pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:49.188189 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.188128 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4887b468-7065-4f77-9104-d8006787d79d-tls-cert\") pod \"authorino-54f8d7b44-h5jhh\" (UID: \"4887b468-7065-4f77-9104-d8006787d79d\") " pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:49.190276 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.190256 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/4887b468-7065-4f77-9104-d8006787d79d-tls-cert\") pod \"authorino-54f8d7b44-h5jhh\" (UID: \"4887b468-7065-4f77-9104-d8006787d79d\") " pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:49.195826 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.195806 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pndqr\" (UniqueName: \"kubernetes.io/projected/4887b468-7065-4f77-9104-d8006787d79d-kube-api-access-pndqr\") pod \"authorino-54f8d7b44-h5jhh\" (UID: \"4887b468-7065-4f77-9104-d8006787d79d\") " pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:49.245434 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.245410 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-54f8d7b44-h5jhh" Sep 09 23:25:49.513270 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.513248 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-54f8d7b44-h5jhh"] Sep 09 23:25:49.515272 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:25:49.515247 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4887b468_7065_4f77_9104_d8006787d79d.slice/crio-ed28a5eb66bf22f4597588624898c82dfd1cf4eb7abcdfd3c69e285de72365ac WatchSource:0}: Error finding container ed28a5eb66bf22f4597588624898c82dfd1cf4eb7abcdfd3c69e285de72365ac: Status 404 returned error can't find the container with id ed28a5eb66bf22f4597588624898c82dfd1cf4eb7abcdfd3c69e285de72365ac Sep 09 23:25:49.737679 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.737650 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:49.737679 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.737677 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9hg2p" Sep 09 23:25:49.737861 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.737641 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8d7b44-h5jhh" event={"ID":"4887b468-7065-4f77-9104-d8006787d79d","Type":"ContainerStarted","Data":"ed28a5eb66bf22f4597588624898c82dfd1cf4eb7abcdfd3c69e285de72365ac"} Sep 09 23:25:49.745966 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.745947 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:49.749281 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.749265 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9hg2p" Sep 09 23:25:49.894011 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.893958 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d9lbl\" (UniqueName: \"kubernetes.io/projected/b7211a4c-cc5a-4daa-889d-3d88a8f492c9-kube-api-access-d9lbl\") pod \"b7211a4c-cc5a-4daa-889d-3d88a8f492c9\" (UID: \"b7211a4c-cc5a-4daa-889d-3d88a8f492c9\") " Sep 09 23:25:49.894011 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.893984 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rt649\" (UniqueName: \"kubernetes.io/projected/a8ce0188-7a99-495d-8e2a-3929125d5330-kube-api-access-rt649\") pod \"a8ce0188-7a99-495d-8e2a-3929125d5330\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " Sep 09 23:25:49.894137 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.894047 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8ce0188-7a99-495d-8e2a-3929125d5330-tls-cert\") pod \"a8ce0188-7a99-495d-8e2a-3929125d5330\" (UID: \"a8ce0188-7a99-495d-8e2a-3929125d5330\") " Sep 09 23:25:49.895932 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.895908 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8ce0188-7a99-495d-8e2a-3929125d5330-kube-api-access-rt649" (OuterVolumeSpecName: "kube-api-access-rt649") pod "a8ce0188-7a99-495d-8e2a-3929125d5330" (UID: "a8ce0188-7a99-495d-8e2a-3929125d5330"). InnerVolumeSpecName "kube-api-access-rt649". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:25:49.896009 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.895927 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8ce0188-7a99-495d-8e2a-3929125d5330-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "a8ce0188-7a99-495d-8e2a-3929125d5330" (UID: "a8ce0188-7a99-495d-8e2a-3929125d5330"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Sep 09 23:25:49.896009 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.895936 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7211a4c-cc5a-4daa-889d-3d88a8f492c9-kube-api-access-d9lbl" (OuterVolumeSpecName: "kube-api-access-d9lbl") pod "b7211a4c-cc5a-4daa-889d-3d88a8f492c9" (UID: "b7211a4c-cc5a-4daa-889d-3d88a8f492c9"). InnerVolumeSpecName "kube-api-access-d9lbl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:25:49.995423 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.995401 2583 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a8ce0188-7a99-495d-8e2a-3929125d5330-tls-cert\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:25:49.995423 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.995422 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d9lbl\" (UniqueName: \"kubernetes.io/projected/b7211a4c-cc5a-4daa-889d-3d88a8f492c9-kube-api-access-d9lbl\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:25:49.995567 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:49.995433 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rt649\" (UniqueName: \"kubernetes.io/projected/a8ce0188-7a99-495d-8e2a-3929125d5330-kube-api-access-rt649\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:25:50.746928 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.744166 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-54f8d7b44-h5jhh" event={"ID":"4887b468-7065-4f77-9104-d8006787d79d","Type":"ContainerStarted","Data":"1c13c95e31a93df06fad5574bdd14a21760b32d266cac04321899313f706da99"} Sep 09 23:25:50.746928 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.744258 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-557f876f69-9hg2p" Sep 09 23:25:50.746928 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.744486 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d4dfc649f-dqn79" Sep 09 23:25:50.765811 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.765771 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-54f8d7b44-h5jhh" podStartSLOduration=2.235818311 podStartE2EDuration="2.765757346s" totalImagesPullingTime="529.939035ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:25:50.764335978 +0000 UTC m=+515.792346351" watchObservedRunningTime="2026-09-09 23:25:50.765757346 +0000 UTC m=+515.793767716" Sep 09 23:25:50.792997 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.792970 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cqv2f"] Sep 09 23:25:50.793221 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.793171 2583 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-59c974bd48-cqv2f" podUID="7874b01b-6992-4f6a-8c48-02dad7819ed0" containerName="authorino" containerID="cri-o://f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488" gracePeriod=30 Sep 09 23:25:50.794542 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.794501 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-dqn79"] Sep 09 23:25:50.801614 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.801588 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d4dfc649f-dqn79"] Sep 09 23:25:50.822207 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.822173 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-557f876f69-9hg2p"] Sep 09 23:25:50.825793 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:50.825770 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-557f876f69-9hg2p"] Sep 09 23:25:51.033071 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.033047 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cqv2f" Sep 09 23:25:51.103104 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.103080 2583 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-49qtx\" (UniqueName: \"kubernetes.io/projected/7874b01b-6992-4f6a-8c48-02dad7819ed0-kube-api-access-49qtx\") pod \"7874b01b-6992-4f6a-8c48-02dad7819ed0\" (UID: \"7874b01b-6992-4f6a-8c48-02dad7819ed0\") " Sep 09 23:25:51.105058 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.105033 2583 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7874b01b-6992-4f6a-8c48-02dad7819ed0-kube-api-access-49qtx" (OuterVolumeSpecName: "kube-api-access-49qtx") pod "7874b01b-6992-4f6a-8c48-02dad7819ed0" (UID: "7874b01b-6992-4f6a-8c48-02dad7819ed0"). InnerVolumeSpecName "kube-api-access-49qtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Sep 09 23:25:51.204442 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.204415 2583 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-49qtx\" (UniqueName: \"kubernetes.io/projected/7874b01b-6992-4f6a-8c48-02dad7819ed0-kube-api-access-49qtx\") on node \"ip-10-0-130-161.ec2.internal\" DevicePath \"\"" Sep 09 23:25:51.528811 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.528781 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8ce0188-7a99-495d-8e2a-3929125d5330" path="/var/lib/kubelet/pods/a8ce0188-7a99-495d-8e2a-3929125d5330/volumes" Sep 09 23:25:51.528999 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.528986 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7211a4c-cc5a-4daa-889d-3d88a8f492c9" path="/var/lib/kubelet/pods/b7211a4c-cc5a-4daa-889d-3d88a8f492c9/volumes" Sep 09 23:25:51.749388 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.749362 2583 generic.go:356] "Generic (PLEG): container finished" podID="7874b01b-6992-4f6a-8c48-02dad7819ed0" containerID="f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488" exitCode=0 Sep 09 23:25:51.749750 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.749412 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-59c974bd48-cqv2f" Sep 09 23:25:51.749750 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.749452 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cqv2f" event={"ID":"7874b01b-6992-4f6a-8c48-02dad7819ed0","Type":"ContainerDied","Data":"f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488"} Sep 09 23:25:51.749750 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.749488 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-59c974bd48-cqv2f" event={"ID":"7874b01b-6992-4f6a-8c48-02dad7819ed0","Type":"ContainerDied","Data":"e94338e436993e331cc76cebed1d16d84e5e5f8e03ea56496a371c5a3bc7a718"} Sep 09 23:25:51.749750 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.749506 2583 scope.go:117] "RemoveContainer" containerID="f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488" Sep 09 23:25:51.757702 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.757684 2583 scope.go:117] "RemoveContainer" containerID="f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488" Sep 09 23:25:51.757970 ip-10-0-130-161 kubenswrapper[2583]: E0909 23:25:51.757952 2583 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488\": container with ID starting with f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488 not found: ID does not exist" containerID="f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488" Sep 09 23:25:51.758015 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.757977 2583 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488"} err="failed to get container status \"f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488\": rpc error: code = NotFound desc = could not find container \"f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488\": container with ID starting with f66f51e87857d45f75f2a27819009d4daf33b234a6ceb0f89e5695e1ad30d488 not found: ID does not exist" Sep 09 23:25:51.768484 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.768464 2583 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cqv2f"] Sep 09 23:25:51.771921 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:51.771903 2583 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-59c974bd48-cqv2f"] Sep 09 23:25:53.529410 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:53.529375 2583 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7874b01b-6992-4f6a-8c48-02dad7819ed0" path="/var/lib/kubelet/pods/7874b01b-6992-4f6a-8c48-02dad7819ed0/volumes" Sep 09 23:25:55.276726 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:55.276688 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:55.348934 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:55.348904 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:55.405659 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:55.405632 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:55.464317 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:55.464290 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:55.656234 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:55.656209 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:58.759209 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:58.759172 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:25:58.871159 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:25:58.871127 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:17.407495 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:17.407451 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:30.450201 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:30.450166 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:30.542434 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:30.542406 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:31.821168 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:31.821134 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:31.924735 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:31.924701 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:31.989040 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:31.989013 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:32.287273 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.287241 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:32.387816 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.387785 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:32.391596 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.391567 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-48stb"] Sep 09 23:26:32.391959 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.391943 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7874b01b-6992-4f6a-8c48-02dad7819ed0" containerName="authorino" Sep 09 23:26:32.392044 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.391961 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="7874b01b-6992-4f6a-8c48-02dad7819ed0" containerName="authorino" Sep 09 23:26:32.392100 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.392045 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="7874b01b-6992-4f6a-8c48-02dad7819ed0" containerName="authorino" Sep 09 23:26:32.396670 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.396649 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.399053 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.399024 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-986vb\"" Sep 09 23:26:32.399176 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.399062 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Sep 09 23:26:32.405158 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.405136 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-48stb"] Sep 09 23:26:32.430517 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.430487 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-w7dqr"] Sep 09 23:26:32.433749 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.433731 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.443873 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.443852 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-w7dqr"] Sep 09 23:26:32.487369 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.487339 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8f263-1aee-44d6-a7c6-e5f1c50e4809-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-w7dqr\" (UID: \"41c8f263-1aee-44d6-a7c6-e5f1c50e4809\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.487465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.487394 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9758e54-befc-43d9-958b-ff09125f8e38-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-48stb\" (UID: \"a9758e54-befc-43d9-958b-ff09125f8e38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.487465 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.487442 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnt6j\" (UniqueName: \"kubernetes.io/projected/a9758e54-befc-43d9-958b-ff09125f8e38-kube-api-access-vnt6j\") pod \"payload-pre-processing-59fbc47bf8-48stb\" (UID: \"a9758e54-befc-43d9-958b-ff09125f8e38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.487570 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.487473 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdnpc\" (UniqueName: \"kubernetes.io/projected/41c8f263-1aee-44d6-a7c6-e5f1c50e4809-kube-api-access-fdnpc\") pod \"payload-processing-5b54b7fbb7-w7dqr\" (UID: \"41c8f263-1aee-44d6-a7c6-e5f1c50e4809\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.588839 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.588761 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8f263-1aee-44d6-a7c6-e5f1c50e4809-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-w7dqr\" (UID: \"41c8f263-1aee-44d6-a7c6-e5f1c50e4809\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.588839 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.588810 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9758e54-befc-43d9-958b-ff09125f8e38-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-48stb\" (UID: \"a9758e54-befc-43d9-958b-ff09125f8e38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.589025 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.588848 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnt6j\" (UniqueName: \"kubernetes.io/projected/a9758e54-befc-43d9-958b-ff09125f8e38-kube-api-access-vnt6j\") pod \"payload-pre-processing-59fbc47bf8-48stb\" (UID: \"a9758e54-befc-43d9-958b-ff09125f8e38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.589025 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.588880 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdnpc\" (UniqueName: \"kubernetes.io/projected/41c8f263-1aee-44d6-a7c6-e5f1c50e4809-kube-api-access-fdnpc\") pod \"payload-processing-5b54b7fbb7-w7dqr\" (UID: \"41c8f263-1aee-44d6-a7c6-e5f1c50e4809\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.589556 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.589517 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/41c8f263-1aee-44d6-a7c6-e5f1c50e4809-plugins-config-volume\") pod \"payload-processing-5b54b7fbb7-w7dqr\" (UID: \"41c8f263-1aee-44d6-a7c6-e5f1c50e4809\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.589663 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.589644 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9758e54-befc-43d9-958b-ff09125f8e38-plugins-config-volume\") pod \"payload-pre-processing-59fbc47bf8-48stb\" (UID: \"a9758e54-befc-43d9-958b-ff09125f8e38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.597993 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.597971 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdnpc\" (UniqueName: \"kubernetes.io/projected/41c8f263-1aee-44d6-a7c6-e5f1c50e4809-kube-api-access-fdnpc\") pod \"payload-processing-5b54b7fbb7-w7dqr\" (UID: \"41c8f263-1aee-44d6-a7c6-e5f1c50e4809\") " pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.598106 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.598033 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnt6j\" (UniqueName: \"kubernetes.io/projected/a9758e54-befc-43d9-958b-ff09125f8e38-kube-api-access-vnt6j\") pod \"payload-pre-processing-59fbc47bf8-48stb\" (UID: \"a9758e54-befc-43d9-958b-ff09125f8e38\") " pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.707470 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.707438 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:32.744754 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.744623 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:32.790352 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.790277 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:32.991986 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:32.991931 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59fbc47bf8-48stb"] Sep 09 23:26:32.994589 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:26:32.994564 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9758e54_befc_43d9_958b_ff09125f8e38.slice/crio-b893bfb94cb285bfdd3b9559012617c06e94945a11c9e615c4f96b58ccc32e79 WatchSource:0}: Error finding container b893bfb94cb285bfdd3b9559012617c06e94945a11c9e615c4f96b58ccc32e79: Status 404 returned error can't find the container with id b893bfb94cb285bfdd3b9559012617c06e94945a11c9e615c4f96b58ccc32e79 Sep 09 23:26:33.032647 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:33.032627 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5b54b7fbb7-w7dqr"] Sep 09 23:26:33.034272 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:26:33.034249 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c8f263_1aee_44d6_a7c6_e5f1c50e4809.slice/crio-90faf1e7c2378967c56030dac8fcbd12293bd9697f79235958a7656edef81ae8 WatchSource:0}: Error finding container 90faf1e7c2378967c56030dac8fcbd12293bd9697f79235958a7656edef81ae8: Status 404 returned error can't find the container with id 90faf1e7c2378967c56030dac8fcbd12293bd9697f79235958a7656edef81ae8 Sep 09 23:26:33.965493 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:33.965454 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" event={"ID":"a9758e54-befc-43d9-958b-ff09125f8e38","Type":"ContainerStarted","Data":"b893bfb94cb285bfdd3b9559012617c06e94945a11c9e615c4f96b58ccc32e79"} Sep 09 23:26:33.967804 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:33.967729 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" event={"ID":"41c8f263-1aee-44d6-a7c6-e5f1c50e4809","Type":"ContainerStarted","Data":"90faf1e7c2378967c56030dac8fcbd12293bd9697f79235958a7656edef81ae8"} Sep 09 23:26:34.974448 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:34.974417 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" event={"ID":"a9758e54-befc-43d9-958b-ff09125f8e38","Type":"ContainerStarted","Data":"755593c6f18125c8ea5fb079408432d9e0d2b7ddef4a6988270b71b9fd893571"} Sep 09 23:26:34.974904 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:34.974542 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:34.976231 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:34.976208 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" event={"ID":"41c8f263-1aee-44d6-a7c6-e5f1c50e4809","Type":"ContainerStarted","Data":"5640cc150e1fdb33c648e800dc160241a43835e3881360b564c0513fdf27c5dd"} Sep 09 23:26:34.976369 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:34.976291 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:34.990797 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:34.990756 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" podStartSLOduration=1.194966672 podStartE2EDuration="2.99074251s" totalImagesPullingTime="1.795775838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:26:34.988987659 +0000 UTC m=+560.016998041" watchObservedRunningTime="2026-09-09 23:26:34.99074251 +0000 UTC m=+560.018752881" Sep 09 23:26:35.003476 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:35.003433 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" podStartSLOduration=1.254155215 podStartE2EDuration="3.003420402s" totalImagesPullingTime="1.749265187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:26:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:26:35.002580991 +0000 UTC m=+560.030591363" watchObservedRunningTime="2026-09-09 23:26:35.003420402 +0000 UTC m=+560.031430772" Sep 09 23:26:43.377076 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:43.377039 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:44.745195 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:44.745159 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:45.982540 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:45.982497 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5b54b7fbb7-w7dqr" Sep 09 23:26:45.983025 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:45.982679 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59fbc47bf8-48stb" Sep 09 23:26:49.632488 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:49.632451 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:26:57.317878 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:26:57.317847 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:05.711599 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:05.711567 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:09.696978 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:09.696942 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:09.750414 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:09.750388 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:12.233437 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:12.233390 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:18.897454 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.897414 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl"] Sep 09 23:27:18.900837 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.900808 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:18.904480 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.904452 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Sep 09 23:27:18.904480 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.904471 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pq5fv\"" Sep 09 23:27:18.904711 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.904453 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Sep 09 23:27:18.904711 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.904504 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Sep 09 23:27:18.909193 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.909003 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl"] Sep 09 23:27:18.933851 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:18.933825 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:19.029045 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.029016 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.029158 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.029061 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.029158 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.029106 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90da4d48-f56b-4274-9faf-3c6b96afdddd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.029158 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.029148 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.029330 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.029220 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbc8g\" (UniqueName: \"kubernetes.io/projected/90da4d48-f56b-4274-9faf-3c6b96afdddd-kube-api-access-xbc8g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.029330 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.029273 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.129792 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.129760 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.129922 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.129800 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90da4d48-f56b-4274-9faf-3c6b96afdddd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.129922 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.129840 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.129922 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.129878 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbc8g\" (UniqueName: \"kubernetes.io/projected/90da4d48-f56b-4274-9faf-3c6b96afdddd-kube-api-access-xbc8g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.129922 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.129917 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.130179 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.129967 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.130405 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.130343 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.130656 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.130631 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.130835 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.130677 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.135635 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.134037 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/90da4d48-f56b-4274-9faf-3c6b96afdddd-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.136258 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.136236 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/90da4d48-f56b-4274-9faf-3c6b96afdddd-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.139271 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.139250 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbc8g\" (UniqueName: \"kubernetes.io/projected/90da4d48-f56b-4274-9faf-3c6b96afdddd-kube-api-access-xbc8g\") pod \"e2e-trlp-test-simulated-kserve-598466548d-6rmhl\" (UID: \"90da4d48-f56b-4274-9faf-3c6b96afdddd\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.213374 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.213356 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:19.481704 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:19.481675 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl"] Sep 09 23:27:19.483564 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:27:19.483537 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90da4d48_f56b_4274_9faf_3c6b96afdddd.slice/crio-8f64468a5c462b77dacd1b0a121b1f73584f61c6313c626361533ba1de10a775 WatchSource:0}: Error finding container 8f64468a5c462b77dacd1b0a121b1f73584f61c6313c626361533ba1de10a775: Status 404 returned error can't find the container with id 8f64468a5c462b77dacd1b0a121b1f73584f61c6313c626361533ba1de10a775 Sep 09 23:27:20.212091 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:20.212049 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" event={"ID":"90da4d48-f56b-4274-9faf-3c6b96afdddd","Type":"ContainerStarted","Data":"8f64468a5c462b77dacd1b0a121b1f73584f61c6313c626361533ba1de10a775"} Sep 09 23:27:21.218693 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:21.218645 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" event={"ID":"90da4d48-f56b-4274-9faf-3c6b96afdddd","Type":"ContainerStarted","Data":"cafeb12c6da04c972d86dc734cf4833e2e871fb21e1c875a8d7b4eff3367fe6d"} Sep 09 23:27:21.236536 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:21.236487 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" podStartSLOduration=2.264582207 podStartE2EDuration="3.236471968s" totalImagesPullingTime="971.889761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:27:21.235257497 +0000 UTC m=+606.263267868" watchObservedRunningTime="2026-09-09 23:27:21.236471968 +0000 UTC m=+606.264482339" Sep 09 23:27:24.118911 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:24.118882 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:29.213651 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:29.213611 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:29.214098 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:29.213676 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:29.226537 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:29.226495 2583 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:29.264682 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:29.264661 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-6rmhl" Sep 09 23:27:36.139395 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:36.139360 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:27:44.528258 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:27:44.528186 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:28:04.757857 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:28:04.757822 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:28:18.448866 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:28:18.448827 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:28:53.143006 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:28:53.142974 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:28:53.244212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:28:53.244184 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:30:00.152726 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.152691 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck"] Sep 09 23:30:00.156015 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.155999 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck" Sep 09 23:30:00.159389 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.159370 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-plzfj\"" Sep 09 23:30:00.165490 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.165474 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck" Sep 09 23:30:00.176903 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.176879 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck"] Sep 09 23:30:00.433647 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.433584 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck"] Sep 09 23:30:00.436327 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:30:00.436295 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf228791a_f2e7_46e3_ae20_d1caead0c387.slice/crio-1d24fe5db883d2a3283539d64d271ddf7a521cea88387e6528f0dcef67ee7ca3 WatchSource:0}: Error finding container 1d24fe5db883d2a3283539d64d271ddf7a521cea88387e6528f0dcef67ee7ca3: Status 404 returned error can't find the container with id 1d24fe5db883d2a3283539d64d271ddf7a521cea88387e6528f0dcef67ee7ca3 Sep 09 23:30:00.438536 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.438502 2583 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Sep 09 23:30:00.945669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:00.945637 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck" event={"ID":"f228791a-f2e7-46e3-ae20-d1caead0c387","Type":"ContainerStarted","Data":"1d24fe5db883d2a3283539d64d271ddf7a521cea88387e6528f0dcef67ee7ca3"} Sep 09 23:30:03.967011 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:03.966978 2583 generic.go:356] "Generic (PLEG): container finished" podID="f228791a-f2e7-46e3-ae20-d1caead0c387" containerID="eb2ff0cdbfbd16113e904c0231a26c86170db03283b0dbb36ac3c635ce0faf3e" exitCode=0 Sep 09 23:30:03.967334 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:03.967062 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck" event={"ID":"f228791a-f2e7-46e3-ae20-d1caead0c387","Type":"ContainerDied","Data":"eb2ff0cdbfbd16113e904c0231a26c86170db03283b0dbb36ac3c635ce0faf3e"} Sep 09 23:30:05.095711 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:05.095688 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck" Sep 09 23:30:05.980112 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:05.980081 2583 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck" Sep 09 23:30:05.980272 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:05.980078 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29816610-s95ck" event={"ID":"f228791a-f2e7-46e3-ae20-d1caead0c387","Type":"ContainerDied","Data":"1d24fe5db883d2a3283539d64d271ddf7a521cea88387e6528f0dcef67ee7ca3"} Sep 09 23:30:05.980272 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:30:05.980217 2583 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1d24fe5db883d2a3283539d64d271ddf7a521cea88387e6528f0dcef67ee7ca3" Sep 09 23:31:12.207463 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:12.207420 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:31:12.267735 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:12.267709 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:31:47.662015 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:47.661980 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f8d7b44-h5jhh_4887b468-7065-4f77-9104-d8006787d79d/authorino/0.log" Sep 09 23:31:53.543993 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:53.543964 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c5c8967d-xknms_514990db-f69a-4791-aefc-92c3dbd66c5d/manager/0.log" Sep 09 23:31:53.549459 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:53.549437 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c5c8967d-xknms_514990db-f69a-4791-aefc-92c3dbd66c5d/copy-manifests/0.log" Sep 09 23:31:53.964298 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:53.964268 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29816610-s95ck_f228791a-f2e7-46e3-ae20-d1caead0c387/cleanup/0.log" Sep 09 23:31:54.814538 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:54.814486 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f8d7b44-h5jhh_4887b468-7065-4f77-9104-d8006787d79d/authorino/0.log" Sep 09 23:31:54.923515 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:54.923488 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hj8tl_3db4c5d8-38df-4d3c-822f-879079d18c92/manager/0.log" Sep 09 23:31:55.029238 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:55.029204 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-6gflh_f366c939-e211-4c9b-87cf-b30dbab1da73/manager/0.log" Sep 09 23:31:55.134979 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:55.134913 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-jzz86_ad44cb4c-2373-49f7-990c-2fdfd8eeb740/kuadrant-console-plugin/0.log" Sep 09 23:31:56.129837 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:56.129806 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd8cf678b-jvqqb_f8e9dffc-f652-4567-b2e0-e4de914de268/kube-auth-proxy/0.log" Sep 09 23:31:56.341902 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:56.341859 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-48stb_a9758e54-befc-43d9-958b-ff09125f8e38/payload-pre-processing/0.log" Sep 09 23:31:56.448226 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:56.448190 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w7dqr_41c8f263-1aee-44d6-a7c6-e5f1c50e4809/payload-processing/0.log" Sep 09 23:31:57.197987 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:31:57.197955 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-6rmhl_90da4d48-f56b-4274-9faf-3c6b96afdddd/main/0.log" Sep 09 23:32:02.890157 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.890126 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pwd2c/must-gather-7m9wm"] Sep 09 23:32:02.890582 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.890456 2583 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f228791a-f2e7-46e3-ae20-d1caead0c387" containerName="cleanup" Sep 09 23:32:02.890582 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.890467 2583 state_mem.go:107] "Deleted CPUSet assignment" podUID="f228791a-f2e7-46e3-ae20-d1caead0c387" containerName="cleanup" Sep 09 23:32:02.890582 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.890538 2583 memory_manager.go:368] "RemoveStaleState removing state" podUID="f228791a-f2e7-46e3-ae20-d1caead0c387" containerName="cleanup" Sep 09 23:32:02.893780 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.893759 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:02.896479 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.896459 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pwd2c\"/\"kube-root-ca.crt\"" Sep 09 23:32:02.896621 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.896503 2583 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-pwd2c\"/\"openshift-service-ca.crt\"" Sep 09 23:32:02.897586 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.897564 2583 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-pwd2c\"/\"default-dockercfg-nkb97\"" Sep 09 23:32:02.901032 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.901010 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwd2c/must-gather-7m9wm"] Sep 09 23:32:02.906905 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.906880 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:32:02.994212 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.994190 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kljm7\" (UniqueName: \"kubernetes.io/projected/2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3-kube-api-access-kljm7\") pod \"must-gather-7m9wm\" (UID: \"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3\") " pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:02.994301 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:02.994242 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3-must-gather-output\") pod \"must-gather-7m9wm\" (UID: \"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3\") " pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:03.094967 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:03.094940 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kljm7\" (UniqueName: \"kubernetes.io/projected/2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3-kube-api-access-kljm7\") pod \"must-gather-7m9wm\" (UID: \"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3\") " pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:03.095057 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:03.094985 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3-must-gather-output\") pod \"must-gather-7m9wm\" (UID: \"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3\") " pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:03.095249 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:03.095235 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3-must-gather-output\") pod \"must-gather-7m9wm\" (UID: \"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3\") " pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:03.102980 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:03.102951 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kljm7\" (UniqueName: \"kubernetes.io/projected/2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3-kube-api-access-kljm7\") pod \"must-gather-7m9wm\" (UID: \"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3\") " pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:03.226669 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:03.226645 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwd2c/must-gather-7m9wm" Sep 09 23:32:03.494290 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:03.494265 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwd2c/must-gather-7m9wm"] Sep 09 23:32:03.496029 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:32:03.496006 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2243d5e6_c87b_4f2d_80f5_4976ff0ee3d3.slice/crio-ba438b43ca6a289ea6393041541e16834ef7081ff45475d1cf7506ba92aa4dd9 WatchSource:0}: Error finding container ba438b43ca6a289ea6393041541e16834ef7081ff45475d1cf7506ba92aa4dd9: Status 404 returned error can't find the container with id ba438b43ca6a289ea6393041541e16834ef7081ff45475d1cf7506ba92aa4dd9 Sep 09 23:32:03.530942 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:03.530910 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwd2c/must-gather-7m9wm" event={"ID":"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3","Type":"ContainerStarted","Data":"ba438b43ca6a289ea6393041541e16834ef7081ff45475d1cf7506ba92aa4dd9"} Sep 09 23:32:04.347813 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:04.347783 2583 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" limit=1024 Sep 09 23:32:04.539365 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:04.539331 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwd2c/must-gather-7m9wm" event={"ID":"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3","Type":"ContainerStarted","Data":"a65b7aa57d224e5b02014a2bb71a4325efcd6c6b9ca184786a91b64cb7b5ab52"} Sep 09 23:32:05.546424 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:05.546393 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwd2c/must-gather-7m9wm" event={"ID":"2243d5e6-c87b-4f2d-80f5-4976ff0ee3d3","Type":"ContainerStarted","Data":"db5a22da4042b40f161b8def256b12d2fbd6f51b74a238a1fdff6f77c482e161"} Sep 09 23:32:05.561753 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:05.561706 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pwd2c/must-gather-7m9wm" podStartSLOduration=2.698112858 podStartE2EDuration="3.561690024s" totalImagesPullingTime="863.577166ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-09-09 23:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:32:05.560288956 +0000 UTC m=+890.588299339" watchObservedRunningTime="2026-09-09 23:32:05.561690024 +0000 UTC m=+890.589700393" Sep 09 23:32:05.843915 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:05.843840 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-xhn5n_f2fcef21-91e1-4349-bba6-6388e3afdf03/global-pull-secret-syncer/0.log" Sep 09 23:32:05.925716 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:05.925690 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-2t29c_7a25f2eb-7fd8-4e1d-b57b-beef85fe265f/konnectivity-agent/0.log" Sep 09 23:32:05.996053 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:05.996025 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-161.ec2.internal_3cdd65af97b5510fd0cbdb7cae07a57d/haproxy/0.log" Sep 09 23:32:10.566991 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:10.566909 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-54f8d7b44-h5jhh_4887b468-7065-4f77-9104-d8006787d79d/authorino/0.log" Sep 09 23:32:10.603350 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:10.603315 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-76b478bd78-hj8tl_3db4c5d8-38df-4d3c-822f-879079d18c92/manager/0.log" Sep 09 23:32:10.633121 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:10.633086 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-7b84cd7c9c-6gflh_f366c939-e211-4c9b-87cf-b30dbab1da73/manager/0.log" Sep 09 23:32:10.661405 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:10.661373 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-fbdd4f445-jzz86_ad44cb4c-2373-49f7-990c-2fdfd8eeb740/kuadrant-console-plugin/0.log" Sep 09 23:32:12.401429 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.401382 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-vtxkk_0c8b9e6b-5b44-40f5-868e-532e59e1240b/kube-state-metrics/0.log" Sep 09 23:32:12.418502 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.418468 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-vtxkk_0c8b9e6b-5b44-40f5-868e-532e59e1240b/kube-rbac-proxy-main/0.log" Sep 09 23:32:12.436665 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.436635 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-74cb57df7-vtxkk_0c8b9e6b-5b44-40f5-868e-532e59e1240b/kube-rbac-proxy-self/0.log" Sep 09 23:32:12.487600 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.487473 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-85bbbbbf4-zpzgf_a6dfc81b-2cd1-4c8b-9f3f-177f7677b77f/monitoring-plugin/0.log" Sep 09 23:32:12.682741 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.682707 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nr2wm_b6c06c5e-8bf7-498a-b783-c236723f7ea9/node-exporter/0.log" Sep 09 23:32:12.703832 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.703797 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nr2wm_b6c06c5e-8bf7-498a-b783-c236723f7ea9/kube-rbac-proxy/0.log" Sep 09 23:32:12.732385 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.732241 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-nr2wm_b6c06c5e-8bf7-498a-b783-c236723f7ea9/init-textfile/0.log" Sep 09 23:32:12.761233 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.761149 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vnvwx_e442bba4-d5d7-49e1-a5ce-cf51f6666fa3/kube-rbac-proxy-main/0.log" Sep 09 23:32:12.783777 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.783748 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vnvwx_e442bba4-d5d7-49e1-a5ce-cf51f6666fa3/kube-rbac-proxy-self/0.log" Sep 09 23:32:12.812586 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.812553 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-657fd6c54-vnvwx_e442bba4-d5d7-49e1-a5ce-cf51f6666fa3/openshift-state-metrics/0.log" Sep 09 23:32:12.856629 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.856594 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22f8a672-e1c3-4f81-997f-ccf7f97b3be9/prometheus/0.log" Sep 09 23:32:12.880403 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.880370 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22f8a672-e1c3-4f81-997f-ccf7f97b3be9/config-reloader/0.log" Sep 09 23:32:12.908648 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.907837 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22f8a672-e1c3-4f81-997f-ccf7f97b3be9/thanos-sidecar/0.log" Sep 09 23:32:12.935997 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.931982 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22f8a672-e1c3-4f81-997f-ccf7f97b3be9/kube-rbac-proxy-web/0.log" Sep 09 23:32:12.966049 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.965957 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22f8a672-e1c3-4f81-997f-ccf7f97b3be9/kube-rbac-proxy/0.log" Sep 09 23:32:12.996274 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:12.996241 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22f8a672-e1c3-4f81-997f-ccf7f97b3be9/kube-rbac-proxy-thanos/0.log" Sep 09 23:32:13.022763 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:13.022661 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_22f8a672-e1c3-4f81-997f-ccf7f97b3be9/init-config-reloader/0.log" Sep 09 23:32:13.194013 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:13.193978 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856999bfd7-cjfst_9b264fcc-5f78-455e-9fbe-eeb09cd1eca1/thanos-query/0.log" Sep 09 23:32:13.215784 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:13.215756 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856999bfd7-cjfst_9b264fcc-5f78-455e-9fbe-eeb09cd1eca1/kube-rbac-proxy-web/0.log" Sep 09 23:32:13.234613 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:13.234583 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856999bfd7-cjfst_9b264fcc-5f78-455e-9fbe-eeb09cd1eca1/kube-rbac-proxy/0.log" Sep 09 23:32:13.255716 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:13.255674 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856999bfd7-cjfst_9b264fcc-5f78-455e-9fbe-eeb09cd1eca1/prom-label-proxy/0.log" Sep 09 23:32:13.276170 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:13.276105 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856999bfd7-cjfst_9b264fcc-5f78-455e-9fbe-eeb09cd1eca1/kube-rbac-proxy-rules/0.log" Sep 09 23:32:13.295258 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:13.295221 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-856999bfd7-cjfst_9b264fcc-5f78-455e-9fbe-eeb09cd1eca1/kube-rbac-proxy-metrics/0.log" Sep 09 23:32:16.270106 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.270072 2583 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx"] Sep 09 23:32:16.274123 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.274094 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.280625 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.280600 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx"] Sep 09 23:32:16.327937 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.327897 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-sys\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.328180 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.328161 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-podres\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.328313 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.328300 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-proc\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.328431 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.328417 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-lib-modules\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.328539 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.328509 2583 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k2lh7\" (UniqueName: \"kubernetes.io/projected/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-kube-api-access-k2lh7\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.430003 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.429968 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-sys\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.430258 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430224 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-sys\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.430367 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430349 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-podres\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.430538 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430434 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-podres\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.430637 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430515 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-proc\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.430759 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430745 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-lib-modules\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.430978 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430964 2583 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k2lh7\" (UniqueName: \"kubernetes.io/projected/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-kube-api-access-k2lh7\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.431191 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430926 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-lib-modules\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.431272 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.430652 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-proc\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.439027 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.439003 2583 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k2lh7\" (UniqueName: \"kubernetes.io/projected/ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73-kube-api-access-k2lh7\") pod \"perf-node-gather-daemonset-g5vxx\" (UID: \"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73\") " pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.591072 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.590990 2583 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:16.878511 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:16.878418 2583 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx"] Sep 09 23:32:16.885537 ip-10-0-130-161 kubenswrapper[2583]: W0909 23:32:16.885479 2583 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podecb931b4_fd79_4ff5_ade6_6eeeeb20ed73.slice/crio-1ccd89d46bc8a3e12327b1209f3d00a5b19fa597508a21751c7bbf38e4086e61 WatchSource:0}: Error finding container 1ccd89d46bc8a3e12327b1209f3d00a5b19fa597508a21751c7bbf38e4086e61: Status 404 returned error can't find the container with id 1ccd89d46bc8a3e12327b1209f3d00a5b19fa597508a21751c7bbf38e4086e61 Sep 09 23:32:17.645996 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:17.645954 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" event={"ID":"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73","Type":"ContainerStarted","Data":"bb554e47201d2ce7eb736349c41ed02311715160f0f61ed13807567ac21cbd86"} Sep 09 23:32:17.646554 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:17.646027 2583 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" event={"ID":"ecb931b4-fd79-4ff5-ade6-6eeeeb20ed73","Type":"ContainerStarted","Data":"1ccd89d46bc8a3e12327b1209f3d00a5b19fa597508a21751c7bbf38e4086e61"} Sep 09 23:32:17.646554 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:17.646250 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:17.660710 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:17.660652 2583 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" podStartSLOduration=1.6606337679999998 podStartE2EDuration="1.660633768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-09-09 23:32:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-09-09 23:32:17.660420047 +0000 UTC m=+902.688430418" watchObservedRunningTime="2026-09-09 23:32:17.660633768 +0000 UTC m=+902.688644137" Sep 09 23:32:17.822002 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:17.821971 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7s27k_b5e139a1-a104-4c18-810e-5247b3ba69b1/dns/0.log" Sep 09 23:32:17.850485 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:17.850453 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7s27k_b5e139a1-a104-4c18-810e-5247b3ba69b1/kube-rbac-proxy/0.log" Sep 09 23:32:17.961539 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:17.961503 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mp9pb_6d959b05-e8b6-410a-ab1f-003d5e42b7db/dns-node-resolver/0.log" Sep 09 23:32:18.517479 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:18.517423 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-srrdw_5a95fd43-ec7f-4f2f-bea8-a47f1af97c1d/node-ca/0.log" Sep 09 23:32:19.503836 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:19.503805 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd8cf678b-jvqqb_f8e9dffc-f652-4567-b2e0-e4de914de268/kube-auth-proxy/0.log" Sep 09 23:32:19.546733 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:19.546700 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-48stb_a9758e54-befc-43d9-958b-ff09125f8e38/payload-pre-processing/0.log" Sep 09 23:32:19.567400 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:19.567371 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w7dqr_41c8f263-1aee-44d6-a7c6-e5f1c50e4809/payload-processing/0.log" Sep 09 23:32:20.200771 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:20.200734 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dwmrc_b6225d32-9afa-481d-833a-546c7e8048b2/serve-healthcheck-canary/0.log" Sep 09 23:32:20.692039 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:20.692006 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fg6v7_fc3c03a8-0af9-46b5-b922-f93d46f1adaf/kube-rbac-proxy/0.log" Sep 09 23:32:20.711813 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:20.711785 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fg6v7_fc3c03a8-0af9-46b5-b922-f93d46f1adaf/exporter/0.log" Sep 09 23:32:20.734363 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:20.734331 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-fg6v7_fc3c03a8-0af9-46b5-b922-f93d46f1adaf/extractor/0.log" Sep 09 23:32:23.275165 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:23.275132 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c5c8967d-xknms_514990db-f69a-4791-aefc-92c3dbd66c5d/manager/0.log" Sep 09 23:32:23.292130 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:23.292100 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-8c5c8967d-xknms_514990db-f69a-4791-aefc-92c3dbd66c5d/copy-manifests/0.log" Sep 09 23:32:23.662387 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:23.662357 2583 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-pwd2c/perf-node-gather-daemonset-g5vxx" Sep 09 23:32:24.384542 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:24.384492 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-67998c845-9x6g6_cc39e1a9-d08e-4a52-b1a3-da58f1b080e8/manager/0.log" Sep 09 23:32:26.157054 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:26.157016 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd8cf678b-jvqqb_f8e9dffc-f652-4567-b2e0-e4de914de268/kube-auth-proxy/0.log" Sep 09 23:32:26.198442 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:26.198414 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-48stb_a9758e54-befc-43d9-958b-ff09125f8e38/payload-pre-processing/0.log" Sep 09 23:32:26.221458 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:26.215248 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w7dqr_41c8f263-1aee-44d6-a7c6-e5f1c50e4809/payload-processing/0.log" Sep 09 23:32:27.323092 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:27.323055 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bd8cf678b-jvqqb_f8e9dffc-f652-4567-b2e0-e4de914de268/kube-auth-proxy/0.log" Sep 09 23:32:27.359059 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:27.359029 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59fbc47bf8-48stb_a9758e54-befc-43d9-958b-ff09125f8e38/payload-pre-processing/0.log" Sep 09 23:32:27.372365 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:27.372330 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5b54b7fbb7-w7dqr_41c8f263-1aee-44d6-a7c6-e5f1c50e4809/payload-processing/0.log" Sep 09 23:32:31.082319 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.082293 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pmhp_511989b6-e9ae-4dcb-ad5e-c1e9aa6de097/kube-multus-additional-cni-plugins/0.log" Sep 09 23:32:31.100154 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.100127 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pmhp_511989b6-e9ae-4dcb-ad5e-c1e9aa6de097/egress-router-binary-copy/0.log" Sep 09 23:32:31.117652 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.117629 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pmhp_511989b6-e9ae-4dcb-ad5e-c1e9aa6de097/cni-plugins/0.log" Sep 09 23:32:31.137742 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.137720 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pmhp_511989b6-e9ae-4dcb-ad5e-c1e9aa6de097/bond-cni-plugin/0.log" Sep 09 23:32:31.157085 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.157069 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pmhp_511989b6-e9ae-4dcb-ad5e-c1e9aa6de097/routeoverride-cni/0.log" Sep 09 23:32:31.176199 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.176176 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pmhp_511989b6-e9ae-4dcb-ad5e-c1e9aa6de097/whereabouts-cni-bincopy/0.log" Sep 09 23:32:31.195484 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.195468 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-7pmhp_511989b6-e9ae-4dcb-ad5e-c1e9aa6de097/whereabouts-cni/0.log" Sep 09 23:32:31.372531 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.372449 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hq8vc_d83c89fc-0232-4959-be96-d944ea5c8cb8/kube-multus/0.log" Sep 09 23:32:31.527190 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.527135 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4v8j_ecde3b41-da5a-42e3-a3b2-bf422e8e3ace/network-metrics-daemon/0.log" Sep 09 23:32:31.544589 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:31.544558 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-w4v8j_ecde3b41-da5a-42e3-a3b2-bf422e8e3ace/kube-rbac-proxy/0.log" Sep 09 23:32:32.666970 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.666940 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/ovn-controller/0.log" Sep 09 23:32:32.681597 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.681575 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/ovn-acl-logging/0.log" Sep 09 23:32:32.704445 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.704416 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/kube-rbac-proxy-node/0.log" Sep 09 23:32:32.722462 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.722434 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/kube-rbac-proxy-ovn-metrics/0.log" Sep 09 23:32:32.740182 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.740159 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/northd/0.log" Sep 09 23:32:32.757914 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.757892 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/nbdb/0.log" Sep 09 23:32:32.775500 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.775478 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/sbdb/0.log" Sep 09 23:32:32.825416 ip-10-0-130-161 kubenswrapper[2583]: I0909 23:32:32.825394 2583 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-ps2zl_a4dcbb85-1ce8-4b0c-9116-e24b3b26f1a9/ovnkube-controller/0.log"