Jun 12 18:28:21.055958 ip-10-0-128-4 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 12 18:28:21.055972 ip-10-0-128-4 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 12 18:28:21.055982 ip-10-0-128-4 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 12 18:28:21.056292 ip-10-0-128-4 systemd[1]: Failed to start Kubernetes Kubelet. Jun 12 18:28:31.002353 ip-10-0-128-4 systemd[1]: kubelet.service: Failed to schedule restart job: Unit openvswitch.service not found. Jun 12 18:28:31.002367 ip-10-0-128-4 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot c2aeb785acf54354af0a5e49229f77b2 -- Jun 12 18:30:52.684754 ip-10-0-128-4 systemd[1]: Starting Kubernetes Kubelet... Jun 12 18:30:53.094036 ip-10-0-128-4 kubenswrapper[2561]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:30:53.094036 ip-10-0-128-4 kubenswrapper[2561]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 18:30:53.094036 ip-10-0-128-4 kubenswrapper[2561]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:30:53.094036 ip-10-0-128-4 kubenswrapper[2561]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 18:30:53.094036 ip-10-0-128-4 kubenswrapper[2561]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:30:53.095584 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.095499 2561 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 18:30:53.100755 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100740 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:53.100755 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100755 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100759 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100762 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100766 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100769 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100772 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100775 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100778 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100781 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100784 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100787 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100789 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100792 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100795 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100800 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100803 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100807 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100810 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100813 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:53.100819 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100816 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100819 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100821 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100824 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100828 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100830 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100833 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100836 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100839 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100841 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100844 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100846 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100849 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100851 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100854 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100856 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100885 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100890 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100893 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100896 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:53.101265 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100899 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100902 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100905 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100908 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100911 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100913 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100916 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100918 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100921 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100924 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100927 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100930 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100933 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100935 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100938 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100941 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100943 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100946 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100949 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100951 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:53.101776 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100954 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100957 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100959 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100962 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100964 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100967 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100969 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100972 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100975 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100977 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100980 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100982 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100986 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100989 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100992 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100994 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.100997 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101000 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101002 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:53.102258 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101005 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101007 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101010 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101014 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101016 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101019 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101022 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101025 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101029 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101033 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101036 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101038 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101041 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101043 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101045 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101048 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101050 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101053 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101055 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.101058 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:53.102731 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102406 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102414 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102417 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102420 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102423 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102427 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102429 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102432 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102435 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102437 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102441 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102443 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102446 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102448 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102451 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102454 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102457 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102460 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102463 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102466 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:53.103213 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102468 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102485 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102489 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102493 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102497 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102500 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102503 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102505 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102508 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102511 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102514 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102516 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102520 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102524 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102529 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102531 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102534 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102536 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102539 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:53.103752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102541 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102544 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102547 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102568 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102572 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102575 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102578 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102581 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102584 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102586 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102589 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102592 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102595 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102600 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102603 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102607 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102610 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102613 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102615 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102618 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:53.104205 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102621 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102625 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102627 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102630 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102634 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102637 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102640 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102643 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102646 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102649 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102651 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102654 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102656 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102660 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102662 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102665 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102668 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102670 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102672 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:53.104743 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102675 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102677 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102680 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102683 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102685 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102688 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102690 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102693 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102695 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102698 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102700 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102703 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102705 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102708 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102710 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102713 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102715 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102718 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102721 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102723 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:53.105208 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.102726 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103076 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103083 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103087 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103091 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103093 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103097 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103099 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103102 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103105 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103108 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103111 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103113 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103116 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103119 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103121 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103125 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103128 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103131 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:53.105723 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103134 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103137 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103140 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103143 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103145 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103148 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103151 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103154 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103157 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103159 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103162 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103164 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103167 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103169 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103172 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103174 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103177 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103179 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103182 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:53.106192 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103184 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103187 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103189 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103192 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103195 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103199 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103201 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103204 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103206 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103209 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103211 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103215 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103217 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103220 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103223 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103225 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103228 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103230 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103233 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:53.106667 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103235 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103238 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103240 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103243 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103245 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103248 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103251 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103253 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103256 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103258 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103261 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103263 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103266 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103268 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103271 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103274 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103276 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103279 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103282 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103285 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:53.107121 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103287 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103290 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103292 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103295 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103297 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103300 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103302 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103305 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103307 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103310 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103313 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103317 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103320 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103323 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103326 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103328 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103331 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103334 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103336 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103339 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:53.107611 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103341 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103344 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.103347 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103414 2561 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103421 2561 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103427 2561 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103431 2561 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103435 2561 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103438 2561 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103442 2561 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103448 2561 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103452 2561 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103455 2561 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103459 2561 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103462 2561 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103465 2561 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103468 2561 flags.go:64] FLAG: --cgroup-root="" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103483 2561 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103487 2561 flags.go:64] FLAG: --client-ca-file="" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103490 2561 flags.go:64] FLAG: --cloud-provider="external" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103493 2561 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103497 2561 flags.go:64] FLAG: --cluster-domain="" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103500 2561 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 18:30:53.108086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103503 2561 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103506 2561 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103510 2561 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103514 2561 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103517 2561 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103520 2561 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103523 2561 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103526 2561 flags.go:64] FLAG: --contention-profiling="false" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103529 2561 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103532 2561 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103535 2561 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103538 2561 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103541 2561 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103544 2561 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103547 2561 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103550 2561 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103553 2561 flags.go:64] FLAG: --enable-server="true" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103556 2561 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103560 2561 flags.go:64] FLAG: --event-burst="100" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103565 2561 flags.go:64] FLAG: --event-qps="50" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103567 2561 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103571 2561 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103574 2561 flags.go:64] FLAG: --eviction-hard="" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103578 2561 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 18:30:53.108692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103581 2561 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103584 2561 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103586 2561 flags.go:64] FLAG: --eviction-soft="" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103589 2561 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103592 2561 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103595 2561 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103601 2561 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103604 2561 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103607 2561 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103609 2561 flags.go:64] FLAG: --feature-gates="" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103613 2561 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103616 2561 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103619 2561 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103622 2561 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103626 2561 flags.go:64] FLAG: --healthz-port="10248" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103629 2561 flags.go:64] FLAG: --help="false" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103632 2561 flags.go:64] FLAG: --hostname-override="ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103635 2561 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103637 2561 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103640 2561 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103644 2561 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103647 2561 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103650 2561 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 18:30:53.109265 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103653 2561 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103655 2561 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103658 2561 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103661 2561 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103666 2561 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103669 2561 flags.go:64] FLAG: --kube-reserved="" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103672 2561 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103675 2561 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103678 2561 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103681 2561 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103684 2561 flags.go:64] FLAG: --lock-file="" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103687 2561 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103690 2561 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103693 2561 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103698 2561 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103702 2561 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103705 2561 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103707 2561 flags.go:64] FLAG: --logging-format="text" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103711 2561 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103714 2561 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103717 2561 flags.go:64] FLAG: --manifest-url="" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103720 2561 flags.go:64] FLAG: --manifest-url-header="" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103724 2561 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103727 2561 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103731 2561 flags.go:64] FLAG: --max-pods="110" Jun 12 18:30:53.109854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103734 2561 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103737 2561 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103740 2561 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103743 2561 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103746 2561 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103749 2561 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103752 2561 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103759 2561 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103762 2561 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103765 2561 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103768 2561 flags.go:64] FLAG: --pod-cidr="" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103776 2561 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103782 2561 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103785 2561 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103788 2561 flags.go:64] FLAG: --pods-per-core="0" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103792 2561 flags.go:64] FLAG: --port="10250" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103795 2561 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103798 2561 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-000b48526f5fedf84" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103801 2561 flags.go:64] FLAG: --qos-reserved="" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103804 2561 flags.go:64] FLAG: --read-only-port="10255" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103807 2561 flags.go:64] FLAG: --register-node="true" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103810 2561 flags.go:64] FLAG: --register-with-taints="" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103813 2561 flags.go:64] FLAG: --registry-burst="10" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103817 2561 flags.go:64] FLAG: --registry-qps="5" Jun 12 18:30:53.110918 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103820 2561 flags.go:64] FLAG: --reserved-cpus="" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103823 2561 flags.go:64] FLAG: --reserved-memory="" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103827 2561 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103830 2561 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103833 2561 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103835 2561 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103838 2561 flags.go:64] FLAG: --runonce="false" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103841 2561 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103844 2561 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103847 2561 flags.go:64] FLAG: --seccomp-default="false" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103850 2561 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103853 2561 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103856 2561 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103859 2561 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103862 2561 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103865 2561 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103868 2561 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103871 2561 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103873 2561 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103879 2561 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103881 2561 flags.go:64] FLAG: --system-cgroups="" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103884 2561 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103889 2561 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103892 2561 flags.go:64] FLAG: --tls-cert-file="" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103895 2561 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 18:30:53.111945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103899 2561 flags.go:64] FLAG: --tls-min-version="" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103902 2561 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103905 2561 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103908 2561 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103911 2561 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103913 2561 flags.go:64] FLAG: --v="2" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103918 2561 flags.go:64] FLAG: --version="false" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103922 2561 flags.go:64] FLAG: --vmodule="" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103931 2561 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.103934 2561 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104047 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104051 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104054 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104057 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104060 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104063 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104065 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104068 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104071 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104075 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104078 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104081 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:53.113034 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104084 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104087 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104090 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104093 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104097 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104100 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104103 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104105 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104108 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104111 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104114 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104116 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104119 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104122 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104124 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104127 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104131 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104133 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104136 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104138 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:53.113882 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104141 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104143 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104146 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104148 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104151 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104154 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104156 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104159 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104161 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104164 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104167 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104169 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104171 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104174 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104177 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104179 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104183 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104186 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104188 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104191 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:53.114590 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104193 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104196 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104198 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104201 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104204 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104207 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104209 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104212 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104216 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104220 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104222 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104225 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104228 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104230 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104234 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104237 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104240 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104243 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104246 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:53.115400 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104249 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104252 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104254 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104257 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104259 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104262 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104264 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104266 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104269 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104272 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104275 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104278 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104281 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104283 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104285 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104288 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104291 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104294 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104296 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:53.115976 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104299 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104301 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104305 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104308 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104312 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104314 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104317 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104320 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.104322 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.104933 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.112119 2561 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.112137 2561 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.112159 2561 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.112168 2561 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 18:30:53.116499 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112251 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112258 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112263 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112268 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112273 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112277 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112281 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112286 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112290 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112294 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112298 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112302 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112306 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112310 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112315 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112319 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112324 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112328 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112332 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112336 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:53.116983 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112340 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112346 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112352 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112356 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112361 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112365 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112370 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112374 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112378 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112384 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112389 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112393 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112397 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112401 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112406 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112410 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112414 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112418 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112422 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:53.117587 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112426 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112430 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112435 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112439 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112443 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112447 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112451 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112456 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112460 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112464 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112487 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112494 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112499 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112504 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112508 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112513 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112517 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112522 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112526 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112531 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:53.118107 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112534 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112538 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112543 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112549 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112553 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112558 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112562 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112566 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112571 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112575 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112579 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112583 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112587 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112591 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112595 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112599 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112603 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112607 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112611 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112616 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:53.118633 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112621 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112625 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112629 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112633 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112638 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112642 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112646 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112650 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112654 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112658 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112662 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112667 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112671 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112675 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112680 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112684 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112689 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112696 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112702 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:53.119160 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112707 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.112715 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112899 2561 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112907 2561 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112912 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112917 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112921 2561 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112925 2561 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112930 2561 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112934 2561 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112938 2561 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112942 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112947 2561 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112951 2561 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112955 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:30:53.119665 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112960 2561 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112964 2561 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112968 2561 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112972 2561 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112976 2561 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112980 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112985 2561 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112989 2561 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112993 2561 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.112997 2561 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113006 2561 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113010 2561 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113014 2561 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113019 2561 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113023 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113028 2561 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113032 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113036 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113040 2561 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113044 2561 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:30:53.120064 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113048 2561 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113052 2561 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113056 2561 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113060 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113064 2561 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113070 2561 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113077 2561 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113081 2561 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113086 2561 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113091 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113095 2561 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113099 2561 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113103 2561 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113108 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113111 2561 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113115 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113120 2561 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113124 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113128 2561 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:30:53.120912 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113132 2561 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113137 2561 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113141 2561 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113145 2561 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113149 2561 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113153 2561 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113157 2561 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113161 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113166 2561 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113171 2561 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113175 2561 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113179 2561 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113183 2561 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113187 2561 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113191 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113195 2561 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113199 2561 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113203 2561 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113207 2561 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:30:53.121711 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113213 2561 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113218 2561 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113223 2561 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113228 2561 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113233 2561 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113238 2561 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113242 2561 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113246 2561 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113251 2561 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113256 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113260 2561 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113264 2561 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113268 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113272 2561 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113276 2561 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113280 2561 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113284 2561 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113289 2561 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113293 2561 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113298 2561 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:30:53.122555 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113302 2561 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113307 2561 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113311 2561 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113318 2561 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113323 2561 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113328 2561 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113332 2561 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:53.113336 2561 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.113344 2561 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.113506 2561 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.116633 2561 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.118009 2561 server.go:1019] "Starting client certificate rotation" Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.118109 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:30:53.123551 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.118170 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:30:53.123896 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.120940 2561 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:30:53.123896 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.123111 2561 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:30:53.147975 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.147956 2561 log.go:25] "Validated CRI v1 runtime API" Jun 12 18:30:53.150373 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.150355 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:30:53.150736 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.150721 2561 log.go:25] "Validated CRI v1 image API" Jun 12 18:30:53.151572 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.151555 2561 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 18:30:53.155708 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.155683 2561 fs.go:135] Filesystem UUIDs: map[125ef94a-ea2c-452a-b2a1-63539cb5af17:/dev/nvme0n1p4 5b8c735d-e19d-4f5a-8c60-81632d057161:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 12 18:30:53.155772 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.155708 2561 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 18:30:53.160860 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.160758 2561 manager.go:216] Machine: {Timestamp:2026-06-12 18:30:53.159313519 +0000 UTC m=+0.359266562 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3103503 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2351f7244e56e72788e52544e6e4cf SystemUUID:ec2351f7-244e-56e7-2788-e52544e6e4cf BootID:c2aeb785-acf5-4354-af0a-5e49229f77b2 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:46:a1:a7:ff:6d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:46:a1:a7:ff:6d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:66:8e:f0:18:66:2d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 18:30:53.160860 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.160859 2561 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 18:30:53.160967 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.160936 2561 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 18:30:53.166005 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.165979 2561 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 18:30:53.166153 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.166008 2561 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-4.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 18:30:53.166701 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.166691 2561 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 18:30:53.166734 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.166704 2561 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 18:30:53.166734 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.166717 2561 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:30:53.168461 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.168450 2561 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:30:53.169688 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.169678 2561 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 18:30:53.172002 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.171987 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xq6ht" Jun 12 18:30:53.172432 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.172421 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:30:53.172729 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.172719 2561 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 18:30:53.172759 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.172753 2561 kubelet.go:486] "Attempting to sync node with API server" Jun 12 18:30:53.172791 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.172769 2561 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 18:30:53.172791 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.172784 2561 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 18:30:53.172842 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.172796 2561 kubelet.go:398] "Adding apiserver pod source" Jun 12 18:30:53.172842 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.172805 2561 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 18:30:53.186022 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.173142 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:30:53.186116 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.186059 2561 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:30:53.186116 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.179276 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-xq6ht" Jun 12 18:30:53.188457 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.188441 2561 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 18:30:53.189792 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.189777 2561 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 18:30:53.189863 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.189807 2561 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 18:30:53.189970 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.189959 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 18:30:53.190018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.189974 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 18:30:53.190018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.189980 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 18:30:53.190018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.189986 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 18:30:53.190018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.189995 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 18:30:53.190018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.190000 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 18:30:53.190648 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.190637 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 18:30:53.190685 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.190651 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 18:30:53.190685 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.190659 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 18:30:53.190685 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.190665 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 18:30:53.190685 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.190673 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 18:30:53.190685 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.190681 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 18:30:53.191344 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.191335 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 18:30:53.191344 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.191344 2561 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 18:30:53.192089 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.192048 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 18:30:53.192129 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.192048 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-4.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 18:30:53.194661 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.194649 2561 server.go:1268] "Started kubelet" Jun 12 18:30:53.194770 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.194732 2561 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 18:30:53.194825 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.194759 2561 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 18:30:53.194825 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.194798 2561 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 18:30:53.195679 ip-10-0-128-4 systemd[1]: Started Kubernetes Kubelet. Jun 12 18:30:53.196700 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.196687 2561 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 18:30:53.201270 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.201249 2561 server.go:310] "Adding debug handlers to kubelet server" Jun 12 18:30:53.204000 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.203981 2561 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 18:30:53.204084 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.203995 2561 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 18:30:53.204084 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.204059 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.205011 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.204860 2561 factory.go:55] Registering systemd factory Jun 12 18:30:53.205011 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.204879 2561 factory.go:223] Registration of the systemd container factory successfully Jun 12 18:30:53.205165 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205096 2561 factory.go:153] Registering CRI-O factory Jun 12 18:30:53.205165 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205114 2561 factory.go:223] Registration of the crio container factory successfully Jun 12 18:30:53.205254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205180 2561 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 18:30:53.205254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205203 2561 factory.go:103] Registering Raw factory Jun 12 18:30:53.205254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205218 2561 manager.go:1196] Started watching for new ooms in manager Jun 12 18:30:53.205394 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205357 2561 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 18:30:53.205394 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205373 2561 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 18:30:53.205571 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205358 2561 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 18:30:53.205571 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205527 2561 reconstruct.go:97] "Volume reconstruction finished" Jun 12 18:30:53.205571 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205535 2561 reconciler.go:29] "Reconciler: start to sync state" Jun 12 18:30:53.205715 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.205629 2561 manager.go:349] Starting recovery of all containers Jun 12 18:30:53.206232 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.206205 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:53.206408 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.206393 2561 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 18:30:53.209180 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.209159 2561 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-128-4.ec2.internal\" not found" node="ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.211775 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.211619 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-4.ec2.internal" not found Jun 12 18:30:53.215417 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.215402 2561 manager.go:354] Recovery completed Jun 12 18:30:53.220084 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.220073 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:53.221887 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.221873 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:53.221955 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.221900 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:53.221955 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.221910 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:53.222382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.222369 2561 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 18:30:53.222382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.222381 2561 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 18:30:53.222524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.222398 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:53.222524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.222410 2561 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:30:53.223165 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.223150 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:53.223215 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.223183 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:53.223215 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.223198 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:53.223646 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.223612 2561 policy_none.go:49] "None policy: Start" Jun 12 18:30:53.223646 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.223624 2561 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 18:30:53.223646 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.223634 2561 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 18:30:53.224592 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.224578 2561 policy_none.go:47] "Start" Jun 12 18:30:53.227699 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.227682 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-4.ec2.internal" not found Jun 12 18:30:53.261074 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.261060 2561 manager.go:337] "Starting Device Plugin manager" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.261091 2561 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.261100 2561 server.go:87] "Starting device plugin registration server" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.261382 2561 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.261397 2561 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.261493 2561 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.261706 2561 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.261717 2561 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.262632 2561 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.262691 2561 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.269036 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.270267 2561 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.270309 2561 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.270329 2561 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.270366 2561 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 18:30:53.272603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.272572 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:53.286868 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.286850 2561 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-128-4.ec2.internal" not found Jun 12 18:30:53.362249 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.362175 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:53.363165 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.363147 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:53.363245 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.363187 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:53.363245 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.363200 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:53.363245 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.363223 2561 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.371160 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.371146 2561 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.371236 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.371166 2561 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-4.ec2.internal\": node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.371290 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.371250 2561 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal"] Jun 12 18:30:53.371354 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.371343 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:53.372715 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.372699 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:53.372788 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.372740 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:53.372788 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.372755 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:53.374072 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374060 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:53.374223 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374209 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.374280 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374237 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:53.374796 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374769 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:53.374883 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374805 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:53.374883 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374815 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:53.374883 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374781 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:53.374883 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374879 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:53.375018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.374892 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:53.376109 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.376095 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.376201 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.376122 2561 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:30:53.376769 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.376750 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:30:53.376872 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.376789 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:30:53.376872 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.376802 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:30:53.389160 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.389146 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.405119 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.405094 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-4.ec2.internal\" not found" node="ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.407026 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.407007 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/798e762c20fd11c14bfe9899eb68218f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-4.ec2.internal\" (UID: \"798e762c20fd11c14bfe9899eb68218f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.407093 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.407039 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02a1404a4b46ae3e2edf0ed09e4190e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal\" (UID: \"02a1404a4b46ae3e2edf0ed09e4190e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.407093 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.407065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02a1404a4b46ae3e2edf0ed09e4190e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal\" (UID: \"02a1404a4b46ae3e2edf0ed09e4190e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.409507 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.409491 2561 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-4.ec2.internal\" not found" node="ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.489677 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.489644 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.508144 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.508122 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/798e762c20fd11c14bfe9899eb68218f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-4.ec2.internal\" (UID: \"798e762c20fd11c14bfe9899eb68218f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.508220 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.508149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02a1404a4b46ae3e2edf0ed09e4190e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal\" (UID: \"02a1404a4b46ae3e2edf0ed09e4190e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.508220 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.508166 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02a1404a4b46ae3e2edf0ed09e4190e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal\" (UID: \"02a1404a4b46ae3e2edf0ed09e4190e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.508220 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.508192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/02a1404a4b46ae3e2edf0ed09e4190e8-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal\" (UID: \"02a1404a4b46ae3e2edf0ed09e4190e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.508340 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.508221 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/798e762c20fd11c14bfe9899eb68218f-config\") pod \"kube-apiserver-proxy-ip-10-0-128-4.ec2.internal\" (UID: \"798e762c20fd11c14bfe9899eb68218f\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.508340 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.508229 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/02a1404a4b46ae3e2edf0ed09e4190e8-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal\" (UID: \"02a1404a4b46ae3e2edf0ed09e4190e8\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.590435 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.590409 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.690756 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.690669 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.706993 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.706973 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.713128 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:53.713111 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" Jun 12 18:30:53.791355 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.791322 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.891883 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.891855 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:53.992452 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:53.992387 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:54.069939 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.069907 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:54.093073 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:54.093044 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:54.117581 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.117557 2561 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 18:30:54.118091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.117698 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:30:54.118091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.117721 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:30:54.118091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.117733 2561 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:30:54.191550 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.191462 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 18:25:53 +0000 UTC" deadline="2027-12-09 13:44:58.766963556 +0000 UTC" Jun 12 18:30:54.191550 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.191543 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13075h14m4.575424513s" Jun 12 18:30:54.193608 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:54.193584 2561 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-4.ec2.internal\" not found" Jun 12 18:30:54.221196 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.221161 2561 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:54.239799 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:54.239767 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a1404a4b46ae3e2edf0ed09e4190e8.slice/crio-4604206efb1082a21b8ae03f45e20431f47a9c35e7da2bea63b1579b2aa0f562 WatchSource:0}: Error finding container 4604206efb1082a21b8ae03f45e20431f47a9c35e7da2bea63b1579b2aa0f562: Status 404 returned error can't find the container with id 4604206efb1082a21b8ae03f45e20431f47a9c35e7da2bea63b1579b2aa0f562 Jun 12 18:30:54.240043 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:54.240021 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod798e762c20fd11c14bfe9899eb68218f.slice/crio-f34efee0c69f8faa1b285cf2d7b65c579ec128e079b4807fbf397b336a8483a0 WatchSource:0}: Error finding container f34efee0c69f8faa1b285cf2d7b65c579ec128e079b4807fbf397b336a8483a0: Status 404 returned error can't find the container with id f34efee0c69f8faa1b285cf2d7b65c579ec128e079b4807fbf397b336a8483a0 Jun 12 18:30:54.243644 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.243630 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:30:54.274088 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.274040 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" event={"ID":"02a1404a4b46ae3e2edf0ed09e4190e8","Type":"ContainerStarted","Data":"4604206efb1082a21b8ae03f45e20431f47a9c35e7da2bea63b1579b2aa0f562"} Jun 12 18:30:54.275933 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.275906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" event={"ID":"798e762c20fd11c14bfe9899eb68218f","Type":"ContainerStarted","Data":"f34efee0c69f8faa1b285cf2d7b65c579ec128e079b4807fbf397b336a8483a0"} Jun 12 18:30:54.305035 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.305017 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" Jun 12 18:30:54.328141 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.328125 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:30:54.329156 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.329144 2561 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" Jun 12 18:30:54.348963 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:54.348948 2561 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:30:55.042460 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.042435 2561 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:55.174812 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.174777 2561 apiserver.go:52] "Watching apiserver" Jun 12 18:30:55.189645 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.189613 2561 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 18:30:55.191050 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.191017 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-vl785","kube-system/global-pull-secret-syncer-hx5qr","kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal","openshift-cluster-node-tuning-operator/tuned-mqvgf","openshift-dns/node-resolver-j7n2c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal","openshift-multus/multus-additional-cni-plugins-ld2ff","openshift-multus/network-metrics-daemon-rvspg","openshift-network-operator/iptables-alerter-jqtw6","kube-system/konnectivity-agent-f2xrr","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx","openshift-image-registry/node-ca-btmjg","openshift-multus/multus-hmn94","openshift-network-diagnostics/network-check-target-jt2gw"] Jun 12 18:30:55.192649 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.192628 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.194082 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.194061 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.195654 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.195633 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:55.195749 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.195714 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:30:55.197199 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.197180 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.198749 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.197961 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 18:30:55.198749 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.198428 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 18:30:55.198890 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.198758 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 18:30:55.198890 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.198862 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 18:30:55.198991 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.198949 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 18:30:55.200262 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.199226 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 18:30:55.200262 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.199862 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-wkdmz\"" Jun 12 18:30:55.200461 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.200414 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.201960 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.201820 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mjknt\"" Jun 12 18:30:55.202062 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.202048 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:55.202135 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.202114 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:30:55.202848 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.202816 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-ks4hv\"" Jun 12 18:30:55.203338 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.203322 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:30:55.203423 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.203397 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 18:30:55.203681 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.203664 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.205393 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.205374 2561 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 18:30:55.205632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.205609 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.206489 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.206444 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 18:30:55.207002 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.206983 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-qmr67\"" Jun 12 18:30:55.208274 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.208256 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:30:55.208362 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.208273 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 18:30:55.208362 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.208286 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.208457 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.208354 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:30:55.208617 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.208597 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-qtp7j\"" Jun 12 18:30:55.208754 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.208647 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 18:30:55.208754 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.208598 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 18:30:55.209402 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.209385 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 18:30:55.210276 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.210260 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.210721 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.210692 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 18:30:55.210815 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.210750 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 18:30:55.210815 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.210795 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 18:30:55.211101 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.211086 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 18:30:55.212398 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.212379 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.212799 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.212784 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-jx4bd\"" Jun 12 18:30:55.213461 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.213446 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 18:30:55.214777 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.214755 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.215272 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.215254 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 18:30:55.217311 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217293 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 18:30:55.217420 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217405 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 18:30:55.217485 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217421 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 18:30:55.217555 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217513 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-prqq7\"" Jun 12 18:30:55.217680 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217664 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 18:30:55.217727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-sys\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.217778 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217740 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-system-cni-dir\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.217828 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217785 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-daemon-config\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.217880 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217842 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-slash\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.217880 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-jwbtq\"" Jun 12 18:30:55.217880 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217876 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-ovn\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.218006 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217900 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:55.218006 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217926 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysctl-d\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218006 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217948 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-cnibin\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.218006 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217972 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.218006 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.217994 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-cni-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218174 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218011 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca9f855a-4e2c-45fe-b3b0-531b67863c31-cni-binary-copy\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218174 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218033 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-run-netns\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.218174 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218060 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-host\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218174 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218103 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-os-release\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218174 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218135 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-socket-dir-parent\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218174 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218162 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-cni-bin\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218187 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-multus-certs\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218210 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-log-socket\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysctl-conf\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218277 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-run\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218303 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-tmp\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218327 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-iptables-alerter-script\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218353 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-etc-kubernetes\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218376 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-node-log\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218400 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218425 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7pxc\" (UniqueName: \"kubernetes.io/projected/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-kube-api-access-g7pxc\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218449 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-hostroot\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218495 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-lib-modules\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-tuned\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218579 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-os-release\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218620 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218667 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22e07909-8555-4f40-86b1-d97e1e5e5e4f-hosts-file\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218704 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-etc-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218721 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218754 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-cni-binary-copy\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218789 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v94n2\" (UniqueName: \"kubernetes.io/projected/e010037a-6a90-4583-a287-0a2f71c385de-kube-api-access-v94n2\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218816 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-k8s-cni-cncf-io\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5vw9\" (UniqueName: \"kubernetes.io/projected/ca9f855a-4e2c-45fe-b3b0-531b67863c31-kube-api-access-m5vw9\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.218869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218863 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w97n\" (UniqueName: \"kubernetes.io/projected/79883943-cedb-4352-bf3d-05b99afe7224-kube-api-access-2w97n\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218893 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-cni-multus\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218963 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.218989 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysconfig\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219013 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2snrb\" (UniqueName: \"kubernetes.io/projected/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-kube-api-access-2snrb\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219046 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-cnibin\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219076 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-systemd\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219158 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-cni-bin\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219195 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovnkube-config\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219218 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovn-node-metrics-cert\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219241 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nnk4x\" (UniqueName: \"kubernetes.io/projected/02ecfda6-cc62-41e6-8d42-2bb93795ba27-kube-api-access-nnk4x\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-kubernetes\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219289 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-systemd\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.219336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219332 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-var-lib-kubelet\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-kubelet\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-kubelet\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219441 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-run-ovn-kubernetes\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219519 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-cni-netd\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219552 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovnkube-script-lib\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-dbus\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219616 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-modprobe-d\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219648 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-host-slash\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219671 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6v4b\" (UniqueName: \"kubernetes.io/projected/22e07909-8555-4f40-86b1-d97e1e5e5e4f-kube-api-access-k6v4b\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219694 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-conf-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219715 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219716 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22e07909-8555-4f40-86b1-d97e1e5e5e4f-tmp-dir\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219768 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-var-lib-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219800 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-env-overrides\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219843 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219849 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219856 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 18:30:55.219972 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-netns\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.220730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219898 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-kubelet-config\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.220730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219908 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-9fjg5\"" Jun 12 18:30:55.220730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219920 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-system-cni-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.220730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.219944 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-systemd-units\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.226256 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.226234 2561 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:30:55.254448 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.254422 2561 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-lnnlx" Jun 12 18:30:55.267999 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.267974 2561 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-lnnlx" Jun 12 18:30:55.306667 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.306593 2561 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 18:30:55.320699 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320665 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-cni-multus\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.320867 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320706 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:55.320867 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320735 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.320867 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320830 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysconfig\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.320867 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320854 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-cni-multus\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.320875 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320856 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2snrb\" (UniqueName: \"kubernetes.io/projected/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-kube-api-access-2snrb\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.320916 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320917 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-cnibin\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.320983 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-cnibin\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.321020 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret podName:236a8efa-2ef3-4ddb-9c11-95e34b5bb32f nodeName:}" failed. No retries permitted until 2026-06-12 18:30:55.82099544 +0000 UTC m=+3.020948492 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret") pod "global-pull-secret-syncer-hx5qr" (UID: "236a8efa-2ef3-4ddb-9c11-95e34b5bb32f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.321049 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs podName:79883943-cedb-4352-bf3d-05b99afe7224 nodeName:}" failed. No retries permitted until 2026-06-12 18:30:55.821034343 +0000 UTC m=+3.020987389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs") pod "network-metrics-daemon-rvspg" (UID: "79883943-cedb-4352-bf3d-05b99afe7224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321046 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-systemd\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321079 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-cni-bin\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321088 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-systemd\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321022 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysconfig\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovnkube-config\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321128 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovn-node-metrics-cert\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321134 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-cni-bin\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321149 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nnk4x\" (UniqueName: \"kubernetes.io/projected/02ecfda6-cc62-41e6-8d42-2bb93795ba27-kube-api-access-nnk4x\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321170 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-kubernetes\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321190 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-systemd\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-systemd\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321285 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-var-lib-kubelet\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321312 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-kubelet\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321280 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-kubernetes\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321333 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-var-lib-kubelet\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321336 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-kubelet\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321370 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-kubelet\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321390 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1cccbad-7ec4-46dc-8eac-5c1207d77342-agent-certs\") pod \"konnectivity-agent-f2xrr\" (UID: \"f1cccbad-7ec4-46dc-8eac-5c1207d77342\") " pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.321524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321424 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-sys-fs\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321390 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-kubelet\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321452 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b023889a-3206-4b10-a251-629bb1837618-host\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-run-ovn-kubernetes\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321531 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-cni-netd\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovnkube-script-lib\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321568 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-run-ovn-kubernetes\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321584 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-dbus\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321594 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-cni-netd\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-modprobe-d\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321641 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-host-slash\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6v4b\" (UniqueName: \"kubernetes.io/projected/22e07909-8555-4f40-86b1-d97e1e5e5e4f-kube-api-access-k6v4b\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321681 2561 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321686 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-dbus\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321688 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1cccbad-7ec4-46dc-8eac-5c1207d77342-konnectivity-ca\") pod \"konnectivity-agent-f2xrr\" (UID: \"f1cccbad-7ec4-46dc-8eac-5c1207d77342\") " pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321723 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-host-slash\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321748 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-modprobe-d\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-conf-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.322352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321810 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovnkube-config\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321818 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22e07909-8555-4f40-86b1-d97e1e5e5e4f-tmp-dir\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321847 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-var-lib-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-env-overrides\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321904 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-var-lib-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321937 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321959 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-conf-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.321974 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322007 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-netns\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322053 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-kubelet-config\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-netns\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322076 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-system-cni-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322098 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/22e07909-8555-4f40-86b1-d97e1e5e5e4f-tmp-dir\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322108 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-systemd-units\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322127 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-kubelet-config\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322140 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-registration-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322154 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.322980 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322167 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-sys\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322177 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-system-cni-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322192 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-systemd-units\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-system-cni-dir\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322225 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-sys\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-system-cni-dir\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322233 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-daemon-config\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322260 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-slash\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322196 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovnkube-script-lib\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-ovn\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322309 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322320 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-slash\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322333 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysctl-d\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322356 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-cnibin\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322358 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-ovn\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322360 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/02ecfda6-cc62-41e6-8d42-2bb93795ba27-env-overrides\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.323725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322404 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-cni-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322411 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-cnibin\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca9f855a-4e2c-45fe-b3b0-531b67863c31-cni-binary-copy\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322456 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-socket-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322497 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-device-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322509 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysctl-d\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322526 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-run-netns\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322575 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-run-netns\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322583 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-cni-dir\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322617 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-host\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322643 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-os-release\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322669 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-socket-dir-parent\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322691 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-cni-bin\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-multus-certs\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322737 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-daemon-config\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322738 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-log-socket\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322769 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-log-socket\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.324469 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322785 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322784 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dffjv\" (UniqueName: \"kubernetes.io/projected/af716ce5-9dae-4121-aede-2a87fb283327-kube-api-access-dffjv\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322814 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-host\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysctl-conf\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322836 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-multus-socket-dir-parent\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322848 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-run\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322872 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-multus-certs\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322874 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-tmp\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322899 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-os-release\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322900 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-iptables-alerter-script\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322935 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-etc-kubernetes\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322958 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-node-log\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322969 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca9f855a-4e2c-45fe-b3b0-531b67863c31-cni-binary-copy\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322983 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323010 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7pxc\" (UniqueName: \"kubernetes.io/projected/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-kube-api-access-g7pxc\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323016 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-etc-kubernetes\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-sysctl-conf\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323045 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-hostroot\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325173 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323054 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-node-log\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323072 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4p4q\" (UniqueName: \"kubernetes.io/projected/b023889a-3206-4b10-a251-629bb1837618-kube-api-access-t4p4q\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323085 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-var-lib-cni-bin\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323098 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-lib-modules\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.322902 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-run\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323149 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-hostroot\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323161 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-tuned\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323211 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-os-release\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323239 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22e07909-8555-4f40-86b1-d97e1e5e5e4f-hosts-file\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323289 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-etc-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323300 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/e010037a-6a90-4583-a287-0a2f71c385de-os-release\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323314 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323352 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/22e07909-8555-4f40-86b1-d97e1e5e5e4f-hosts-file\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323371 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-cni-binary-copy\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.325944 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323397 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-iptables-alerter-script\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v94n2\" (UniqueName: \"kubernetes.io/projected/e010037a-6a90-4583-a287-0a2f71c385de-kube-api-access-v94n2\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323445 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-k8s-cni-cncf-io\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323491 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5vw9\" (UniqueName: \"kubernetes.io/projected/ca9f855a-4e2c-45fe-b3b0-531b67863c31-kube-api-access-m5vw9\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323525 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w97n\" (UniqueName: \"kubernetes.io/projected/79883943-cedb-4352-bf3d-05b99afe7224-kube-api-access-2w97n\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323554 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b023889a-3206-4b10-a251-629bb1837618-serviceca\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323625 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-lib-modules\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323650 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ca9f855a-4e2c-45fe-b3b0-531b67863c31-host-run-k8s-cni-cncf-io\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323676 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-etc-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323691 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/02ecfda6-cc62-41e6-8d42-2bb93795ba27-run-openvswitch\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.323793 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.324138 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/e010037a-6a90-4583-a287-0a2f71c385de-cni-binary-copy\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.325683 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/02ecfda6-cc62-41e6-8d42-2bb93795ba27-ovn-node-metrics-cert\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.325694 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-tmp\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.326512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.325778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-etc-tuned\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.336250 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.336225 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2snrb\" (UniqueName: \"kubernetes.io/projected/e7ee1c59-97c8-489c-aab3-e295eb40cc4f-kube-api-access-2snrb\") pod \"iptables-alerter-jqtw6\" (UID: \"e7ee1c59-97c8-489c-aab3-e295eb40cc4f\") " pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.336447 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.336426 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6v4b\" (UniqueName: \"kubernetes.io/projected/22e07909-8555-4f40-86b1-d97e1e5e5e4f-kube-api-access-k6v4b\") pod \"node-resolver-j7n2c\" (UID: \"22e07909-8555-4f40-86b1-d97e1e5e5e4f\") " pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.336755 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.336733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nnk4x\" (UniqueName: \"kubernetes.io/projected/02ecfda6-cc62-41e6-8d42-2bb93795ba27-kube-api-access-nnk4x\") pod \"ovnkube-node-vl785\" (UID: \"02ecfda6-cc62-41e6-8d42-2bb93795ba27\") " pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.339407 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.339374 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:30:55.339525 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.339493 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:30:55.339525 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.339512 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mjqdx for pod openshift-network-diagnostics/network-check-target-jt2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:55.339680 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.339583 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx podName:4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae nodeName:}" failed. No retries permitted until 2026-06-12 18:30:55.839564944 +0000 UTC m=+3.039517987 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mjqdx" (UniqueName: "kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx") pod "network-check-target-jt2gw" (UID: "4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:55.341841 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.341798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v94n2\" (UniqueName: \"kubernetes.io/projected/e010037a-6a90-4583-a287-0a2f71c385de-kube-api-access-v94n2\") pod \"multus-additional-cni-plugins-ld2ff\" (UID: \"e010037a-6a90-4583-a287-0a2f71c385de\") " pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.342013 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.341993 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5vw9\" (UniqueName: \"kubernetes.io/projected/ca9f855a-4e2c-45fe-b3b0-531b67863c31-kube-api-access-m5vw9\") pod \"multus-hmn94\" (UID: \"ca9f855a-4e2c-45fe-b3b0-531b67863c31\") " pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.343054 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.343025 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w97n\" (UniqueName: \"kubernetes.io/projected/79883943-cedb-4352-bf3d-05b99afe7224-kube-api-access-2w97n\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:55.343752 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.343733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7pxc\" (UniqueName: \"kubernetes.io/projected/c1028b63-7efb-40ed-a86b-4d5fed90e2b5-kube-api-access-g7pxc\") pod \"tuned-mqvgf\" (UID: \"c1028b63-7efb-40ed-a86b-4d5fed90e2b5\") " pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.424236 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424205 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4p4q\" (UniqueName: \"kubernetes.io/projected/b023889a-3206-4b10-a251-629bb1837618-kube-api-access-t4p4q\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.424422 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424304 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.424422 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b023889a-3206-4b10-a251-629bb1837618-serviceca\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.424573 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424422 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-kubelet-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.424671 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424645 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1cccbad-7ec4-46dc-8eac-5c1207d77342-agent-certs\") pod \"konnectivity-agent-f2xrr\" (UID: \"f1cccbad-7ec4-46dc-8eac-5c1207d77342\") " pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.424729 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424690 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-sys-fs\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.424729 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424714 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b023889a-3206-4b10-a251-629bb1837618-host\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.424833 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1cccbad-7ec4-46dc-8eac-5c1207d77342-konnectivity-ca\") pod \"konnectivity-agent-f2xrr\" (UID: \"f1cccbad-7ec4-46dc-8eac-5c1207d77342\") " pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.424833 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424802 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-sys-fs\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.424833 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424822 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.424833 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424787 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b023889a-3206-4b10-a251-629bb1837618-host\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.425018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424854 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-registration-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424902 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-socket-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424910 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b023889a-3206-4b10-a251-629bb1837618-serviceca\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.425018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424924 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-device-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424971 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-device-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424972 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dffjv\" (UniqueName: \"kubernetes.io/projected/af716ce5-9dae-4121-aede-2a87fb283327-kube-api-access-dffjv\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425018 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.425010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-etc-selinux\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425346 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.425070 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-socket-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425346 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.424957 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/af716ce5-9dae-4121-aede-2a87fb283327-registration-dir\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.425449 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.425361 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f1cccbad-7ec4-46dc-8eac-5c1207d77342-konnectivity-ca\") pod \"konnectivity-agent-f2xrr\" (UID: \"f1cccbad-7ec4-46dc-8eac-5c1207d77342\") " pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.427171 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.427148 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f1cccbad-7ec4-46dc-8eac-5c1207d77342-agent-certs\") pod \"konnectivity-agent-f2xrr\" (UID: \"f1cccbad-7ec4-46dc-8eac-5c1207d77342\") " pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.437638 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.437593 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4p4q\" (UniqueName: \"kubernetes.io/projected/b023889a-3206-4b10-a251-629bb1837618-kube-api-access-t4p4q\") pod \"node-ca-btmjg\" (UID: \"b023889a-3206-4b10-a251-629bb1837618\") " pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.437638 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.437613 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dffjv\" (UniqueName: \"kubernetes.io/projected/af716ce5-9dae-4121-aede-2a87fb283327-kube-api-access-dffjv\") pod \"aws-ebs-csi-driver-node-l8gvx\" (UID: \"af716ce5-9dae-4121-aede-2a87fb283327\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.505322 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.505286 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" Jun 12 18:30:55.513211 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.513190 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hmn94" Jun 12 18:30:55.520874 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.520847 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" Jun 12 18:30:55.526392 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.526372 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-j7n2c" Jun 12 18:30:55.534926 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.534906 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jqtw6" Jun 12 18:30:55.542020 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.541996 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:30:55.547528 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.547507 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:30:55.555117 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.555092 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" Jun 12 18:30:55.561608 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.561591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-btmjg" Jun 12 18:30:55.629353 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.629324 2561 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:55.828436 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.828366 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:55.828436 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.828400 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:55.828601 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.828526 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:55.828601 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.828586 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs podName:79883943-cedb-4352-bf3d-05b99afe7224 nodeName:}" failed. No retries permitted until 2026-06-12 18:30:56.828571805 +0000 UTC m=+4.028524837 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs") pod "network-metrics-daemon-rvspg" (UID: "79883943-cedb-4352-bf3d-05b99afe7224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:55.828696 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.828526 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:55.828696 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.828645 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret podName:236a8efa-2ef3-4ddb-9c11-95e34b5bb32f nodeName:}" failed. No retries permitted until 2026-06-12 18:30:56.828633713 +0000 UTC m=+4.028586742 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret") pod "global-pull-secret-syncer-hx5qr" (UID: "236a8efa-2ef3-4ddb-9c11-95e34b5bb32f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:55.929497 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:55.929452 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:55.929667 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.929594 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:30:55.929667 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.929612 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:30:55.929667 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.929631 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mjqdx for pod openshift-network-diagnostics/network-check-target-jt2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:55.929846 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:55.929691 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx podName:4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae nodeName:}" failed. No retries permitted until 2026-06-12 18:30:56.929672129 +0000 UTC m=+4.129625163 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjqdx" (UniqueName: "kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx") pod "network-check-target-jt2gw" (UID: "4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:56.185009 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.184979 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02ecfda6_cc62_41e6_8d42_2bb93795ba27.slice/crio-91e208ee92eb9881f968ffd9fdbc3fa4ced86f39634acee984bbf4d86f65fa95 WatchSource:0}: Error finding container 91e208ee92eb9881f968ffd9fdbc3fa4ced86f39634acee984bbf4d86f65fa95: Status 404 returned error can't find the container with id 91e208ee92eb9881f968ffd9fdbc3fa4ced86f39634acee984bbf4d86f65fa95 Jun 12 18:30:56.186696 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.186671 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca9f855a_4e2c_45fe_b3b0_531b67863c31.slice/crio-2f53495953697f55a0158bdd410ea0da44eeba01d28dcdaa678578b1c01dad2c WatchSource:0}: Error finding container 2f53495953697f55a0158bdd410ea0da44eeba01d28dcdaa678578b1c01dad2c: Status 404 returned error can't find the container with id 2f53495953697f55a0158bdd410ea0da44eeba01d28dcdaa678578b1c01dad2c Jun 12 18:30:56.187643 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.187617 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1cccbad_7ec4_46dc_8eac_5c1207d77342.slice/crio-3059b1ddf63cee0e893437bd3b65d54a2908a3fd514aa5c46fd818b4cc5cbefc WatchSource:0}: Error finding container 3059b1ddf63cee0e893437bd3b65d54a2908a3fd514aa5c46fd818b4cc5cbefc: Status 404 returned error can't find the container with id 3059b1ddf63cee0e893437bd3b65d54a2908a3fd514aa5c46fd818b4cc5cbefc Jun 12 18:30:56.192625 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.192596 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e07909_8555_4f40_86b1_d97e1e5e5e4f.slice/crio-d5a2f13deab0ca02a17a50cc4be4564105d8e8dcb0a64948a69ce7e5f1663882 WatchSource:0}: Error finding container d5a2f13deab0ca02a17a50cc4be4564105d8e8dcb0a64948a69ce7e5f1663882: Status 404 returned error can't find the container with id d5a2f13deab0ca02a17a50cc4be4564105d8e8dcb0a64948a69ce7e5f1663882 Jun 12 18:30:56.193439 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.193416 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7ee1c59_97c8_489c_aab3_e295eb40cc4f.slice/crio-297df28d869d68e9f7d575f43943cf4ea1a26bc1faa2e3540d987e344efc28cf WatchSource:0}: Error finding container 297df28d869d68e9f7d575f43943cf4ea1a26bc1faa2e3540d987e344efc28cf: Status 404 returned error can't find the container with id 297df28d869d68e9f7d575f43943cf4ea1a26bc1faa2e3540d987e344efc28cf Jun 12 18:30:56.214138 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.214109 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb023889a_3206_4b10_a251_629bb1837618.slice/crio-27229794827a892265240bc566210a6da2fb15bcf049be7ca0546d117bb237ba WatchSource:0}: Error finding container 27229794827a892265240bc566210a6da2fb15bcf049be7ca0546d117bb237ba: Status 404 returned error can't find the container with id 27229794827a892265240bc566210a6da2fb15bcf049be7ca0546d117bb237ba Jun 12 18:30:56.214823 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.214799 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1028b63_7efb_40ed_a86b_4d5fed90e2b5.slice/crio-8472f9272d62c611b9b6c6c94922d6034aecf2935f42ac94d4e73f0ef1d3d79b WatchSource:0}: Error finding container 8472f9272d62c611b9b6c6c94922d6034aecf2935f42ac94d4e73f0ef1d3d79b: Status 404 returned error can't find the container with id 8472f9272d62c611b9b6c6c94922d6034aecf2935f42ac94d4e73f0ef1d3d79b Jun 12 18:30:56.215843 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.215820 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaf716ce5_9dae_4121_aede_2a87fb283327.slice/crio-15a7ff11bbdb06ef1fe5c133d1f311f40abe186780c1c2204b775cc91b8b102c WatchSource:0}: Error finding container 15a7ff11bbdb06ef1fe5c133d1f311f40abe186780c1c2204b775cc91b8b102c: Status 404 returned error can't find the container with id 15a7ff11bbdb06ef1fe5c133d1f311f40abe186780c1c2204b775cc91b8b102c Jun 12 18:30:56.216411 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:30:56.216391 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode010037a_6a90_4583_a287_0a2f71c385de.slice/crio-957066005b2497bc7411f5862cd926b437a15f73e9a8ce8abaa892984ae18fd0 WatchSource:0}: Error finding container 957066005b2497bc7411f5862cd926b437a15f73e9a8ce8abaa892984ae18fd0: Status 404 returned error can't find the container with id 957066005b2497bc7411f5862cd926b437a15f73e9a8ce8abaa892984ae18fd0 Jun 12 18:30:56.271589 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.271410 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:25:55 +0000 UTC" deadline="2027-12-11 09:56:05.219657892 +0000 UTC" Jun 12 18:30:56.271589 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.271588 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13119h25m8.948074946s" Jun 12 18:30:56.279622 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.279593 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hmn94" event={"ID":"ca9f855a-4e2c-45fe-b3b0-531b67863c31","Type":"ContainerStarted","Data":"2f53495953697f55a0158bdd410ea0da44eeba01d28dcdaa678578b1c01dad2c"} Jun 12 18:30:56.283327 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.283299 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2xrr" event={"ID":"f1cccbad-7ec4-46dc-8eac-5c1207d77342","Type":"ContainerStarted","Data":"3059b1ddf63cee0e893437bd3b65d54a2908a3fd514aa5c46fd818b4cc5cbefc"} Jun 12 18:30:56.284408 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.284382 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"91e208ee92eb9881f968ffd9fdbc3fa4ced86f39634acee984bbf4d86f65fa95"} Jun 12 18:30:56.285441 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.285417 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" event={"ID":"c1028b63-7efb-40ed-a86b-4d5fed90e2b5","Type":"ContainerStarted","Data":"8472f9272d62c611b9b6c6c94922d6034aecf2935f42ac94d4e73f0ef1d3d79b"} Jun 12 18:30:56.286328 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.286308 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-btmjg" event={"ID":"b023889a-3206-4b10-a251-629bb1837618","Type":"ContainerStarted","Data":"27229794827a892265240bc566210a6da2fb15bcf049be7ca0546d117bb237ba"} Jun 12 18:30:56.287280 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.287262 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerStarted","Data":"957066005b2497bc7411f5862cd926b437a15f73e9a8ce8abaa892984ae18fd0"} Jun 12 18:30:56.288257 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.288230 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jqtw6" event={"ID":"e7ee1c59-97c8-489c-aab3-e295eb40cc4f","Type":"ContainerStarted","Data":"297df28d869d68e9f7d575f43943cf4ea1a26bc1faa2e3540d987e344efc28cf"} Jun 12 18:30:56.289441 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.289420 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" event={"ID":"af716ce5-9dae-4121-aede-2a87fb283327","Type":"ContainerStarted","Data":"15a7ff11bbdb06ef1fe5c133d1f311f40abe186780c1c2204b775cc91b8b102c"} Jun 12 18:30:56.290588 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.290563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7n2c" event={"ID":"22e07909-8555-4f40-86b1-d97e1e5e5e4f","Type":"ContainerStarted","Data":"d5a2f13deab0ca02a17a50cc4be4564105d8e8dcb0a64948a69ce7e5f1663882"} Jun 12 18:30:56.370554 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.370526 2561 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:30:56.836332 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.836255 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:56.836332 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.836301 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:56.836563 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.836429 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:56.836563 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.836499 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret podName:236a8efa-2ef3-4ddb-9c11-95e34b5bb32f nodeName:}" failed. No retries permitted until 2026-06-12 18:30:58.836466109 +0000 UTC m=+6.036419139 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret") pod "global-pull-secret-syncer-hx5qr" (UID: "236a8efa-2ef3-4ddb-9c11-95e34b5bb32f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:56.836692 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.836579 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:56.836692 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.836612 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs podName:79883943-cedb-4352-bf3d-05b99afe7224 nodeName:}" failed. No retries permitted until 2026-06-12 18:30:58.836600687 +0000 UTC m=+6.036553723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs") pod "network-metrics-daemon-rvspg" (UID: "79883943-cedb-4352-bf3d-05b99afe7224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:56.936637 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:56.936596 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:56.936825 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.936810 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:30:56.936891 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.936828 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:30:56.936891 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.936841 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mjqdx for pod openshift-network-diagnostics/network-check-target-jt2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:56.936993 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:56.936899 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx podName:4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae nodeName:}" failed. No retries permitted until 2026-06-12 18:30:58.93688102 +0000 UTC m=+6.136834064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjqdx" (UniqueName: "kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx") pod "network-check-target-jt2gw" (UID: "4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:57.273289 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.272448 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:57.273289 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:57.272610 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:30:57.273289 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.273001 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:57.273289 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:57.273090 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:30:57.273289 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.273153 2561 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:25:55 +0000 UTC" deadline="2028-03-27 11:02:32.274031588 +0000 UTC" Jun 12 18:30:57.273289 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.273192 2561 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15688h31m35.000843833s" Jun 12 18:30:57.273995 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.273500 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:57.273995 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:57.273589 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:30:57.305052 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.305017 2561 generic.go:356] "Generic (PLEG): container finished" podID="02a1404a4b46ae3e2edf0ed09e4190e8" containerID="36ef9279025c1f1772602c02620784636325757487691c9e5ea3e889724aa7a1" exitCode=0 Jun 12 18:30:57.305233 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.305109 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" event={"ID":"02a1404a4b46ae3e2edf0ed09e4190e8","Type":"ContainerDied","Data":"36ef9279025c1f1772602c02620784636325757487691c9e5ea3e889724aa7a1"} Jun 12 18:30:57.314779 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.314750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" event={"ID":"798e762c20fd11c14bfe9899eb68218f","Type":"ContainerStarted","Data":"88f539513b6d55be4360259bcb08e22fc8ef914e03d5e2ee06816b0edb4b2f67"} Jun 12 18:30:57.368466 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:57.368238 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-4.ec2.internal" podStartSLOduration=3.368214281 podStartE2EDuration="3.368214281s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:30:57.367490741 +0000 UTC m=+4.567443813" watchObservedRunningTime="2026-06-12 18:30:57.368214281 +0000 UTC m=+4.568167334" Jun 12 18:30:58.320635 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:58.320563 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" event={"ID":"02a1404a4b46ae3e2edf0ed09e4190e8","Type":"ContainerStarted","Data":"41d9e5353aff37ace830163f44236df319c94f2d30e64d2d4690a23909a537d9"} Jun 12 18:30:58.853654 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:58.853579 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:58.853654 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:58.853635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:58.853982 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.853773 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:58.853982 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.853835 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret podName:236a8efa-2ef3-4ddb-9c11-95e34b5bb32f nodeName:}" failed. No retries permitted until 2026-06-12 18:31:02.853816944 +0000 UTC m=+10.053769973 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret") pod "global-pull-secret-syncer-hx5qr" (UID: "236a8efa-2ef3-4ddb-9c11-95e34b5bb32f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:30:58.854255 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.854234 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:58.854343 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.854291 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs podName:79883943-cedb-4352-bf3d-05b99afe7224 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:02.854275274 +0000 UTC m=+10.054228309 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs") pod "network-metrics-daemon-rvspg" (UID: "79883943-cedb-4352-bf3d-05b99afe7224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:30:58.954966 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:58.954927 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:58.955133 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.955118 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:30:58.955206 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.955140 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:30:58.955206 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.955154 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mjqdx for pod openshift-network-diagnostics/network-check-target-jt2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:58.955348 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:58.955216 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx podName:4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae nodeName:}" failed. No retries permitted until 2026-06-12 18:31:02.955197416 +0000 UTC m=+10.155150459 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjqdx" (UniqueName: "kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx") pod "network-check-target-jt2gw" (UID: "4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:30:59.271945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:59.271833 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:30:59.272095 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:59.271966 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:30:59.272095 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:59.271834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:30:59.272095 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:59.272058 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:30:59.272095 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:30:59.271834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:30:59.272304 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:30:59.272145 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:01.270752 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:01.270717 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:01.271170 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:01.270856 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:01.271170 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:01.270934 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:01.271170 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:01.271060 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:01.271170 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:01.271133 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:01.271340 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:01.271207 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:02.890840 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:02.890796 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:02.891315 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:02.890857 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:02.891315 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.890976 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:02.891315 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.891039 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret podName:236a8efa-2ef3-4ddb-9c11-95e34b5bb32f nodeName:}" failed. No retries permitted until 2026-06-12 18:31:10.891021013 +0000 UTC m=+18.090974047 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret") pod "global-pull-secret-syncer-hx5qr" (UID: "236a8efa-2ef3-4ddb-9c11-95e34b5bb32f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:02.891315 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.890976 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:02.891315 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.891115 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs podName:79883943-cedb-4352-bf3d-05b99afe7224 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:10.89110324 +0000 UTC m=+18.091056275 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs") pod "network-metrics-daemon-rvspg" (UID: "79883943-cedb-4352-bf3d-05b99afe7224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:02.991454 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:02.991375 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:02.991653 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.991558 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:31:02.991653 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.991581 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:31:02.991653 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.991594 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mjqdx for pod openshift-network-diagnostics/network-check-target-jt2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:02.991807 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:02.991656 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx podName:4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae nodeName:}" failed. No retries permitted until 2026-06-12 18:31:10.991639223 +0000 UTC m=+18.191592263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjqdx" (UniqueName: "kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx") pod "network-check-target-jt2gw" (UID: "4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:03.274261 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:03.274185 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:03.274261 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:03.274246 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:03.274444 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:03.274342 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:03.274444 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:03.274372 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:03.274444 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:03.274424 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:03.274631 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:03.274514 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:05.271408 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:05.271378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:05.271408 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:05.271410 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:05.272011 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:05.271377 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:05.272011 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:05.271527 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:05.272011 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:05.271639 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:05.272011 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:05.271718 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:07.271382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:07.271325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:07.271382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:07.271381 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:07.271925 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:07.271325 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:07.271925 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:07.271499 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:07.271925 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:07.271598 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:07.271925 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:07.271692 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:09.270933 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:09.270894 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:09.271386 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:09.270894 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:09.271386 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:09.271036 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:09.271386 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:09.271106 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:09.271386 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:09.270915 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:09.271386 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:09.271183 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:10.954377 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:10.954332 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:10.954377 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:10.954383 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:10.954891 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:10.954519 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:10.954891 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:10.954520 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:10.954891 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:10.954598 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret podName:236a8efa-2ef3-4ddb-9c11-95e34b5bb32f nodeName:}" failed. No retries permitted until 2026-06-12 18:31:26.954577411 +0000 UTC m=+34.154530462 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret") pod "global-pull-secret-syncer-hx5qr" (UID: "236a8efa-2ef3-4ddb-9c11-95e34b5bb32f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:10.954891 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:10.954619 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs podName:79883943-cedb-4352-bf3d-05b99afe7224 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:26.954608969 +0000 UTC m=+34.154562012 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs") pod "network-metrics-daemon-rvspg" (UID: "79883943-cedb-4352-bf3d-05b99afe7224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:11.055026 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:11.054984 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:11.055207 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:11.055127 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:31:11.055207 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:11.055147 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:31:11.055207 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:11.055158 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mjqdx for pod openshift-network-diagnostics/network-check-target-jt2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:11.055343 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:11.055221 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx podName:4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae nodeName:}" failed. No retries permitted until 2026-06-12 18:31:27.055203444 +0000 UTC m=+34.255156473 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjqdx" (UniqueName: "kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx") pod "network-check-target-jt2gw" (UID: "4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:11.271377 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:11.271289 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:11.271568 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:11.271299 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:11.271568 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:11.271451 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:11.271568 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:11.271431 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:11.271568 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:11.271560 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:11.271772 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:11.271642 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:13.271500 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:13.271458 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:13.271928 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:13.271504 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:13.271928 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:13.271580 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:13.271928 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:13.271593 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:13.271928 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:13.271689 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:13.271928 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:13.271772 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:15.271283 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.270982 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:15.272081 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.270988 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:15.272081 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:15.271367 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:15.272081 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.271038 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:15.272081 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:15.271432 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:15.272081 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:15.271540 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:15.353548 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.353517 2561 generic.go:356] "Generic (PLEG): container finished" podID="e010037a-6a90-4583-a287-0a2f71c385de" containerID="b5ca46ae251b5cc6157b18faca306b3f3db8d6c8bb6d68cebbf0f9431673b3c8" exitCode=0 Jun 12 18:31:15.353715 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.353606 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerDied","Data":"b5ca46ae251b5cc6157b18faca306b3f3db8d6c8bb6d68cebbf0f9431673b3c8"} Jun 12 18:31:15.355104 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.355063 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" event={"ID":"af716ce5-9dae-4121-aede-2a87fb283327","Type":"ContainerStarted","Data":"af5016dbb7f387fe8d2a5031e1ec6f86c5eb873dda025d34a6981e117c9ae936"} Jun 12 18:31:15.356725 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.356699 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-j7n2c" event={"ID":"22e07909-8555-4f40-86b1-d97e1e5e5e4f","Type":"ContainerStarted","Data":"56964450625b9ed30a0fb8365a6bb7d840d449aca384909274b92ebdf295179f"} Jun 12 18:31:15.358163 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.358138 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hmn94" event={"ID":"ca9f855a-4e2c-45fe-b3b0-531b67863c31","Type":"ContainerStarted","Data":"7359c5ccd26ab25f88bb5450f45d36f1079b66cc72004e9afced22e10a0503e6"} Jun 12 18:31:15.359663 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.359642 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-f2xrr" event={"ID":"f1cccbad-7ec4-46dc-8eac-5c1207d77342","Type":"ContainerStarted","Data":"967466f06912d583dce72fcbf06cd21e1702f44feb25ba7e990565859759d2ba"} Jun 12 18:31:15.362545 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.362522 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:31:15.362857 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.362830 2561 generic.go:356] "Generic (PLEG): container finished" podID="02ecfda6-cc62-41e6-8d42-2bb93795ba27" containerID="a30192ac34b9278ca59af7030a3457098ca79669900a8f62bbab4df0172db1fe" exitCode=1 Jun 12 18:31:15.362941 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.362897 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"23783403bd549c1cd4cb77e4bd7c76581c0c0cd6382fdfa7de0737445a156996"} Jun 12 18:31:15.362999 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.362950 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"10b82888d89784016cd835103c7870b004cd8c6fe0fffc5fc526572fb3bbc14f"} Jun 12 18:31:15.362999 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.362995 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"e9dacbd1cafa56c17e9aadf6f39fbd27f06c8f54c652934629c0aae0eeb2abe5"} Jun 12 18:31:15.363105 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.363031 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"3cf782700fa99bff6046e2f737bd401f9ef593d4c11f85249282c05f9ae58d7c"} Jun 12 18:31:15.363105 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.363058 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerDied","Data":"a30192ac34b9278ca59af7030a3457098ca79669900a8f62bbab4df0172db1fe"} Jun 12 18:31:15.363105 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.363094 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"acfdc7d8f38ea4960c2fbb92cd838ecb23f7f52511509d0bbc2b8f3945ff7938"} Jun 12 18:31:15.364275 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.364255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" event={"ID":"c1028b63-7efb-40ed-a86b-4d5fed90e2b5","Type":"ContainerStarted","Data":"444244750d7e97029a7b8ebbe7fdfffa4ca0a66379b2abd424b4ed0f2d44caa7"} Jun 12 18:31:15.365688 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.365663 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-btmjg" event={"ID":"b023889a-3206-4b10-a251-629bb1837618","Type":"ContainerStarted","Data":"95b011bb3a2dd42dfa9dd18ea785ac39953a3b8b41496819731cd51d9c076b33"} Jun 12 18:31:15.379282 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.379245 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-4.ec2.internal" podStartSLOduration=21.379233592 podStartE2EDuration="21.379233592s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:30:58.357539375 +0000 UTC m=+5.557492466" watchObservedRunningTime="2026-06-12 18:31:15.379233592 +0000 UTC m=+22.579186643" Jun 12 18:31:15.399559 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.399509 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-mqvgf" podStartSLOduration=3.916341042 podStartE2EDuration="22.399497627s" totalImagesPullingTime="18.483156585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:15.39897465 +0000 UTC m=+22.598927713" watchObservedRunningTime="2026-06-12 18:31:15.399497627 +0000 UTC m=+22.599450671" Jun 12 18:31:15.416908 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.416870 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-f2xrr" podStartSLOduration=12.240191014 podStartE2EDuration="22.416857701s" totalImagesPullingTime="10.176666687s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:15.416644188 +0000 UTC m=+22.616597239" watchObservedRunningTime="2026-06-12 18:31:15.416857701 +0000 UTC m=+22.616810753" Jun 12 18:31:15.432327 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.432284 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-btmjg" podStartSLOduration=3.950757917 podStartE2EDuration="22.432271608s" totalImagesPullingTime="18.481513691s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:15.431835166 +0000 UTC m=+22.631788217" watchObservedRunningTime="2026-06-12 18:31:15.432271608 +0000 UTC m=+22.632224658" Jun 12 18:31:15.450956 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.450919 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hmn94" podStartSLOduration=3.911499746 podStartE2EDuration="22.450907031s" totalImagesPullingTime="18.539407285s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:15.450555918 +0000 UTC m=+22.650508988" watchObservedRunningTime="2026-06-12 18:31:15.450907031 +0000 UTC m=+22.650860083" Jun 12 18:31:15.466385 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:15.466343 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-j7n2c" podStartSLOduration=3.977375125 podStartE2EDuration="22.46633107s" totalImagesPullingTime="18.488955945s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:15.465868832 +0000 UTC m=+22.665821905" watchObservedRunningTime="2026-06-12 18:31:15.46633107 +0000 UTC m=+22.666284120" Jun 12 18:31:16.285506 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:16.285464 2561 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 18:31:16.370175 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:16.370139 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jqtw6" event={"ID":"e7ee1c59-97c8-489c-aab3-e295eb40cc4f","Type":"ContainerStarted","Data":"0bfc2ac26a59b2188e7907b89918ed92c46a4191da48117cfa628d4a8772f840"} Jun 12 18:31:16.372201 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:16.372174 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" event={"ID":"af716ce5-9dae-4121-aede-2a87fb283327","Type":"ContainerStarted","Data":"f9ac6092cf27c5c0eac7245c6eff01ed71dd0b625d5a890a2430a9f00d712b35"} Jun 12 18:31:16.389643 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:16.389593 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jqtw6" podStartSLOduration=4.901152615 podStartE2EDuration="23.389578969s" totalImagesPullingTime="18.488426354s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:16.389456168 +0000 UTC m=+23.589409223" watchObservedRunningTime="2026-06-12 18:31:16.389578969 +0000 UTC m=+23.589531997" Jun 12 18:31:17.270689 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.270665 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:17.270689 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.270686 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:17.270888 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:17.270774 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:17.271094 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:17.271072 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:17.271180 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.271129 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:17.271235 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:17.271193 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:17.272658 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.272568 2561 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T18:31:16.285502746Z","UUID":"1b148a13-9ebe-425f-952b-9a1b799c6f72","Handler":null,"Name":"","Endpoint":""} Jun 12 18:31:17.274432 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.274412 2561 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 18:31:17.274535 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.274448 2561 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 18:31:17.377064 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.377039 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" event={"ID":"af716ce5-9dae-4121-aede-2a87fb283327","Type":"ContainerStarted","Data":"adeb0c89590677bf860c34f3b4535690d1bc6cd75957b45117dbb1a2146e2b1d"} Jun 12 18:31:17.399198 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:17.399139 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-l8gvx" podStartSLOduration=3.7710688919999997 podStartE2EDuration="24.399120346s" totalImagesPullingTime="20.628051454s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:17.398881178 +0000 UTC m=+24.598834230" watchObservedRunningTime="2026-06-12 18:31:17.399120346 +0000 UTC m=+24.599073398" Jun 12 18:31:18.381706 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:18.381541 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:31:18.382095 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:18.382039 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"dbdc5d7f4bbf86e9f221e6ce145f064d5b4ef113187fbd2250c571822ac83bdf"} Jun 12 18:31:18.637160 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:18.637084 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:31:18.637663 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:18.637646 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:31:19.270613 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:19.270573 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:19.270807 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:19.270573 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:19.270807 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:19.270703 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:19.270807 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:19.270587 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:19.270807 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:19.270762 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:19.271009 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:19.270866 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:19.384747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:19.384716 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:31:19.385218 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:19.385202 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-f2xrr" Jun 12 18:31:20.390751 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:20.390586 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:31:20.391710 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:20.391217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"0e1730caafd16eb6c0e732f8e88f2b2bc88f978fc397369801ed6db4bceefadf"} Jun 12 18:31:20.391710 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:20.391635 2561 scope.go:117] "RemoveContainer" containerID="a30192ac34b9278ca59af7030a3457098ca79669900a8f62bbab4df0172db1fe" Jun 12 18:31:21.271699 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.271667 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:21.271875 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.271670 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:21.271875 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:21.271784 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:21.271986 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:21.271872 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:21.271986 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.271960 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:21.272085 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:21.272041 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:21.777189 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.777157 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hx5qr"] Jun 12 18:31:21.777666 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.777272 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:21.777666 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:21.777393 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:21.780441 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.780377 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jt2gw"] Jun 12 18:31:21.780598 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.780488 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:21.780598 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:21.780571 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:21.781145 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.781120 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rvspg"] Jun 12 18:31:21.781253 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:21.781198 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:21.781317 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:21.781286 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:22.399115 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.399039 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:31:22.399427 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.399405 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" event={"ID":"02ecfda6-cc62-41e6-8d42-2bb93795ba27","Type":"ContainerStarted","Data":"f48931e98d583ea469bd6ea38ed5a2775ec1a44441df9b5349086fa439c5b95b"} Jun 12 18:31:22.399739 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.399715 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:31:22.399871 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.399788 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:31:22.399871 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.399834 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:31:22.401304 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.401279 2561 generic.go:356] "Generic (PLEG): container finished" podID="e010037a-6a90-4583-a287-0a2f71c385de" containerID="1b15aa417781560b7f8ca767533d73f0da21398e9ef64139be13f62fac88b7f1" exitCode=0 Jun 12 18:31:22.401403 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.401324 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerDied","Data":"1b15aa417781560b7f8ca767533d73f0da21398e9ef64139be13f62fac88b7f1"} Jun 12 18:31:22.414908 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.414884 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:31:22.415092 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.415081 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:31:22.504746 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:22.504695 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" podStartSLOduration=10.927499247 podStartE2EDuration="29.504680729s" totalImagesPullingTime="18.577181482s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:22.449844656 +0000 UTC m=+29.649797726" watchObservedRunningTime="2026-06-12 18:31:22.504680729 +0000 UTC m=+29.704633774" Jun 12 18:31:23.271382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:23.271352 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:23.271900 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:23.271447 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:23.271900 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:23.271456 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:23.271900 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:23.271577 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:23.271900 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:23.271572 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:23.271900 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:23.271665 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:24.407648 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:24.407429 2561 generic.go:356] "Generic (PLEG): container finished" podID="e010037a-6a90-4583-a287-0a2f71c385de" containerID="0e59c5c04ef93cafb681b0866dec97115dd45aea5f07b4f82ffb7ad6382f26f4" exitCode=0 Jun 12 18:31:24.408164 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:24.407516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerDied","Data":"0e59c5c04ef93cafb681b0866dec97115dd45aea5f07b4f82ffb7ad6382f26f4"} Jun 12 18:31:24.423912 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:24.423871 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" podUID="02ecfda6-cc62-41e6-8d42-2bb93795ba27" containerName="ovnkube-controller" probeResult="failure" output="" Jun 12 18:31:25.270558 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:25.270531 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:25.270558 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:25.270548 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:25.270800 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:25.270531 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:25.270800 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:25.270641 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:25.270800 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:25.270714 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:25.270800 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:25.270777 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:26.414897 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:26.414865 2561 generic.go:356] "Generic (PLEG): container finished" podID="e010037a-6a90-4583-a287-0a2f71c385de" containerID="46f7f31596115dc5c78c3c2cb125a3815f274385c9381c130cc7011f56eee34a" exitCode=0 Jun 12 18:31:26.415658 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:26.414937 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerDied","Data":"46f7f31596115dc5c78c3c2cb125a3815f274385c9381c130cc7011f56eee34a"} Jun 12 18:31:26.971929 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:26.971897 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:26.972123 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:26.971936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:26.972123 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:26.972044 2561 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:26.972123 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:26.972048 2561 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:26.972123 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:26.972114 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret podName:236a8efa-2ef3-4ddb-9c11-95e34b5bb32f nodeName:}" failed. No retries permitted until 2026-06-12 18:31:58.972094663 +0000 UTC m=+66.172047698 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret") pod "global-pull-secret-syncer-hx5qr" (UID: "236a8efa-2ef3-4ddb-9c11-95e34b5bb32f") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:31:26.972303 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:26.972128 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs podName:79883943-cedb-4352-bf3d-05b99afe7224 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:58.972121431 +0000 UTC m=+66.172074460 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs") pod "network-metrics-daemon-rvspg" (UID: "79883943-cedb-4352-bf3d-05b99afe7224") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:31:27.073106 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.073080 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:27.073271 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.073248 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:31:27.073271 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.073267 2561 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:31:27.073355 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.073276 2561 projected.go:196] Error preparing data for projected volume kube-api-access-mjqdx for pod openshift-network-diagnostics/network-check-target-jt2gw: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:27.073355 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.073333 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx podName:4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae nodeName:}" failed. No retries permitted until 2026-06-12 18:31:59.073318426 +0000 UTC m=+66.273271454 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mjqdx" (UniqueName: "kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx") pod "network-check-target-jt2gw" (UID: "4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:31:27.271659 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.271574 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:27.271822 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.271579 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:27.271822 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.271686 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-jt2gw" podUID="4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae" Jun 12 18:31:27.271822 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.271760 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rvspg" podUID="79883943-cedb-4352-bf3d-05b99afe7224" Jun 12 18:31:27.271822 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.271799 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:27.272028 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.271862 2561 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-hx5qr" podUID="236a8efa-2ef3-4ddb-9c11-95e34b5bb32f" Jun 12 18:31:27.663981 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.663954 2561 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-4.ec2.internal" event="NodeReady" Jun 12 18:31:27.664347 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.664079 2561 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 18:31:27.700071 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.700043 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-545dd4fb89-4mzl6"] Jun 12 18:31:27.723270 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.723239 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kmdqs"] Jun 12 18:31:27.723445 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.723357 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.726220 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.726197 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 18:31:27.726620 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.726602 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-9fgg9\"" Jun 12 18:31:27.726772 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.726758 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 18:31:27.727110 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.727096 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 18:31:27.734765 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.734741 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 18:31:27.741520 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.741500 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qc6mc"] Jun 12 18:31:27.741612 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.741564 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:27.746633 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.746253 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 18:31:27.746633 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.746279 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 18:31:27.746633 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.746341 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 18:31:27.746633 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.746515 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-nflgq\"" Jun 12 18:31:27.763983 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.763958 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-545dd4fb89-4mzl6"] Jun 12 18:31:27.763983 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.763994 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kmdqs"] Jun 12 18:31:27.764161 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.764012 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qc6mc"] Jun 12 18:31:27.764161 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.764094 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.766852 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.766722 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-45p5c\"" Jun 12 18:31:27.766852 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.766721 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 18:31:27.767023 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.766854 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 18:31:27.879141 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-trusted-ca\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879141 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879143 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-bound-sa-token\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879175 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gngn\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-kube-api-access-8gngn\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879208 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879229 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf8239d-3790-466b-9dd8-df9f5181a109-config-volume\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.879388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879324 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-installation-pull-secrets\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9b0415d-b61b-4f50-9192-ba6fda231e3a-ca-trust-extracted\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879410 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db6b1a0-efdd-468a-9248-ec9ee933f106-cert\") pod \"ingress-canary-kmdqs\" (UID: \"7db6b1a0-efdd-468a-9248-ec9ee933f106\") " pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879436 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5bhrt\" (UniqueName: \"kubernetes.io/projected/7db6b1a0-efdd-468a-9248-ec9ee933f106-kube-api-access-5bhrt\") pod \"ingress-canary-kmdqs\" (UID: \"7db6b1a0-efdd-468a-9248-ec9ee933f106\") " pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879458 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6sc4\" (UniqueName: \"kubernetes.io/projected/bbf8239d-3790-466b-9dd8-df9f5181a109-kube-api-access-m6sc4\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879502 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-image-registry-private-configuration\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879545 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-certificates\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879576 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.879625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.879600 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbf8239d-3790-466b-9dd8-df9f5181a109-tmp-dir\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.980286 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-trusted-ca\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.980286 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980240 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-bound-sa-token\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.980524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980505 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gngn\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-kube-api-access-8gngn\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.980601 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980586 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.980657 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980610 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf8239d-3790-466b-9dd8-df9f5181a109-config-volume\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.980657 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980651 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-installation-pull-secrets\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.980762 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9b0415d-b61b-4f50-9192-ba6fda231e3a-ca-trust-extracted\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.980762 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980705 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db6b1a0-efdd-468a-9248-ec9ee933f106-cert\") pod \"ingress-canary-kmdqs\" (UID: \"7db6b1a0-efdd-468a-9248-ec9ee933f106\") " pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:27.980762 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980733 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5bhrt\" (UniqueName: \"kubernetes.io/projected/7db6b1a0-efdd-468a-9248-ec9ee933f106-kube-api-access-5bhrt\") pod \"ingress-canary-kmdqs\" (UID: \"7db6b1a0-efdd-468a-9248-ec9ee933f106\") " pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:27.980762 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.980708 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:31:27.980911 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.980776 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545dd4fb89-4mzl6: secret "image-registry-tls" not found Jun 12 18:31:27.980911 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.980846 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls podName:b9b0415d-b61b-4f50-9192-ba6fda231e3a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:28.480825965 +0000 UTC m=+35.680778994 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls") pod "image-registry-545dd4fb89-4mzl6" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a") : secret "image-registry-tls" not found Jun 12 18:31:27.980987 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980758 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6sc4\" (UniqueName: \"kubernetes.io/projected/bbf8239d-3790-466b-9dd8-df9f5181a109-kube-api-access-m6sc4\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.981026 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.980998 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-image-registry-private-configuration\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.981058 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981034 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-certificates\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.981090 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981060 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.981122 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981087 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbf8239d-3790-466b-9dd8-df9f5181a109-tmp-dir\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.981593 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bbf8239d-3790-466b-9dd8-df9f5181a109-config-volume\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.981593 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.981343 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:27.981593 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981382 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-trusted-ca\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.981593 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981403 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bbf8239d-3790-466b-9dd8-df9f5181a109-tmp-dir\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.981593 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:27.981392 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls podName:bbf8239d-3790-466b-9dd8-df9f5181a109 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:28.481373559 +0000 UTC m=+35.681326600 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls") pod "dns-default-qc6mc" (UID: "bbf8239d-3790-466b-9dd8-df9f5181a109") : secret "dns-default-metrics-tls" not found Jun 12 18:31:27.981593 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981545 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9b0415d-b61b-4f50-9192-ba6fda231e3a-ca-trust-extracted\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.982091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.981719 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-certificates\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.985499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.985295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-image-registry-private-configuration\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.985499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.985306 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7db6b1a0-efdd-468a-9248-ec9ee933f106-cert\") pod \"ingress-canary-kmdqs\" (UID: \"7db6b1a0-efdd-468a-9248-ec9ee933f106\") " pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:27.985499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.985457 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-installation-pull-secrets\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.989168 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.989144 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-bound-sa-token\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.989982 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.989960 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gngn\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-kube-api-access-8gngn\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:27.990874 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.990851 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6sc4\" (UniqueName: \"kubernetes.io/projected/bbf8239d-3790-466b-9dd8-df9f5181a109-kube-api-access-m6sc4\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:27.991296 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:27.991273 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5bhrt\" (UniqueName: \"kubernetes.io/projected/7db6b1a0-efdd-468a-9248-ec9ee933f106-kube-api-access-5bhrt\") pod \"ingress-canary-kmdqs\" (UID: \"7db6b1a0-efdd-468a-9248-ec9ee933f106\") " pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:28.052287 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:28.052257 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kmdqs" Jun 12 18:31:28.295374 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:28.295100 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kmdqs"] Jun 12 18:31:28.299757 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:31:28.299728 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db6b1a0_efdd_468a_9248_ec9ee933f106.slice/crio-3283479e3a98a744d48fa4107cda63fd42798cc17e612c4a6013b6c0340a7776 WatchSource:0}: Error finding container 3283479e3a98a744d48fa4107cda63fd42798cc17e612c4a6013b6c0340a7776: Status 404 returned error can't find the container with id 3283479e3a98a744d48fa4107cda63fd42798cc17e612c4a6013b6c0340a7776 Jun 12 18:31:28.420335 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:28.420293 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kmdqs" event={"ID":"7db6b1a0-efdd-468a-9248-ec9ee933f106","Type":"ContainerStarted","Data":"3283479e3a98a744d48fa4107cda63fd42798cc17e612c4a6013b6c0340a7776"} Jun 12 18:31:28.484505 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:28.484461 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:28.484694 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:28.484547 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:28.484694 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:28.484628 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:31:28.484694 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:28.484650 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545dd4fb89-4mzl6: secret "image-registry-tls" not found Jun 12 18:31:28.484694 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:28.484673 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:28.484878 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:28.484717 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls podName:b9b0415d-b61b-4f50-9192-ba6fda231e3a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:29.484695767 +0000 UTC m=+36.684648796 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls") pod "image-registry-545dd4fb89-4mzl6" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a") : secret "image-registry-tls" not found Jun 12 18:31:28.484878 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:28.484734 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls podName:bbf8239d-3790-466b-9dd8-df9f5181a109 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:29.484725672 +0000 UTC m=+36.684678702 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls") pod "dns-default-qc6mc" (UID: "bbf8239d-3790-466b-9dd8-df9f5181a109") : secret "dns-default-metrics-tls" not found Jun 12 18:31:29.271171 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.271134 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:29.271747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.271141 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:29.271747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.271147 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:29.276117 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.274425 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:31:29.276117 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.274793 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:31:29.276117 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.275512 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:31:29.276117 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.275763 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-95v5g\"" Jun 12 18:31:29.276117 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.275901 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wglwb\"" Jun 12 18:31:29.276117 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.276062 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:31:29.493318 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.493283 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:29.493541 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:29.493338 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:29.493541 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:29.493408 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:31:29.493541 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:29.493430 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545dd4fb89-4mzl6: secret "image-registry-tls" not found Jun 12 18:31:29.493541 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:29.493447 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:29.493541 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:29.493517 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls podName:b9b0415d-b61b-4f50-9192-ba6fda231e3a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:31.493497099 +0000 UTC m=+38.693450151 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls") pod "image-registry-545dd4fb89-4mzl6" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a") : secret "image-registry-tls" not found Jun 12 18:31:29.493541 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:29.493537 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls podName:bbf8239d-3790-466b-9dd8-df9f5181a109 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:31.493528092 +0000 UTC m=+38.693481122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls") pod "dns-default-qc6mc" (UID: "bbf8239d-3790-466b-9dd8-df9f5181a109") : secret "dns-default-metrics-tls" not found Jun 12 18:31:31.261356 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.261321 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-g6gkk"] Jun 12 18:31:31.265506 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.265466 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.279801 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.279759 2561 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-rbac-proxy\" is forbidden: User \"system:node:ip-10-0-128-4.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-insights\": no relationship found between node 'ip-10-0-128-4.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" type="*v1.ConfigMap" Jun 12 18:31:31.280644 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.280623 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 18:31:31.280734 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.280626 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 18:31:31.280734 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.280626 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 18:31:31.280958 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.280945 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h7n2m\"" Jun 12 18:31:31.308069 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.308045 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g6gkk"] Jun 12 18:31:31.410088 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.410057 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mr7b\" (UniqueName: \"kubernetes.io/projected/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-api-access-5mr7b\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.410277 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.410121 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01a5532c-8a97-4979-b7dd-b81be0e17f56-data-volume\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.410277 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.410238 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01a5532c-8a97-4979-b7dd-b81be0e17f56-crio-socket\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.410379 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.410293 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.410379 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.410322 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511131 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511097 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:31.511222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511138 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01a5532c-8a97-4979-b7dd-b81be0e17f56-data-volume\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511185 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01a5532c-8a97-4979-b7dd-b81be0e17f56-crio-socket\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511216 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:31.511320 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.511231 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:31:31.511320 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511241 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511320 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.511251 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545dd4fb89-4mzl6: secret "image-registry-tls" not found Jun 12 18:31:31.511320 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511269 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511320 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.511320 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls podName:b9b0415d-b61b-4f50-9192-ba6fda231e3a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:35.51129965 +0000 UTC m=+42.711252700 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls") pod "image-registry-545dd4fb89-4mzl6" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a") : secret "image-registry-tls" not found Jun 12 18:31:31.511464 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511363 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mr7b\" (UniqueName: \"kubernetes.io/projected/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-api-access-5mr7b\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511464 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.511374 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:31.511464 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511385 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/01a5532c-8a97-4979-b7dd-b81be0e17f56-crio-socket\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511464 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.511421 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:32.011405983 +0000 UTC m=+39.211359020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:31.511464 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.511437 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/01a5532c-8a97-4979-b7dd-b81be0e17f56-data-volume\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:31.511639 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.511491 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:31.511639 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:31.511542 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls podName:bbf8239d-3790-466b-9dd8-df9f5181a109 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:35.511528263 +0000 UTC m=+42.711481297 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls") pod "dns-default-qc6mc" (UID: "bbf8239d-3790-466b-9dd8-df9f5181a109") : secret "dns-default-metrics-tls" not found Jun 12 18:31:31.532259 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:31.532111 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mr7b\" (UniqueName: \"kubernetes.io/projected/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-api-access-5mr7b\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:32.014753 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:32.014559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:32.014944 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:32.014712 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:32.014944 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:32.014840 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:33.014826211 +0000 UTC m=+40.214779245 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:32.424231 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:32.424206 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 18:31:32.431558 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:32.431539 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:32.431680 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:32.431600 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:32.931585375 +0000 UTC m=+40.131538415 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : configmap "kube-rbac-proxy" not found Jun 12 18:31:32.432676 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:32.432654 2561 generic.go:356] "Generic (PLEG): container finished" podID="e010037a-6a90-4583-a287-0a2f71c385de" containerID="58b8d9c109435f7a08a3baf57a978b27190dacde129bed9850340cbe674eb728" exitCode=0 Jun 12 18:31:32.432775 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:32.432736 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerDied","Data":"58b8d9c109435f7a08a3baf57a978b27190dacde129bed9850340cbe674eb728"} Jun 12 18:31:32.434071 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:32.434053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kmdqs" event={"ID":"7db6b1a0-efdd-468a-9248-ec9ee933f106","Type":"ContainerStarted","Data":"5896cc718a99f802a35d25434f9fa7525c08e64007da9f611408f8659ed65a57"} Jun 12 18:31:32.482534 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:32.482464 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kmdqs" podStartSLOduration=2.369410991 podStartE2EDuration="5.482444156s" totalImagesPullingTime="3.113033165s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:32.481831153 +0000 UTC m=+39.681784206" watchObservedRunningTime="2026-06-12 18:31:32.482444156 +0000 UTC m=+39.682397210" Jun 12 18:31:32.946121 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:32.946094 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7n2c_22e07909-8555-4f40-86b1-d97e1e5e5e4f/dns-node-resolver/0.log" Jun 12 18:31:33.024119 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:33.024084 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:33.024119 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:33.024121 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:33.024401 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:33.024212 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:33.024401 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:33.024251 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:33.024401 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:33.024276 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:34.024259987 +0000 UTC m=+41.224213016 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : configmap "kube-rbac-proxy" not found Jun 12 18:31:33.024401 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:33.024302 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:35.024286868 +0000 UTC m=+42.224239901 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:33.439219 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:33.439187 2561 generic.go:356] "Generic (PLEG): container finished" podID="e010037a-6a90-4583-a287-0a2f71c385de" containerID="1c997d04fc03bfec641cc8890187e847c7c96f7530e5f980c732fd6e7ce046c5" exitCode=0 Jun 12 18:31:33.439674 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:33.439277 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerDied","Data":"1c997d04fc03bfec641cc8890187e847c7c96f7530e5f980c732fd6e7ce046c5"} Jun 12 18:31:34.032263 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:34.032226 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:34.032470 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:34.032392 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:34.032568 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:34.032497 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:36.032450275 +0000 UTC m=+43.232403306 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : configmap "kube-rbac-proxy" not found Jun 12 18:31:34.146863 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:34.146839 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-btmjg_b023889a-3206-4b10-a251-629bb1837618/node-ca/0.log" Jun 12 18:31:34.444591 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:34.444556 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" event={"ID":"e010037a-6a90-4583-a287-0a2f71c385de","Type":"ContainerStarted","Data":"0a81b3710ffaff84394d528cbbf8453c6f8455571ba0a29a46b07827d967cb38"} Jun 12 18:31:34.470860 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:34.470812 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ld2ff" podStartSLOduration=9.174046937 podStartE2EDuration="41.470798244s" totalImagesPullingTime="32.296751307s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:34.469333188 +0000 UTC m=+41.669286239" watchObservedRunningTime="2026-06-12 18:31:34.470798244 +0000 UTC m=+41.670751295" Jun 12 18:31:34.946393 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:34.946366 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kmdqs_7db6b1a0-efdd-468a-9248-ec9ee933f106/serve-healthcheck-canary/0.log" Jun 12 18:31:35.038984 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:35.038948 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:35.039125 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:35.039105 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:35.039179 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:35.039169 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:39.03915317 +0000 UTC m=+46.239106210 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:35.544069 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:35.544012 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:35.544542 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:35.544103 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:35.544542 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:35.544229 2561 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:31:35.544542 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:35.544234 2561 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:31:35.544542 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:35.544254 2561 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-545dd4fb89-4mzl6: secret "image-registry-tls" not found Jun 12 18:31:35.544542 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:35.544296 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls podName:bbf8239d-3790-466b-9dd8-df9f5181a109 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:43.544279753 +0000 UTC m=+50.744232782 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls") pod "dns-default-qc6mc" (UID: "bbf8239d-3790-466b-9dd8-df9f5181a109") : secret "dns-default-metrics-tls" not found Jun 12 18:31:35.544542 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:35.544310 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls podName:b9b0415d-b61b-4f50-9192-ba6fda231e3a nodeName:}" failed. No retries permitted until 2026-06-12 18:31:43.54430459 +0000 UTC m=+50.744257619 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls") pod "image-registry-545dd4fb89-4mzl6" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a") : secret "image-registry-tls" not found Jun 12 18:31:36.047655 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:36.047606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:36.047833 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:36.047736 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:36.047870 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:36.047834 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:40.047817373 +0000 UTC m=+47.247770421 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : configmap "kube-rbac-proxy" not found Jun 12 18:31:39.069137 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:39.069094 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:39.069521 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:39.069238 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:39.069521 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:39.069312 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:47.069297162 +0000 UTC m=+54.269250192 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:40.077470 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:40.077433 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:40.077857 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:40.077559 2561 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:31:40.077857 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:40.077635 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:48.077619074 +0000 UTC m=+55.277572119 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : configmap "kube-rbac-proxy" not found Jun 12 18:31:43.608114 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.608075 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:43.608587 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.608140 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:43.610757 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.610733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"image-registry-545dd4fb89-4mzl6\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:43.610856 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.610766 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bbf8239d-3790-466b-9dd8-df9f5181a109-metrics-tls\") pod \"dns-default-qc6mc\" (UID: \"bbf8239d-3790-466b-9dd8-df9f5181a109\") " pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:43.634917 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.634884 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:43.673699 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.673668 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:43.782542 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.782509 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-545dd4fb89-4mzl6"] Jun 12 18:31:43.785956 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:31:43.785929 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9b0415d_b61b_4f50_9192_ba6fda231e3a.slice/crio-b64147e917f1069bc1c6f68a491ec4e7a47086e89e73d079333c75d41a71a05d WatchSource:0}: Error finding container b64147e917f1069bc1c6f68a491ec4e7a47086e89e73d079333c75d41a71a05d: Status 404 returned error can't find the container with id b64147e917f1069bc1c6f68a491ec4e7a47086e89e73d079333c75d41a71a05d Jun 12 18:31:43.811795 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:43.811772 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qc6mc"] Jun 12 18:31:43.814752 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:31:43.814726 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbf8239d_3790_466b_9dd8_df9f5181a109.slice/crio-776b6584aabe02d07a141e5d4422e049dfda72dc774129f8be3f3afd0349dc41 WatchSource:0}: Error finding container 776b6584aabe02d07a141e5d4422e049dfda72dc774129f8be3f3afd0349dc41: Status 404 returned error can't find the container with id 776b6584aabe02d07a141e5d4422e049dfda72dc774129f8be3f3afd0349dc41 Jun 12 18:31:44.469228 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:44.469186 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qc6mc" event={"ID":"bbf8239d-3790-466b-9dd8-df9f5181a109","Type":"ContainerStarted","Data":"776b6584aabe02d07a141e5d4422e049dfda72dc774129f8be3f3afd0349dc41"} Jun 12 18:31:44.470953 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:44.470916 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" event={"ID":"b9b0415d-b61b-4f50-9192-ba6fda231e3a","Type":"ContainerStarted","Data":"6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79"} Jun 12 18:31:44.471091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:44.470962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" event={"ID":"b9b0415d-b61b-4f50-9192-ba6fda231e3a","Type":"ContainerStarted","Data":"b64147e917f1069bc1c6f68a491ec4e7a47086e89e73d079333c75d41a71a05d"} Jun 12 18:31:44.471160 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:44.471105 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:31:44.509354 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:44.509156 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" podStartSLOduration=52.509138432 podStartE2EDuration="52.509138432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:30:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:44.508980094 +0000 UTC m=+51.708933147" watchObservedRunningTime="2026-06-12 18:31:44.509138432 +0000 UTC m=+51.709091484" Jun 12 18:31:47.133844 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:47.133811 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:47.134221 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:47.133965 2561 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:31:47.134221 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:31:47.134031 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls podName:01a5532c-8a97-4979-b7dd-b81be0e17f56 nodeName:}" failed. No retries permitted until 2026-06-12 18:32:03.134015073 +0000 UTC m=+70.333968102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls") pod "insights-runtime-extractor-g6gkk" (UID: "01a5532c-8a97-4979-b7dd-b81be0e17f56") : secret "insights-runtime-extractor-tls" not found Jun 12 18:31:47.479991 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:47.479951 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qc6mc" event={"ID":"bbf8239d-3790-466b-9dd8-df9f5181a109","Type":"ContainerStarted","Data":"f8bf09887e0eaff3ba3cef1f9a91492b302b71aa2cb9ee03ab5866e79b0b0689"} Jun 12 18:31:47.480163 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:47.480011 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qc6mc" event={"ID":"bbf8239d-3790-466b-9dd8-df9f5181a109","Type":"ContainerStarted","Data":"90a0dc6ad897cf6d413842a8d38be6b79ac380104413bea5be7e4475fc9243fa"} Jun 12 18:31:47.480163 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:47.480092 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:47.503059 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:47.503010 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qc6mc" podStartSLOduration=17.603390718 podStartE2EDuration="20.502995016s" totalImagesPullingTime="2.899604298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:47.502454618 +0000 UTC m=+54.702407669" watchObservedRunningTime="2026-06-12 18:31:47.502995016 +0000 UTC m=+54.702948115" Jun 12 18:31:48.141601 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:48.141562 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:48.142256 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:48.142231 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/01a5532c-8a97-4979-b7dd-b81be0e17f56-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:31:54.418152 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:54.418122 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-vl785" Jun 12 18:31:55.452409 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.452368 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8"] Jun 12 18:31:55.497658 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.497622 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989"] Jun 12 18:31:55.497828 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.497762 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.502365 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.502336 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 18:31:55.502514 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.502391 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 18:31:55.503096 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.503078 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 18:31:55.503854 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.503835 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 18:31:55.504321 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.504056 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-t9b59\"" Jun 12 18:31:55.511024 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.511003 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8"] Jun 12 18:31:55.511120 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.511031 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989"] Jun 12 18:31:55.511178 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.511124 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.513358 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.513342 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 12 18:31:55.594779 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.594746 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b64d77f8-v9dr8\" (UID: \"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.594779 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.594778 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-tmp\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.594973 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.594855 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnm8z\" (UniqueName: \"kubernetes.io/projected/f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad-kube-api-access-jnm8z\") pod \"managed-serviceaccount-addon-agent-86b64d77f8-v9dr8\" (UID: \"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.594973 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.594881 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.594973 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.594905 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krppq\" (UniqueName: \"kubernetes.io/projected/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-kube-api-access-krppq\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.604031 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.604000 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-545dd4fb89-4mzl6"] Jun 12 18:31:55.658104 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.658072 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69c88697f7-2vbw7"] Jun 12 18:31:55.682984 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.682960 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69c88697f7-2vbw7"] Jun 12 18:31:55.683149 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.683085 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.695871 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.695850 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b64d77f8-v9dr8\" (UID: \"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.695976 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.695875 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-tmp\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.695976 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.695923 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnm8z\" (UniqueName: \"kubernetes.io/projected/f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad-kube-api-access-jnm8z\") pod \"managed-serviceaccount-addon-agent-86b64d77f8-v9dr8\" (UID: \"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.695976 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.695942 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.695976 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.695957 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krppq\" (UniqueName: \"kubernetes.io/projected/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-kube-api-access-krppq\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.696292 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.696252 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-tmp\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.698306 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.698286 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-klusterlet-config\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.698887 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.698870 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-86b64d77f8-v9dr8\" (UID: \"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.715115 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.715063 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnm8z\" (UniqueName: \"kubernetes.io/projected/f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad-kube-api-access-jnm8z\") pod \"managed-serviceaccount-addon-agent-86b64d77f8-v9dr8\" (UID: \"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.718633 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.718612 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-krppq\" (UniqueName: \"kubernetes.io/projected/1dd8ba81-5808-44e7-a74a-3edf3e6993b1-kube-api-access-krppq\") pod \"klusterlet-addon-workmgr-5bd6879f59-wt989\" (UID: \"1dd8ba81-5808-44e7-a74a-3edf3e6993b1\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.797021 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.796982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9402b82-9ea5-4fc2-9ecb-54d085c25352-installation-pull-secrets\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.797188 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.797098 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9402b82-9ea5-4fc2-9ecb-54d085c25352-image-registry-private-configuration\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.797188 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.797127 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5qtrz\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-kube-api-access-5qtrz\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.797188 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.797145 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-bound-sa-token\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.797511 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.797253 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-registry-tls\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.797764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.797729 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9402b82-9ea5-4fc2-9ecb-54d085c25352-registry-certificates\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.800587 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.797791 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9402b82-9ea5-4fc2-9ecb-54d085c25352-ca-trust-extracted\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.800587 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.798251 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9402b82-9ea5-4fc2-9ecb-54d085c25352-trusted-ca\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.817352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.817333 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" Jun 12 18:31:55.825083 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.825062 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:31:55.899693 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.899662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9402b82-9ea5-4fc2-9ecb-54d085c25352-ca-trust-extracted\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.899859 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.899707 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9402b82-9ea5-4fc2-9ecb-54d085c25352-trusted-ca\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.899859 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.899773 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9402b82-9ea5-4fc2-9ecb-54d085c25352-installation-pull-secrets\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.900192 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.900095 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9402b82-9ea5-4fc2-9ecb-54d085c25352-image-registry-private-configuration\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.900192 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.900162 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5qtrz\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-kube-api-access-5qtrz\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.900192 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.900180 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f9402b82-9ea5-4fc2-9ecb-54d085c25352-ca-trust-extracted\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.900192 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.900194 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-bound-sa-token\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.900443 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.900253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-registry-tls\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.900443 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.900306 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9402b82-9ea5-4fc2-9ecb-54d085c25352-registry-certificates\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.901065 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.901037 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f9402b82-9ea5-4fc2-9ecb-54d085c25352-trusted-ca\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.901190 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.901133 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f9402b82-9ea5-4fc2-9ecb-54d085c25352-registry-certificates\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.904881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.904295 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f9402b82-9ea5-4fc2-9ecb-54d085c25352-image-registry-private-configuration\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.904881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.904323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-registry-tls\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.904881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.904399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f9402b82-9ea5-4fc2-9ecb-54d085c25352-installation-pull-secrets\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.912365 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.912340 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-bound-sa-token\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.912744 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.912711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5qtrz\" (UniqueName: \"kubernetes.io/projected/f9402b82-9ea5-4fc2-9ecb-54d085c25352-kube-api-access-5qtrz\") pod \"image-registry-69c88697f7-2vbw7\" (UID: \"f9402b82-9ea5-4fc2-9ecb-54d085c25352\") " pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:55.966831 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.966744 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8"] Jun 12 18:31:55.970788 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:31:55.970762 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf1ad4d99_0411_4584_b9da_c8cb7e5fc1ad.slice/crio-f17821f8174c571bd2b961dd3d693b1fe6699c56ef9ad80b639b67b7de127648 WatchSource:0}: Error finding container f17821f8174c571bd2b961dd3d693b1fe6699c56ef9ad80b639b67b7de127648: Status 404 returned error can't find the container with id f17821f8174c571bd2b961dd3d693b1fe6699c56ef9ad80b639b67b7de127648 Jun 12 18:31:55.986449 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.986426 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989"] Jun 12 18:31:55.988591 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:31:55.988564 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd8ba81_5808_44e7_a74a_3edf3e6993b1.slice/crio-d588c79b7baf93dc075b42f9e84ae46912a943aa59bb72c55fde332d6f9d8bf0 WatchSource:0}: Error finding container d588c79b7baf93dc075b42f9e84ae46912a943aa59bb72c55fde332d6f9d8bf0: Status 404 returned error can't find the container with id d588c79b7baf93dc075b42f9e84ae46912a943aa59bb72c55fde332d6f9d8bf0 Jun 12 18:31:55.991815 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:55.991780 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:56.143796 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:56.143762 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69c88697f7-2vbw7"] Jun 12 18:31:56.146679 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:31:56.146656 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9402b82_9ea5_4fc2_9ecb_54d085c25352.slice/crio-f24d5cb4e7e3b2076a404e3d0808ff3e8884dfe1ed376c2bacfa39283a1f9215 WatchSource:0}: Error finding container f24d5cb4e7e3b2076a404e3d0808ff3e8884dfe1ed376c2bacfa39283a1f9215: Status 404 returned error can't find the container with id f24d5cb4e7e3b2076a404e3d0808ff3e8884dfe1ed376c2bacfa39283a1f9215 Jun 12 18:31:56.504885 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:56.504808 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" event={"ID":"1dd8ba81-5808-44e7-a74a-3edf3e6993b1","Type":"ContainerStarted","Data":"d588c79b7baf93dc075b42f9e84ae46912a943aa59bb72c55fde332d6f9d8bf0"} Jun 12 18:31:56.506416 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:56.506387 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" event={"ID":"f9402b82-9ea5-4fc2-9ecb-54d085c25352","Type":"ContainerStarted","Data":"255431f9e575c60789a65ab95c2a84a2f64b94122260b119ddf6a8b3d45a2275"} Jun 12 18:31:56.506566 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:56.506439 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:31:56.506566 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:56.506458 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" event={"ID":"f9402b82-9ea5-4fc2-9ecb-54d085c25352","Type":"ContainerStarted","Data":"f24d5cb4e7e3b2076a404e3d0808ff3e8884dfe1ed376c2bacfa39283a1f9215"} Jun 12 18:31:56.507490 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:56.507457 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" event={"ID":"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad","Type":"ContainerStarted","Data":"f17821f8174c571bd2b961dd3d693b1fe6699c56ef9ad80b639b67b7de127648"} Jun 12 18:31:56.528770 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:56.528718 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" podStartSLOduration=1.528704933 podStartE2EDuration="1.528704933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:56.528577413 +0000 UTC m=+63.728530465" watchObservedRunningTime="2026-06-12 18:31:56.528704933 +0000 UTC m=+63.728657974" Jun 12 18:31:57.485755 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:57.485513 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qc6mc" Jun 12 18:31:59.028626 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.028569 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:59.028626 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.028624 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:59.031524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.031499 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:31:59.031642 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.031544 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:31:59.041905 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.041878 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/236a8efa-2ef3-4ddb-9c11-95e34b5bb32f-original-pull-secret\") pod \"global-pull-secret-syncer-hx5qr\" (UID: \"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f\") " pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:59.042024 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.042010 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/79883943-cedb-4352-bf3d-05b99afe7224-metrics-certs\") pod \"network-metrics-daemon-rvspg\" (UID: \"79883943-cedb-4352-bf3d-05b99afe7224\") " pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:59.129066 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.129023 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:59.131945 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.131921 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:31:59.142794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.142773 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:31:59.153545 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.153522 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjqdx\" (UniqueName: \"kubernetes.io/projected/4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae-kube-api-access-mjqdx\") pod \"network-check-target-jt2gw\" (UID: \"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae\") " pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:31:59.290279 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.290211 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-95v5g\"" Jun 12 18:31:59.295685 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.295658 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-hx5qr" Jun 12 18:31:59.298794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.298774 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rvspg" Jun 12 18:31:59.304084 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.304060 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-wglwb\"" Jun 12 18:31:59.312505 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:31:59.312484 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:32:00.811511 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:00.811428 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rvspg"] Jun 12 18:32:00.815153 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:00.815128 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79883943_cedb_4352_bf3d_05b99afe7224.slice/crio-cf163d01054663b99e36f410a1906b503ae53d6d3b5e4c280b5a6b3e6c28fbff WatchSource:0}: Error finding container cf163d01054663b99e36f410a1906b503ae53d6d3b5e4c280b5a6b3e6c28fbff: Status 404 returned error can't find the container with id cf163d01054663b99e36f410a1906b503ae53d6d3b5e4c280b5a6b3e6c28fbff Jun 12 18:32:00.821037 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:00.820997 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-jt2gw"] Jun 12 18:32:00.824909 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:00.824860 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d6ecdf3_20a8_4ff9_b376_0f605a55d1ae.slice/crio-40380125274cee20482cdbc0d983920d3346c6a7e60869483e9ceaa5333241c4 WatchSource:0}: Error finding container 40380125274cee20482cdbc0d983920d3346c6a7e60869483e9ceaa5333241c4: Status 404 returned error can't find the container with id 40380125274cee20482cdbc0d983920d3346c6a7e60869483e9ceaa5333241c4 Jun 12 18:32:00.837020 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:00.836964 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-hx5qr"] Jun 12 18:32:00.842104 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:00.842075 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod236a8efa_2ef3_4ddb_9c11_95e34b5bb32f.slice/crio-d05ed80af2e47afedd651c3438b6662db35f00c7aad33d4e1b86a9ab847635e2 WatchSource:0}: Error finding container d05ed80af2e47afedd651c3438b6662db35f00c7aad33d4e1b86a9ab847635e2: Status 404 returned error can't find the container with id d05ed80af2e47afedd651c3438b6662db35f00c7aad33d4e1b86a9ab847635e2 Jun 12 18:32:01.528281 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.528219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" event={"ID":"1dd8ba81-5808-44e7-a74a-3edf3e6993b1","Type":"ContainerStarted","Data":"a3850c6ae487db19ec873408d4213d65b58fc23f624cb73e08fe402663869265"} Jun 12 18:32:01.528281 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.528285 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:32:01.530380 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.530184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvspg" event={"ID":"79883943-cedb-4352-bf3d-05b99afe7224","Type":"ContainerStarted","Data":"cf163d01054663b99e36f410a1906b503ae53d6d3b5e4c280b5a6b3e6c28fbff"} Jun 12 18:32:01.530545 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.530443 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" Jun 12 18:32:01.532433 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.532397 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" event={"ID":"f1ad4d99-0411-4584-b9da-c8cb7e5fc1ad","Type":"ContainerStarted","Data":"44de299f28817b4bf5f7583185674a6d418c1489b0d9d6b91bc9754500d5a6e4"} Jun 12 18:32:01.535915 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.535889 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jt2gw" event={"ID":"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae","Type":"ContainerStarted","Data":"40380125274cee20482cdbc0d983920d3346c6a7e60869483e9ceaa5333241c4"} Jun 12 18:32:01.537526 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.537448 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hx5qr" event={"ID":"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f","Type":"ContainerStarted","Data":"d05ed80af2e47afedd651c3438b6662db35f00c7aad33d4e1b86a9ab847635e2"} Jun 12 18:32:01.558381 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.558115 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-5bd6879f59-wt989" podStartSLOduration=1.884424195 podStartE2EDuration="6.558096345s" totalImagesPullingTime="4.67367215s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:01.556800894 +0000 UTC m=+68.756753959" watchObservedRunningTime="2026-06-12 18:32:01.558096345 +0000 UTC m=+68.758049400" Jun 12 18:32:01.598762 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:01.598312 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-86b64d77f8-v9dr8" podStartSLOduration=1.93275909 podStartE2EDuration="6.598289617s" totalImagesPullingTime="4.665530527s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:01.597401448 +0000 UTC m=+68.797354501" watchObservedRunningTime="2026-06-12 18:32:01.598289617 +0000 UTC m=+68.798242671" Jun 12 18:32:02.545564 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:02.545132 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvspg" event={"ID":"79883943-cedb-4352-bf3d-05b99afe7224","Type":"ContainerStarted","Data":"7ecd2739d03cd681d2346084ce5dc23143780066828b426623a483b0d16795bb"} Jun 12 18:32:02.545564 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:02.545188 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rvspg" event={"ID":"79883943-cedb-4352-bf3d-05b99afe7224","Type":"ContainerStarted","Data":"3995a10cf3b954e7fae797db12cc13f8543b14451971e5f804ca2201f393dc28"} Jun 12 18:32:02.563338 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:02.563287 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rvspg" podStartSLOduration=68.459501613 podStartE2EDuration="1m9.563270406s" totalImagesPullingTime="1.103768793s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:02.562203424 +0000 UTC m=+69.762156476" watchObservedRunningTime="2026-06-12 18:32:02.563270406 +0000 UTC m=+69.763223457" Jun 12 18:32:03.164459 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:03.164416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:32:03.167200 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:03.167168 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/01a5532c-8a97-4979-b7dd-b81be0e17f56-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-g6gkk\" (UID: \"01a5532c-8a97-4979-b7dd-b81be0e17f56\") " pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:32:03.377382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:03.377333 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-h7n2m\"" Jun 12 18:32:03.387152 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:03.387108 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-g6gkk" Jun 12 18:32:05.610375 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:05.610355 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:32:05.734552 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:05.734519 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-g6gkk"] Jun 12 18:32:05.738427 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:05.738398 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01a5532c_8a97_4979_b7dd_b81be0e17f56.slice/crio-441ce65c8e00a54aee40b7532346eae02b147caf942f9f7de41642091325a8f6 WatchSource:0}: Error finding container 441ce65c8e00a54aee40b7532346eae02b147caf942f9f7de41642091325a8f6: Status 404 returned error can't find the container with id 441ce65c8e00a54aee40b7532346eae02b147caf942f9f7de41642091325a8f6 Jun 12 18:32:06.561008 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:06.560971 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6gkk" event={"ID":"01a5532c-8a97-4979-b7dd-b81be0e17f56","Type":"ContainerStarted","Data":"441ce65c8e00a54aee40b7532346eae02b147caf942f9f7de41642091325a8f6"} Jun 12 18:32:06.562680 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:06.562651 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-jt2gw" event={"ID":"4d6ecdf3-20a8-4ff9-b376-0f605a55d1ae","Type":"ContainerStarted","Data":"36aa221f8d44f939b9540f9e963f54845b6d9184e67c2d1d8003f0af58cfd98c"} Jun 12 18:32:06.562815 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:06.562785 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:32:06.564285 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:06.564260 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-hx5qr" event={"ID":"236a8efa-2ef3-4ddb-9c11-95e34b5bb32f","Type":"ContainerStarted","Data":"523cca3d4f8f872380b8830cd8286b88e837901d4134cb137c9d398156fce99e"} Jun 12 18:32:06.605559 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:06.605497 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-jt2gw" podStartSLOduration=68.838621797 podStartE2EDuration="1m13.605455335s" totalImagesPullingTime="4.766833538s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:06.583252369 +0000 UTC m=+73.783205430" watchObservedRunningTime="2026-06-12 18:32:06.605455335 +0000 UTC m=+73.805408388" Jun 12 18:32:09.576263 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:09.576236 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6gkk" event={"ID":"01a5532c-8a97-4979-b7dd-b81be0e17f56","Type":"ContainerStarted","Data":"f50aa5a5564002b04e2adcf4f71e14bfadfe7f97180644c4509266bf725c069f"} Jun 12 18:32:10.581816 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:10.581777 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6gkk" event={"ID":"01a5532c-8a97-4979-b7dd-b81be0e17f56","Type":"ContainerStarted","Data":"11e8e60dc49a2c3e738ed719a1f155d4d96ffc3a2e7019fe45fba25ec62dca6e"} Jun 12 18:32:11.587305 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.587223 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-g6gkk" event={"ID":"01a5532c-8a97-4979-b7dd-b81be0e17f56","Type":"ContainerStarted","Data":"3ded37c91b703d8de9c7f5eeae5415ae7a138e630791c77a1534430b4c836b6d"} Jun 12 18:32:11.609721 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.609674 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-hx5qr" podStartSLOduration=73.854505647 podStartE2EDuration="1m18.60965828s" totalImagesPullingTime="4.755152633s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:30:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:06.605893714 +0000 UTC m=+73.805846766" watchObservedRunningTime="2026-06-12 18:32:11.60965828 +0000 UTC m=+78.809611338" Jun 12 18:32:11.610231 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.610207 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-g6gkk" podStartSLOduration=35.354282806 podStartE2EDuration="40.610197094s" totalImagesPullingTime="5.255914288s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:31:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:11.608563233 +0000 UTC m=+78.808516285" watchObservedRunningTime="2026-06-12 18:32:11.610197094 +0000 UTC m=+78.810150179" Jun 12 18:32:11.883774 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.883738 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mqd6d"] Jun 12 18:32:11.886143 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.886128 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:11.890793 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.890765 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 18:32:11.890978 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.890792 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 18:32:11.891089 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.890891 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 18:32:11.891089 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.891080 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-d2n24\"" Jun 12 18:32:11.892121 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.892101 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 18:32:11.892234 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.892106 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 18:32:11.892304 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.892280 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 18:32:11.894048 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.894027 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb"] Jun 12 18:32:11.896143 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.896126 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:11.898711 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.898695 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 18:32:11.899307 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.899289 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 18:32:11.899381 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.899293 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 18:32:11.902514 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.902463 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-xs4j4\"" Jun 12 18:32:11.911708 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:11.911680 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb"] Jun 12 18:32:12.036668 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036629 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-sys\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.036668 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036669 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.036894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036696 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/794501c9-4f9b-4509-b7fa-e595452367e6-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.036894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036765 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-tls\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.036894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036807 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.036894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036836 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-root\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.036894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036853 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sgwn\" (UniqueName: \"kubernetes.io/projected/493a0159-b2c0-45c9-b1d0-fd7712df59a2-kube-api-access-4sgwn\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.036894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.037186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036906 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j2qv\" (UniqueName: \"kubernetes.io/projected/794501c9-4f9b-4509-b7fa-e595452367e6-kube-api-access-8j2qv\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.037186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036959 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493a0159-b2c0-45c9-b1d0-fd7712df59a2-metrics-client-ca\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.037186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.036988 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/794501c9-4f9b-4509-b7fa-e595452367e6-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.037186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.037012 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-wtmp\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.037186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.037038 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.037186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.037065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-textfile\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.037186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.037105 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138081 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.137988 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-root\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138081 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138025 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sgwn\" (UniqueName: \"kubernetes.io/projected/493a0159-b2c0-45c9-b1d0-fd7712df59a2-kube-api-access-4sgwn\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138081 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138054 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138083 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j2qv\" (UniqueName: \"kubernetes.io/projected/794501c9-4f9b-4509-b7fa-e595452367e6-kube-api-access-8j2qv\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138107 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493a0159-b2c0-45c9-b1d0-fd7712df59a2-metrics-client-ca\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138114 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-root\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138131 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/794501c9-4f9b-4509-b7fa-e595452367e6-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138174 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-wtmp\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138203 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138231 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-textfile\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138320 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-sys\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138347 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.138798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138366 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-wtmp\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138379 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/794501c9-4f9b-4509-b7fa-e595452367e6-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.138798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138422 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-tls\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138462 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.138798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138684 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-textfile\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.138798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138726 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/794501c9-4f9b-4509-b7fa-e595452367e6-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.139134 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138818 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/493a0159-b2c0-45c9-b1d0-fd7712df59a2-metrics-client-ca\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.139134 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.138892 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/493a0159-b2c0-45c9-b1d0-fd7712df59a2-sys\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.139134 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.139029 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/794501c9-4f9b-4509-b7fa-e595452367e6-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.139278 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.139150 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.139278 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.139243 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-accelerators-collector-config\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.140734 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.140712 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.140963 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.140943 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.141100 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.141081 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/493a0159-b2c0-45c9-b1d0-fd7712df59a2-node-exporter-tls\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.141329 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.141312 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/794501c9-4f9b-4509-b7fa-e595452367e6-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.147263 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.147230 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j2qv\" (UniqueName: \"kubernetes.io/projected/794501c9-4f9b-4509-b7fa-e595452367e6-kube-api-access-8j2qv\") pod \"kube-state-metrics-678bc549d7-6ghzb\" (UID: \"794501c9-4f9b-4509-b7fa-e595452367e6\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.148574 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.148549 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sgwn\" (UniqueName: \"kubernetes.io/projected/493a0159-b2c0-45c9-b1d0-fd7712df59a2-kube-api-access-4sgwn\") pod \"node-exporter-mqd6d\" (UID: \"493a0159-b2c0-45c9-b1d0-fd7712df59a2\") " pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.197712 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.197672 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mqd6d" Jun 12 18:32:12.204417 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.204396 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" Jun 12 18:32:12.208954 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:12.208925 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod493a0159_b2c0_45c9_b1d0_fd7712df59a2.slice/crio-878c6bda313d4ebfd86ec8f5f359cfe45f84d9fe6c4cb1fd272720d5f9d37c1f WatchSource:0}: Error finding container 878c6bda313d4ebfd86ec8f5f359cfe45f84d9fe6c4cb1fd272720d5f9d37c1f: Status 404 returned error can't find the container with id 878c6bda313d4ebfd86ec8f5f359cfe45f84d9fe6c4cb1fd272720d5f9d37c1f Jun 12 18:32:12.358263 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.358105 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb"] Jun 12 18:32:12.360554 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:12.360525 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod794501c9_4f9b_4509_b7fa_e595452367e6.slice/crio-22f4e73b4954b55a1a5e44ffbb7973c5ebb9656950e95cb4d386c6f7d147ea0d WatchSource:0}: Error finding container 22f4e73b4954b55a1a5e44ffbb7973c5ebb9656950e95cb4d386c6f7d147ea0d: Status 404 returned error can't find the container with id 22f4e73b4954b55a1a5e44ffbb7973c5ebb9656950e95cb4d386c6f7d147ea0d Jun 12 18:32:12.591101 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.591068 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqd6d" event={"ID":"493a0159-b2c0-45c9-b1d0-fd7712df59a2","Type":"ContainerStarted","Data":"878c6bda313d4ebfd86ec8f5f359cfe45f84d9fe6c4cb1fd272720d5f9d37c1f"} Jun 12 18:32:12.592225 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:12.592201 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" event={"ID":"794501c9-4f9b-4509-b7fa-e595452367e6","Type":"ContainerStarted","Data":"22f4e73b4954b55a1a5e44ffbb7973c5ebb9656950e95cb4d386c6f7d147ea0d"} Jun 12 18:32:13.001512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.001410 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:32:13.004728 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.004659 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.008563 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.008536 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 18:32:13.008835 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.008705 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 18:32:13.008835 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.008775 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 18:32:13.008835 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.008813 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vpxs7\"" Jun 12 18:32:13.009034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.008813 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 18:32:13.009034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.008817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 18:32:13.009034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.008901 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 18:32:13.009186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.009112 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 18:32:13.009238 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.009226 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 18:32:13.009377 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.009350 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 18:32:13.028412 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.028173 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:32:13.146520 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146491 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146630 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146537 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146630 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146574 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146630 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146596 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146630 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146876 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146642 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146876 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146660 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146876 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146695 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146876 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146713 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-out\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146876 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146745 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-web-config\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146876 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146799 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.146876 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146835 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfzjj\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-kube-api-access-jfzjj\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.147230 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.146890 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248327 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248291 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248327 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248331 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248577 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248348 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248577 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248448 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248694 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248694 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248680 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248796 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248711 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248796 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248737 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248796 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248764 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248938 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248794 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-out\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248938 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-web-config\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248938 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.248938 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.248892 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfzjj\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-kube-api-access-jfzjj\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.249936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.249576 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.249936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.249690 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.249936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.249700 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.251572 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.251512 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-volume\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.251768 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.251747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.251923 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.251898 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.252290 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.252268 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.252376 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.252277 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-web-config\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.252427 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.252399 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-tls-assets\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.252555 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.252540 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.252929 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.252909 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.253527 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.253507 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-out\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.260070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.260045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfzjj\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-kube-api-access-jfzjj\") pod \"alertmanager-main-0\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.318347 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.318317 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:32:13.482970 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.482947 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:32:13.485011 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:13.484981 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6184c20_4e59_41e9_acc7_a097dd0b31ae.slice/crio-a49c4c1528c96c7da6c9a16429dadc9d7196efc5d6b45e714ae6fbc4b6cd4c2e WatchSource:0}: Error finding container a49c4c1528c96c7da6c9a16429dadc9d7196efc5d6b45e714ae6fbc4b6cd4c2e: Status 404 returned error can't find the container with id a49c4c1528c96c7da6c9a16429dadc9d7196efc5d6b45e714ae6fbc4b6cd4c2e Jun 12 18:32:13.597524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.597493 2561 generic.go:356] "Generic (PLEG): container finished" podID="493a0159-b2c0-45c9-b1d0-fd7712df59a2" containerID="91bb7d169f30c0c4cab8fcf0235293347420377537510eee8fa1f672673007e6" exitCode=0 Jun 12 18:32:13.597951 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.597578 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqd6d" event={"ID":"493a0159-b2c0-45c9-b1d0-fd7712df59a2","Type":"ContainerDied","Data":"91bb7d169f30c0c4cab8fcf0235293347420377537510eee8fa1f672673007e6"} Jun 12 18:32:13.598853 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:13.598834 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerStarted","Data":"a49c4c1528c96c7da6c9a16429dadc9d7196efc5d6b45e714ae6fbc4b6cd4c2e"} Jun 12 18:32:14.607736 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:14.607699 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" event={"ID":"794501c9-4f9b-4509-b7fa-e595452367e6","Type":"ContainerStarted","Data":"67de2381e10c7efe4c1242c1b2b3f2fac79ff451f4a92ff0f288f6d15d30cc89"} Jun 12 18:32:14.608196 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:14.607771 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" event={"ID":"794501c9-4f9b-4509-b7fa-e595452367e6","Type":"ContainerStarted","Data":"1405dd668ada5e6c51b8ef65e407599942f1940b9e1b8733072f7416e73b465f"} Jun 12 18:32:14.608196 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:14.607800 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" event={"ID":"794501c9-4f9b-4509-b7fa-e595452367e6","Type":"ContainerStarted","Data":"1b7852c120381d027ed70a8bb7a804ee0fdfe918a83a79451e73db6c72fc814f"} Jun 12 18:32:14.610071 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:14.610047 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqd6d" event={"ID":"493a0159-b2c0-45c9-b1d0-fd7712df59a2","Type":"ContainerStarted","Data":"75a8ccc4fbbfa926e331d1b0868440d47ea348c6ac92d29171bddfb0f21d5f97"} Jun 12 18:32:14.610196 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:14.610090 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mqd6d" event={"ID":"493a0159-b2c0-45c9-b1d0-fd7712df59a2","Type":"ContainerStarted","Data":"f30c0e4a41532d9b56424b4449f309a603ec511c9c0f93e92796d0de2337e33f"} Jun 12 18:32:14.705042 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:14.704978 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-6ghzb" podStartSLOduration=2.139024517 podStartE2EDuration="3.704957646s" totalImagesPullingTime="1.565933129s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:14.702266836 +0000 UTC m=+81.902219888" watchObservedRunningTime="2026-06-12 18:32:14.704957646 +0000 UTC m=+81.904910698" Jun 12 18:32:15.618081 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:15.618046 2561 generic.go:356] "Generic (PLEG): container finished" podID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerID="9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e" exitCode=0 Jun 12 18:32:15.618559 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:15.618131 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e"} Jun 12 18:32:15.649311 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:15.649268 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mqd6d" podStartSLOduration=3.673169429 podStartE2EDuration="4.649255221s" totalImagesPullingTime="907.439684ms" totalInitContainerRuntime="68.646108ms" isStatefulPod=true podCreationTimestamp="2026-06-12 18:32:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:14.737115343 +0000 UTC m=+81.937068422" watchObservedRunningTime="2026-06-12 18:32:15.649255221 +0000 UTC m=+82.849208271" Jun 12 18:32:17.517499 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:17.517460 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69c88697f7-2vbw7" Jun 12 18:32:17.627249 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:17.627217 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerStarted","Data":"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa"} Jun 12 18:32:18.379279 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.379242 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:32:18.383129 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.383103 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.385686 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.385664 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 18:32:18.385814 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.385696 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 18:32:18.386370 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.386345 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6cusmmvi6oevc\"" Jun 12 18:32:18.386637 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.386620 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t6mvx\"" Jun 12 18:32:18.386761 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.386743 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 18:32:18.387686 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.387662 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 18:32:18.387787 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.387664 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 18:32:18.387787 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.387781 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 18:32:18.387904 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.387867 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 18:32:18.387904 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.387890 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 18:32:18.388074 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.388007 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 18:32:18.388074 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.388016 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 18:32:18.388074 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.388046 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 18:32:18.389118 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.388925 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 18:32:18.389118 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.388949 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 18:32:18.395990 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.395969 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 18:32:18.397344 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.397319 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 18:32:18.406171 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.406149 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:32:18.494104 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494073 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494104 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494108 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494324 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494133 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494324 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494148 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494324 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494237 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494324 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494270 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494324 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494300 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494518 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494357 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494518 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494391 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494518 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494420 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494518 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494450 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494518 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494464 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494518 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494513 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494558 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494577 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494592 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494622 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494658 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494675 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.494730 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.494690 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w28q\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-kube-api-access-5w28q\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.595857 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.595826 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.595870 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.595896 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.595932 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.595962 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.595990 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596017 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596040 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596078 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596358 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596497 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596523 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596580 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596626 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596632 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596634 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596678 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596688 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596709 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596752 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596792 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596836 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596861 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w28q\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-kube-api-access-5w28q\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.596977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596888 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.597361 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.597326 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.597670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.596831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.599099 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.599068 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.599218 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.599193 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.599341 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.599318 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.599642 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.599607 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.599785 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.599751 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config-out\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.600898 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.600853 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.600990 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.600955 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.601364 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.601323 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.601526 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.601467 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-web-config\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.601670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.601651 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.601865 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.601848 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.601925 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.601849 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.602179 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.602164 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.606820 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.606804 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w28q\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-kube-api-access-5w28q\") pod \"prometheus-k8s-0\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.634046 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.633987 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerStarted","Data":"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7"} Jun 12 18:32:18.634141 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.634046 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerStarted","Data":"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa"} Jun 12 18:32:18.634141 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.634070 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerStarted","Data":"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b"} Jun 12 18:32:18.634141 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.634094 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerStarted","Data":"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32"} Jun 12 18:32:18.634141 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.634117 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerStarted","Data":"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613"} Jun 12 18:32:18.665575 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.665533 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.79125861 podStartE2EDuration="6.665520494s" totalImagesPullingTime="3.859150691s" totalInitContainerRuntime="15.111193ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:12 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:18.665295757 +0000 UTC m=+85.865248833" watchObservedRunningTime="2026-06-12 18:32:18.665520494 +0000 UTC m=+85.865473545" Jun 12 18:32:18.698675 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.698643 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:18.838127 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:18.838066 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:32:18.840077 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:32:18.840044 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1bfe7f7_d994_46da_a6d1_45d314abc2ff.slice/crio-3ed2caf29eba2ee3fa0de3e12dd61aaaa460c8f83cbaf7430c1d026cd94fe7ef WatchSource:0}: Error finding container 3ed2caf29eba2ee3fa0de3e12dd61aaaa460c8f83cbaf7430c1d026cd94fe7ef: Status 404 returned error can't find the container with id 3ed2caf29eba2ee3fa0de3e12dd61aaaa460c8f83cbaf7430c1d026cd94fe7ef Jun 12 18:32:19.639128 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:19.639091 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerID="7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da" exitCode=0 Jun 12 18:32:19.639586 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:19.639177 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da"} Jun 12 18:32:19.639586 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:19.639259 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerStarted","Data":"3ed2caf29eba2ee3fa0de3e12dd61aaaa460c8f83cbaf7430c1d026cd94fe7ef"} Jun 12 18:32:20.622686 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:20.622630 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" podUID="b9b0415d-b61b-4f50-9192-ba6fda231e3a" containerName="registry" containerID="cri-o://6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79" gracePeriod=30 Jun 12 18:32:20.884392 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:20.884333 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:32:21.021440 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021405 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-installation-pull-secrets\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.021617 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021466 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-image-registry-private-configuration\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.021617 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021566 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.021617 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021608 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-bound-sa-token\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.021775 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021641 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8gngn\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-kube-api-access-8gngn\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.021775 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021683 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9b0415d-b61b-4f50-9192-ba6fda231e3a-ca-trust-extracted\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.021775 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021714 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-certificates\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.021775 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.021745 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-trusted-ca\") pod \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\" (UID: \"b9b0415d-b61b-4f50-9192-ba6fda231e3a\") " Jun 12 18:32:21.022431 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.022348 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:32:21.022431 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.022375 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:32:21.023957 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.023926 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:32:21.024074 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.023988 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:32:21.024135 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.024077 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:32:21.024135 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.024121 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:32:21.024235 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.024179 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-kube-api-access-8gngn" (OuterVolumeSpecName: "kube-api-access-8gngn") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "kube-api-access-8gngn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:32:21.030103 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.030079 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9b0415d-b61b-4f50-9192-ba6fda231e3a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b9b0415d-b61b-4f50-9192-ba6fda231e3a" (UID: "b9b0415d-b61b-4f50-9192-ba6fda231e3a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:32:21.123350 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123314 2561 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-installation-pull-secrets\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.123350 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123353 2561 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b9b0415d-b61b-4f50-9192-ba6fda231e3a-image-registry-private-configuration\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.123603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123370 2561 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-tls\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.123603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123386 2561 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-bound-sa-token\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.123603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123399 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8gngn\" (UniqueName: \"kubernetes.io/projected/b9b0415d-b61b-4f50-9192-ba6fda231e3a-kube-api-access-8gngn\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.123603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123412 2561 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b9b0415d-b61b-4f50-9192-ba6fda231e3a-ca-trust-extracted\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.123603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123427 2561 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-registry-certificates\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.123603 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.123439 2561 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b9b0415d-b61b-4f50-9192-ba6fda231e3a-trusted-ca\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:32:21.649206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.649097 2561 generic.go:356] "Generic (PLEG): container finished" podID="b9b0415d-b61b-4f50-9192-ba6fda231e3a" containerID="6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79" exitCode=0 Jun 12 18:32:21.649206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.649147 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" Jun 12 18:32:21.649206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.649156 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" event={"ID":"b9b0415d-b61b-4f50-9192-ba6fda231e3a","Type":"ContainerDied","Data":"6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79"} Jun 12 18:32:21.649559 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.649219 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-545dd4fb89-4mzl6" event={"ID":"b9b0415d-b61b-4f50-9192-ba6fda231e3a","Type":"ContainerDied","Data":"b64147e917f1069bc1c6f68a491ec4e7a47086e89e73d079333c75d41a71a05d"} Jun 12 18:32:21.649559 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.649249 2561 scope.go:117] "RemoveContainer" containerID="6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79" Jun 12 18:32:21.658236 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.658217 2561 scope.go:117] "RemoveContainer" containerID="6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79" Jun 12 18:32:21.658597 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:32:21.658574 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79\": container with ID starting with 6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79 not found: ID does not exist" containerID="6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79" Jun 12 18:32:21.658678 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.658611 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79"} err="failed to get container status \"6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79\": rpc error: code = NotFound desc = could not find container \"6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79\": container with ID starting with 6fbbe434ccf5b1d1ede1dcfdd83a59a0c5037168540a22ae6c8e0edefb74eb79 not found: ID does not exist" Jun 12 18:32:21.667992 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.667965 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-545dd4fb89-4mzl6"] Jun 12 18:32:21.671955 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:21.671934 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-545dd4fb89-4mzl6"] Jun 12 18:32:23.276839 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:23.276808 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b9b0415d-b61b-4f50-9192-ba6fda231e3a" path="/var/lib/kubelet/pods/b9b0415d-b61b-4f50-9192-ba6fda231e3a/volumes" Jun 12 18:32:23.658733 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:23.658698 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerStarted","Data":"f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a"} Jun 12 18:32:23.658907 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:23.658775 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerStarted","Data":"5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8"} Jun 12 18:32:25.670155 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:25.670123 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerStarted","Data":"04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24"} Jun 12 18:32:25.670553 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:25.670184 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerStarted","Data":"9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2"} Jun 12 18:32:25.670553 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:25.670210 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerStarted","Data":"83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88"} Jun 12 18:32:25.670553 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:25.670239 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerStarted","Data":"5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b"} Jun 12 18:32:25.701813 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:25.701752 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.059995609 podStartE2EDuration="7.701734011s" totalImagesPullingTime="5.624292759s" totalInitContainerRuntime="17.445643ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:25.699639632 +0000 UTC m=+92.899592683" watchObservedRunningTime="2026-06-12 18:32:25.701734011 +0000 UTC m=+92.901687066" Jun 12 18:32:28.699180 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:28.699148 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:32:37.570450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:32:37.570419 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-jt2gw" Jun 12 18:33:18.699181 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:18.699133 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:18.717998 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:18.717973 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:18.884583 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:18.884557 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:32.523218 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.523140 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:33:32.523620 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.523434 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="alertmanager" containerID="cri-o://365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa" gracePeriod=120 Jun 12 18:33:32.523620 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.523506 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-metric" containerID="cri-o://752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b" gracePeriod=120 Jun 12 18:33:32.523620 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.523537 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-web" containerID="cri-o://8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613" gracePeriod=120 Jun 12 18:33:32.523620 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.523583 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="config-reloader" containerID="cri-o://c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7" gracePeriod=120 Jun 12 18:33:32.523620 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.523554 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy" containerID="cri-o://e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32" gracePeriod=120 Jun 12 18:33:32.523875 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.523539 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="prom-label-proxy" containerID="cri-o://ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa" gracePeriod=120 Jun 12 18:33:32.922931 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.922902 2561 generic.go:356] "Generic (PLEG): container finished" podID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerID="ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa" exitCode=0 Jun 12 18:33:32.922931 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.922927 2561 generic.go:356] "Generic (PLEG): container finished" podID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerID="e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32" exitCode=0 Jun 12 18:33:32.922931 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.922933 2561 generic.go:356] "Generic (PLEG): container finished" podID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerID="c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7" exitCode=0 Jun 12 18:33:32.923148 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.922940 2561 generic.go:356] "Generic (PLEG): container finished" podID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerID="365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa" exitCode=0 Jun 12 18:33:32.923148 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.922968 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa"} Jun 12 18:33:32.923148 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.923021 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32"} Jun 12 18:33:32.923148 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.923047 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7"} Jun 12 18:33:32.923148 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:32.923072 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa"} Jun 12 18:33:33.775983 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.775960 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:33.848604 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848509 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfzjj\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-kube-api-access-jfzjj\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.848769 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848612 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-trusted-ca-bundle\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.848769 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848645 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-out\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.848769 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848668 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-volume\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.848769 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848709 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-metrics-client-ca\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.848769 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848728 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.848769 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848743 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-tls-assets\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.849070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848776 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-web\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.849070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848811 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-metric\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.849070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848836 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-cluster-tls-config\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.849070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848866 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-web-config\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.849070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848895 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-main-tls\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.849070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.848921 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-main-db\") pod \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\" (UID: \"b6184c20-4e59-41e9-acc7-a097dd0b31ae\") " Jun 12 18:33:33.849070 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.849060 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:33.849448 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.849095 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:33.849448 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.849197 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.849448 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.849317 2561 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b6184c20-4e59-41e9-acc7-a097dd0b31ae-metrics-client-ca\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.849448 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.849336 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:33:33.851690 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.851647 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:33.851951 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.851914 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-out" (OuterVolumeSpecName: "config-out") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:33:33.852689 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.852651 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:33.852967 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.852931 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:33.852967 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.852942 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:33.853179 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.853157 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:33:33.853282 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.853257 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-volume" (OuterVolumeSpecName: "config-volume") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:33.853566 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.853539 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-kube-api-access-jfzjj" (OuterVolumeSpecName: "kube-api-access-jfzjj") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "kube-api-access-jfzjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:33:33.856571 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.856550 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:33.864401 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.864375 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-web-config" (OuterVolumeSpecName: "web-config") pod "b6184c20-4e59-41e9-acc7-a097dd0b31ae" (UID: "b6184c20-4e59-41e9-acc7-a097dd0b31ae"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:33.929907 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.929871 2561 generic.go:356] "Generic (PLEG): container finished" podID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerID="752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b" exitCode=0 Jun 12 18:33:33.929907 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.929899 2561 generic.go:356] "Generic (PLEG): container finished" podID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerID="8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613" exitCode=0 Jun 12 18:33:33.930107 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.929924 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b"} Jun 12 18:33:33.930107 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.929946 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:33.930107 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.929979 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613"} Jun 12 18:33:33.930107 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.930006 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"b6184c20-4e59-41e9-acc7-a097dd0b31ae","Type":"ContainerDied","Data":"a49c4c1528c96c7da6c9a16429dadc9d7196efc5d6b45e714ae6fbc4b6cd4c2e"} Jun 12 18:33:33.930107 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.930036 2561 scope.go:117] "RemoveContainer" containerID="ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa" Jun 12 18:33:33.938308 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.938279 2561 scope.go:117] "RemoveContainer" containerID="752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b" Jun 12 18:33:33.945128 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.945115 2561 scope.go:117] "RemoveContainer" containerID="e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32" Jun 12 18:33:33.949721 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949692 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949721 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949715 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-tls-assets\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949721 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949725 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949734 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949746 2561 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-cluster-tls-config\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949755 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-web-config\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949763 2561 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-secret-alertmanager-main-tls\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949771 2561 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-alertmanager-main-db\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949779 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfzjj\" (UniqueName: \"kubernetes.io/projected/b6184c20-4e59-41e9-acc7-a097dd0b31ae-kube-api-access-jfzjj\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949786 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-out\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.949936 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.949794 2561 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/b6184c20-4e59-41e9-acc7-a097dd0b31ae-config-volume\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:33.952215 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.952109 2561 scope.go:117] "RemoveContainer" containerID="8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613" Jun 12 18:33:33.954427 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.954404 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:33:33.959988 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.959965 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:33:33.960896 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.960879 2561 scope.go:117] "RemoveContainer" containerID="c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7" Jun 12 18:33:33.967682 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.967665 2561 scope.go:117] "RemoveContainer" containerID="365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa" Jun 12 18:33:33.974242 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.974226 2561 scope.go:117] "RemoveContainer" containerID="9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e" Jun 12 18:33:33.981382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.981364 2561 scope.go:117] "RemoveContainer" containerID="ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa" Jun 12 18:33:33.981717 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:33.981699 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa\": container with ID starting with ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa not found: ID does not exist" containerID="ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa" Jun 12 18:33:33.981785 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.981725 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa"} err="failed to get container status \"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa\": rpc error: code = NotFound desc = could not find container \"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa\": container with ID starting with ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa not found: ID does not exist" Jun 12 18:33:33.981785 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.981742 2561 scope.go:117] "RemoveContainer" containerID="752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b" Jun 12 18:33:33.981954 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:33.981941 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b\": container with ID starting with 752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b not found: ID does not exist" containerID="752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b" Jun 12 18:33:33.981989 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.981957 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b"} err="failed to get container status \"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b\": rpc error: code = NotFound desc = could not find container \"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b\": container with ID starting with 752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b not found: ID does not exist" Jun 12 18:33:33.981989 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.981969 2561 scope.go:117] "RemoveContainer" containerID="e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32" Jun 12 18:33:33.982209 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:33.982190 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32\": container with ID starting with e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32 not found: ID does not exist" containerID="e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32" Jun 12 18:33:33.982260 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982215 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32"} err="failed to get container status \"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32\": rpc error: code = NotFound desc = could not find container \"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32\": container with ID starting with e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32 not found: ID does not exist" Jun 12 18:33:33.982260 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982231 2561 scope.go:117] "RemoveContainer" containerID="8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613" Jun 12 18:33:33.982453 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:33.982437 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613\": container with ID starting with 8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613 not found: ID does not exist" containerID="8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613" Jun 12 18:33:33.982512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982456 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613"} err="failed to get container status \"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613\": rpc error: code = NotFound desc = could not find container \"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613\": container with ID starting with 8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613 not found: ID does not exist" Jun 12 18:33:33.982512 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982494 2561 scope.go:117] "RemoveContainer" containerID="c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7" Jun 12 18:33:33.982707 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:33.982669 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7\": container with ID starting with c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7 not found: ID does not exist" containerID="c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7" Jun 12 18:33:33.982707 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982688 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7"} err="failed to get container status \"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7\": rpc error: code = NotFound desc = could not find container \"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7\": container with ID starting with c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7 not found: ID does not exist" Jun 12 18:33:33.982707 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982699 2561 scope.go:117] "RemoveContainer" containerID="365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa" Jun 12 18:33:33.982870 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:33.982855 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa\": container with ID starting with 365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa not found: ID does not exist" containerID="365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa" Jun 12 18:33:33.982909 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982872 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa"} err="failed to get container status \"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa\": rpc error: code = NotFound desc = could not find container \"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa\": container with ID starting with 365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa not found: ID does not exist" Jun 12 18:33:33.982909 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.982882 2561 scope.go:117] "RemoveContainer" containerID="9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e" Jun 12 18:33:33.983105 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:33.983087 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e\": container with ID starting with 9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e not found: ID does not exist" containerID="9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e" Jun 12 18:33:33.983143 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983109 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e"} err="failed to get container status \"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e\": rpc error: code = NotFound desc = could not find container \"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e\": container with ID starting with 9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e not found: ID does not exist" Jun 12 18:33:33.983143 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983121 2561 scope.go:117] "RemoveContainer" containerID="ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa" Jun 12 18:33:33.983328 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983310 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa"} err="failed to get container status \"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa\": rpc error: code = NotFound desc = could not find container \"ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa\": container with ID starting with ed281581a2803569d9b8789671628f33d0fd8cab654036ba825c90fb6c10f1fa not found: ID does not exist" Jun 12 18:33:33.983328 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983328 2561 scope.go:117] "RemoveContainer" containerID="752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b" Jun 12 18:33:33.983515 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983499 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b"} err="failed to get container status \"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b\": rpc error: code = NotFound desc = could not find container \"752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b\": container with ID starting with 752bc47c99fc8754235c19084447aa36cd3f15185fe463a043a56d53f840bb0b not found: ID does not exist" Jun 12 18:33:33.983563 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983515 2561 scope.go:117] "RemoveContainer" containerID="e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32" Jun 12 18:33:33.983684 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983666 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32"} err="failed to get container status \"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32\": rpc error: code = NotFound desc = could not find container \"e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32\": container with ID starting with e49e52cd2eb768d2f4f7d4dcde51cd1462f991e5bae4fd53c2db11882253ec32 not found: ID does not exist" Jun 12 18:33:33.983724 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983685 2561 scope.go:117] "RemoveContainer" containerID="8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613" Jun 12 18:33:33.983884 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983869 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613"} err="failed to get container status \"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613\": rpc error: code = NotFound desc = could not find container \"8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613\": container with ID starting with 8b520ad0871faaea1cdd89b4d6e3f311624d0c12f6fc8fc2c09fe0acab87c613 not found: ID does not exist" Jun 12 18:33:33.983928 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.983885 2561 scope.go:117] "RemoveContainer" containerID="c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7" Jun 12 18:33:33.984040 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.984026 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7"} err="failed to get container status \"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7\": rpc error: code = NotFound desc = could not find container \"c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7\": container with ID starting with c230fab333baa14996dbfadfc9ea44a317e7fc342d02c1f07139e7b742310db7 not found: ID does not exist" Jun 12 18:33:33.984079 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.984040 2561 scope.go:117] "RemoveContainer" containerID="365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa" Jun 12 18:33:33.984193 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.984175 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa"} err="failed to get container status \"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa\": rpc error: code = NotFound desc = could not find container \"365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa\": container with ID starting with 365c5d5d7caa8fec0a7060ecc9a631caad38f50188883678b4529bbc688061aa not found: ID does not exist" Jun 12 18:33:33.984232 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.984194 2561 scope.go:117] "RemoveContainer" containerID="9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e" Jun 12 18:33:33.984378 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.984359 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e"} err="failed to get container status \"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e\": rpc error: code = NotFound desc = could not find container \"9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e\": container with ID starting with 9ab4b97b8033a4283d57be8db7fb162f98f155c0274cc446ec15482668b27a9e not found: ID does not exist" Jun 12 18:33:33.993290 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.993265 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:33:33.994075 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994053 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-web" Jun 12 18:33:33.994190 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994179 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-web" Jun 12 18:33:33.994286 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994275 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="init-config-reloader" Jun 12 18:33:33.994351 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994343 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="init-config-reloader" Jun 12 18:33:33.994414 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994406 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="prom-label-proxy" Jun 12 18:33:33.994496 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994463 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="prom-label-proxy" Jun 12 18:33:33.994602 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994589 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy" Jun 12 18:33:33.994745 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994732 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy" Jun 12 18:33:33.994837 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994825 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-metric" Jun 12 18:33:33.994906 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994897 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-metric" Jun 12 18:33:33.994987 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.994978 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="config-reloader" Jun 12 18:33:33.995057 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995048 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="config-reloader" Jun 12 18:33:33.995150 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995130 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9b0415d-b61b-4f50-9192-ba6fda231e3a" containerName="registry" Jun 12 18:33:33.995256 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995145 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9b0415d-b61b-4f50-9192-ba6fda231e3a" containerName="registry" Jun 12 18:33:33.995256 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995169 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="alertmanager" Jun 12 18:33:33.995256 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995175 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="alertmanager" Jun 12 18:33:33.995614 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995601 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9b0415d-b61b-4f50-9192-ba6fda231e3a" containerName="registry" Jun 12 18:33:33.995670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995618 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="prom-label-proxy" Jun 12 18:33:33.995670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995628 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy" Jun 12 18:33:33.995670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995635 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="alertmanager" Jun 12 18:33:33.995670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995640 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="config-reloader" Jun 12 18:33:33.995670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995645 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-web" Jun 12 18:33:33.995670 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:33.995651 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" containerName="kube-rbac-proxy-metric" Jun 12 18:33:34.000722 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.000707 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.003277 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003256 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 18:33:34.003452 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003434 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 18:33:34.003562 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003537 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 18:33:34.003562 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003547 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vpxs7\"" Jun 12 18:33:34.003925 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003905 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 18:33:34.004025 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003924 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 18:33:34.004025 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003945 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 18:33:34.004025 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003950 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 18:33:34.004025 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.003931 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 18:33:34.009832 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.009814 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 18:33:34.012435 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.012414 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:33:34.051087 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051053 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051087 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051089 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c71abf5-e71f-43ca-a3ae-89230f928b33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051294 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051116 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c71abf5-e71f-43ca-a3ae-89230f928b33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051294 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051199 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051294 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051231 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051294 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051249 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051294 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051268 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c71abf5-e71f-43ca-a3ae-89230f928b33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051294 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051291 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c71abf5-e71f-43ca-a3ae-89230f928b33-config-out\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051525 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051309 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c71abf5-e71f-43ca-a3ae-89230f928b33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051525 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051326 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051525 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051352 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-web-config\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051525 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051393 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.051525 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.051415 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w7qv\" (UniqueName: \"kubernetes.io/projected/2c71abf5-e71f-43ca-a3ae-89230f928b33-kube-api-access-4w7qv\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152608 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152501 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c71abf5-e71f-43ca-a3ae-89230f928b33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152608 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152572 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152608 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152621 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152648 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c71abf5-e71f-43ca-a3ae-89230f928b33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152671 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c71abf5-e71f-43ca-a3ae-89230f928b33-config-out\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152694 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c71abf5-e71f-43ca-a3ae-89230f928b33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152754 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152819 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-web-config\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152855 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.152891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152885 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w7qv\" (UniqueName: \"kubernetes.io/projected/2c71abf5-e71f-43ca-a3ae-89230f928b33-kube-api-access-4w7qv\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.153268 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152925 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.153268 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152952 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/2c71abf5-e71f-43ca-a3ae-89230f928b33-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.153382 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.152961 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c71abf5-e71f-43ca-a3ae-89230f928b33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.153756 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.153726 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2c71abf5-e71f-43ca-a3ae-89230f928b33-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.154331 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.154305 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2c71abf5-e71f-43ca-a3ae-89230f928b33-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.155881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.155715 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/2c71abf5-e71f-43ca-a3ae-89230f928b33-config-out\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.155881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.155752 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.155881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.155829 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-config-volume\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.155881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.155850 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.156047 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.155911 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-web-config\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.156047 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.155928 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/2c71abf5-e71f-43ca-a3ae-89230f928b33-tls-assets\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.156047 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.155955 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.156785 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.156767 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.157590 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.157570 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/2c71abf5-e71f-43ca-a3ae-89230f928b33-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.163278 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.163258 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w7qv\" (UniqueName: \"kubernetes.io/projected/2c71abf5-e71f-43ca-a3ae-89230f928b33-kube-api-access-4w7qv\") pod \"alertmanager-main-0\" (UID: \"2c71abf5-e71f-43ca-a3ae-89230f928b33\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.309909 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.309857 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:33:34.449010 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.448981 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:33:34.450439 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:33:34.450415 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c71abf5_e71f_43ca_a3ae_89230f928b33.slice/crio-cf63335cd11ffe9ecc686f71ab4418af2dc97ae3fa104ca3716d7fbf0dfa4b60 WatchSource:0}: Error finding container cf63335cd11ffe9ecc686f71ab4418af2dc97ae3fa104ca3716d7fbf0dfa4b60: Status 404 returned error can't find the container with id cf63335cd11ffe9ecc686f71ab4418af2dc97ae3fa104ca3716d7fbf0dfa4b60 Jun 12 18:33:34.935139 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.935101 2561 generic.go:356] "Generic (PLEG): container finished" podID="2c71abf5-e71f-43ca-a3ae-89230f928b33" containerID="6c7750a49b75fb6429bf5d822043b1a50e023d0cb793f479b476e8985f6f5f05" exitCode=0 Jun 12 18:33:34.935562 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.935189 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerDied","Data":"6c7750a49b75fb6429bf5d822043b1a50e023d0cb793f479b476e8985f6f5f05"} Jun 12 18:33:34.935562 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:34.935255 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerStarted","Data":"cf63335cd11ffe9ecc686f71ab4418af2dc97ae3fa104ca3716d7fbf0dfa4b60"} Jun 12 18:33:35.276865 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.276840 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b6184c20-4e59-41e9-acc7-a097dd0b31ae" path="/var/lib/kubelet/pods/b6184c20-4e59-41e9-acc7-a097dd0b31ae/volumes" Jun 12 18:33:35.943260 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.943221 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerStarted","Data":"d2596b6d2d0deb60a68cf396a7125b194f5d17454bfe99fdc67d0a67cebf5ec7"} Jun 12 18:33:35.943650 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.943304 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerStarted","Data":"4dcc5387df9e622de0be29aaed68f3bdcd31eacc56756b440faed1f7ebd5c13b"} Jun 12 18:33:35.943650 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.943348 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerStarted","Data":"69b9a250769ca4233ae0e5e2bf622ec866c684c6aa2db5e8ec09d75eb964043f"} Jun 12 18:33:35.943650 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.943386 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerStarted","Data":"c57972967fa4725bbb4023d148dd541358c3d15da2d75d4ab119883b96e96641"} Jun 12 18:33:35.943650 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.943419 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerStarted","Data":"f6b5c3aa8e84da5341a2168454297932a35745dba21d593db06b712f7c8259a7"} Jun 12 18:33:35.943650 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.943455 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"2c71abf5-e71f-43ca-a3ae-89230f928b33","Type":"ContainerStarted","Data":"b4385059a2889b2f0a8d2cef82695f99c8688c9933f98354c0cd03488ba0963b"} Jun 12 18:33:35.975802 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:35.975737 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.960886733 podStartE2EDuration="2.975716899s" totalImagesPullingTime="0s" totalInitContainerRuntime="14.830166ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:33:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:33:35.97293273 +0000 UTC m=+163.172885821" watchObservedRunningTime="2026-06-12 18:33:35.975716899 +0000 UTC m=+163.175669951" Jun 12 18:33:36.938206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:36.938170 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:33:36.938493 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:36.938448 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="prometheus" containerID="cri-o://5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8" gracePeriod=600 Jun 12 18:33:36.938588 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:36.938467 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy" containerID="cri-o://9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2" gracePeriod=600 Jun 12 18:33:36.938588 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:36.938513 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-web" containerID="cri-o://83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88" gracePeriod=600 Jun 12 18:33:36.938588 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:36.938528 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="config-reloader" containerID="cri-o://f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a" gracePeriod=600 Jun 12 18:33:36.938588 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:36.938558 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-thanos" containerID="cri-o://04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24" gracePeriod=600 Jun 12 18:33:36.938743 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:36.938491 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="thanos-sidecar" containerID="cri-o://5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b" gracePeriod=600 Jun 12 18:33:37.954929 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.954893 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerID="04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24" exitCode=0 Jun 12 18:33:37.954929 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.954919 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerID="9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2" exitCode=0 Jun 12 18:33:37.954929 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.954929 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerID="5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b" exitCode=0 Jun 12 18:33:37.954929 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.954936 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerID="f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a" exitCode=0 Jun 12 18:33:37.955388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.954943 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerID="5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8" exitCode=0 Jun 12 18:33:37.955388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.954962 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24"} Jun 12 18:33:37.955388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.955026 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2"} Jun 12 18:33:37.955388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.955053 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b"} Jun 12 18:33:37.955388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.955076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a"} Jun 12 18:33:37.955388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:37.955099 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8"} Jun 12 18:33:38.188026 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.187998 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:38.289332 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289247 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-tls-assets\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289332 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289280 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289332 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289311 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-serving-certs-ca-bundle\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289636 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289334 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config-out\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289636 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289538 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-kube-rbac-proxy\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289636 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289579 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-metrics-client-certs\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289636 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289605 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-2\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289636 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289630 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-kubelet-serving-ca-bundle\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289843 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289660 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-web-config\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289843 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289699 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-trusted-ca-bundle\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289843 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289721 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:38.289843 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289728 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-grpc-tls\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.289843 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289799 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5w28q\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-kube-api-access-5w28q\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290083 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289850 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-metrics-client-ca\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290083 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289960 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290083 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289995 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-1\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290083 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.289999 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:38.290083 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290029 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-tls\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290083 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290068 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-db\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290379 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290099 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-0\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290379 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290140 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290379 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290188 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-thanos-prometheus-http-client-file\") pod \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\" (UID: \"b1bfe7f7-d994-46da-a6d1-45d314abc2ff\") " Jun 12 18:33:38.290601 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290379 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:38.290601 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290455 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.290601 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290494 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.290601 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290513 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.290799 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.290749 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:38.292385 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.291734 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:38.292524 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.292402 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:38.293155 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.293110 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:33:38.293155 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.293113 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:33:38.293794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.293693 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config-out" (OuterVolumeSpecName: "config-out") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:33:38.293794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.293717 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.293794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.293718 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:33:38.293794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.293769 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-kube-api-access-5w28q" (OuterVolumeSpecName: "kube-api-access-5w28q") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "kube-api-access-5w28q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:33:38.294091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.293824 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.294091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.294019 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.294209 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.294108 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.294273 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.294257 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.294564 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.294535 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config" (OuterVolumeSpecName: "config") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.294766 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.294742 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.295964 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.295942 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.304687 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.304666 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-web-config" (OuterVolumeSpecName: "web-config") pod "b1bfe7f7-d994-46da-a6d1-45d314abc2ff" (UID: "b1bfe7f7-d994-46da-a6d1-45d314abc2ff"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:33:38.391009 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.390965 2561 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-grpc-tls\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391009 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391001 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5w28q\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-kube-api-access-5w28q\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391009 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391016 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-metrics-client-ca\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391031 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391044 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391056 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391069 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-db\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391082 2561 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391094 2561 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391106 2561 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391118 2561 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-tls-assets\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391129 2561 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391139 2561 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-config-out\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391150 2561 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-kube-rbac-proxy\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391161 2561 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-secret-metrics-client-certs\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391174 2561 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.391254 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.391188 2561 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b1bfe7f7-d994-46da-a6d1-45d314abc2ff-web-config\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:33:38.962380 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.962344 2561 generic.go:356] "Generic (PLEG): container finished" podID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerID="83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88" exitCode=0 Jun 12 18:33:38.962782 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.962417 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:38.962782 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.962424 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88"} Jun 12 18:33:38.962782 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.962520 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b1bfe7f7-d994-46da-a6d1-45d314abc2ff","Type":"ContainerDied","Data":"3ed2caf29eba2ee3fa0de3e12dd61aaaa460c8f83cbaf7430c1d026cd94fe7ef"} Jun 12 18:33:38.962782 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.962555 2561 scope.go:117] "RemoveContainer" containerID="04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24" Jun 12 18:33:38.971024 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.970893 2561 scope.go:117] "RemoveContainer" containerID="9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2" Jun 12 18:33:38.978061 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.978043 2561 scope.go:117] "RemoveContainer" containerID="83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88" Jun 12 18:33:38.984400 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.984380 2561 scope.go:117] "RemoveContainer" containerID="5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b" Jun 12 18:33:38.988828 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.988803 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:33:38.992338 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.992220 2561 scope.go:117] "RemoveContainer" containerID="f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a" Jun 12 18:33:38.994413 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.994392 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:33:38.999712 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:38.999688 2561 scope.go:117] "RemoveContainer" containerID="5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8" Jun 12 18:33:39.006552 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.006528 2561 scope.go:117] "RemoveContainer" containerID="7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da" Jun 12 18:33:39.012808 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.012790 2561 scope.go:117] "RemoveContainer" containerID="04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24" Jun 12 18:33:39.013078 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:39.013059 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24\": container with ID starting with 04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24 not found: ID does not exist" containerID="04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24" Jun 12 18:33:39.013147 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.013087 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24"} err="failed to get container status \"04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24\": rpc error: code = NotFound desc = could not find container \"04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24\": container with ID starting with 04c6f09162f341c0330f4f723a537dc0f3bf1b14e687442e01f3088070513d24 not found: ID does not exist" Jun 12 18:33:39.013147 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.013106 2561 scope.go:117] "RemoveContainer" containerID="9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2" Jun 12 18:33:39.013372 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:39.013358 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2\": container with ID starting with 9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2 not found: ID does not exist" containerID="9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2" Jun 12 18:33:39.013410 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.013376 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2"} err="failed to get container status \"9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2\": rpc error: code = NotFound desc = could not find container \"9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2\": container with ID starting with 9a5ad22ed355570c3d5a343b0045399008606f4f32508ee764a20dfb1e27cbf2 not found: ID does not exist" Jun 12 18:33:39.013410 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.013390 2561 scope.go:117] "RemoveContainer" containerID="83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88" Jun 12 18:33:39.013682 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:39.013656 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88\": container with ID starting with 83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88 not found: ID does not exist" containerID="83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88" Jun 12 18:33:39.013763 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.013685 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88"} err="failed to get container status \"83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88\": rpc error: code = NotFound desc = could not find container \"83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88\": container with ID starting with 83658fb060197513ae3a5f419327dc40d75fd7c5934da053977f14ea0be3ca88 not found: ID does not exist" Jun 12 18:33:39.013763 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.013700 2561 scope.go:117] "RemoveContainer" containerID="5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b" Jun 12 18:33:39.013980 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:39.013958 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b\": container with ID starting with 5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b not found: ID does not exist" containerID="5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b" Jun 12 18:33:39.014023 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.013990 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b"} err="failed to get container status \"5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b\": rpc error: code = NotFound desc = could not find container \"5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b\": container with ID starting with 5b363de965f1b1d8c86ce2620e44cc4ae2e4b2816cb16722f7248e536588098b not found: ID does not exist" Jun 12 18:33:39.014023 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.014012 2561 scope.go:117] "RemoveContainer" containerID="f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a" Jun 12 18:33:39.014283 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:39.014266 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a\": container with ID starting with f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a not found: ID does not exist" containerID="f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a" Jun 12 18:33:39.014335 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.014288 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a"} err="failed to get container status \"f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a\": rpc error: code = NotFound desc = could not find container \"f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a\": container with ID starting with f55ecf91ef59cf347311106ee1774c4e119bd42e2a3dfac7cf51f78dde254a8a not found: ID does not exist" Jun 12 18:33:39.014335 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.014302 2561 scope.go:117] "RemoveContainer" containerID="5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8" Jun 12 18:33:39.014546 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:39.014529 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8\": container with ID starting with 5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8 not found: ID does not exist" containerID="5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8" Jun 12 18:33:39.014605 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.014553 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8"} err="failed to get container status \"5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8\": rpc error: code = NotFound desc = could not find container \"5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8\": container with ID starting with 5f95d3281ac5c15265e6e63d81ab000285ba248382bed8ce71c7c57ce6720bf8 not found: ID does not exist" Jun 12 18:33:39.014605 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.014573 2561 scope.go:117] "RemoveContainer" containerID="7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da" Jun 12 18:33:39.014791 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:33:39.014772 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da\": container with ID starting with 7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da not found: ID does not exist" containerID="7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da" Jun 12 18:33:39.014832 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.014796 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da"} err="failed to get container status \"7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da\": rpc error: code = NotFound desc = could not find container \"7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da\": container with ID starting with 7b025a738e6651337b2732ff16b68fd190b1243c2724ccbbe1fe857e26e790da not found: ID does not exist" Jun 12 18:33:39.025528 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025459 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:33:39.025763 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025732 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy" Jun 12 18:33:39.025763 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025749 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy" Jun 12 18:33:39.025763 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025763 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-thanos" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025768 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-thanos" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025775 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="thanos-sidecar" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025781 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="thanos-sidecar" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025788 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="prometheus" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025793 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="prometheus" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025803 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-web" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025810 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-web" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025820 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="init-config-reloader" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025825 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="init-config-reloader" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025831 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="config-reloader" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025836 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="config-reloader" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025872 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="config-reloader" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025880 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-web" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025885 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="prometheus" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025891 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="thanos-sidecar" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025896 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy" Jun 12 18:33:39.025924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.025902 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" containerName="kube-rbac-proxy-thanos" Jun 12 18:33:39.031047 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.031031 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.036423 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036386 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 18:33:39.036423 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036402 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 18:33:39.036604 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036452 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 18:33:39.036604 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036541 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 18:33:39.036604 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036558 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 18:33:39.036604 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036389 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 18:33:39.036790 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036698 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-t6mvx\"" Jun 12 18:33:39.036790 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036739 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 18:33:39.036790 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036741 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 18:33:39.036790 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036746 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 18:33:39.037008 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036817 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-6cusmmvi6oevc\"" Jun 12 18:33:39.037008 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036853 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 18:33:39.037008 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.036865 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 18:33:39.037217 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.037135 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 18:33:39.037217 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.037148 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 18:33:39.038751 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.038730 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 18:33:39.041788 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.041771 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 18:33:39.051639 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.051616 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:33:39.096553 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096520 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096553 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096556 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096581 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096606 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-config\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096655 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096684 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096710 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096730 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096948 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096769 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r8l5k\" (UniqueName: \"kubernetes.io/projected/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-kube-api-access-r8l5k\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096948 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096819 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096948 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096839 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096948 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096862 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096948 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096877 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096948 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096914 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.096948 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.097161 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096950 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.097161 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.096982 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.097161 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.097001 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.097161 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.097015 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.097161 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.097044 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198116 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198082 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198123 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198142 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198164 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198183 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198222 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198198 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198522 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198322 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198522 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198364 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-config\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198522 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198391 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198522 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198416 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198522 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198454 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198512 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198556 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r8l5k\" (UniqueName: \"kubernetes.io/projected/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-kube-api-access-r8l5k\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198585 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198606 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198635 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198662 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198698 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198722 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.198764 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198750 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.199182 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198834 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.199182 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.198998 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.199182 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.199033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.199182 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.199143 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.200307 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.200776 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.201418 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.201586 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.201615 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.201668 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.202047 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.202727 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.202603 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.203182 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.202816 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-web-config\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.203182 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.203053 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-config\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.203684 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.203648 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.204052 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.204033 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-config-out\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.204052 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.204045 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.204200 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.204091 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.204956 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.204934 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.211731 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.211711 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r8l5k\" (UniqueName: \"kubernetes.io/projected/876e0cb3-5cff-43e6-99b2-32ba93fa9cbe-kube-api-access-r8l5k\") pod \"prometheus-k8s-0\" (UID: \"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.276206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.276130 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1bfe7f7-d994-46da-a6d1-45d314abc2ff" path="/var/lib/kubelet/pods/b1bfe7f7-d994-46da-a6d1-45d314abc2ff/volumes" Jun 12 18:33:39.345664 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.345633 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:33:39.483004 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.482979 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:33:39.484893 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:33:39.484868 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod876e0cb3_5cff_43e6_99b2_32ba93fa9cbe.slice/crio-b9bf5444250965815244d748e8e820a0cf2d8a99146572d5216617a3312e8775 WatchSource:0}: Error finding container b9bf5444250965815244d748e8e820a0cf2d8a99146572d5216617a3312e8775: Status 404 returned error can't find the container with id b9bf5444250965815244d748e8e820a0cf2d8a99146572d5216617a3312e8775 Jun 12 18:33:39.969574 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.969537 2561 generic.go:356] "Generic (PLEG): container finished" podID="876e0cb3-5cff-43e6-99b2-32ba93fa9cbe" containerID="2cb66b2cfafca9eeb9fc9f018dbb0480c841b7fe73d16ff4322254df9be06bdc" exitCode=0 Jun 12 18:33:39.969997 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.969622 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerDied","Data":"2cb66b2cfafca9eeb9fc9f018dbb0480c841b7fe73d16ff4322254df9be06bdc"} Jun 12 18:33:39.969997 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:39.969695 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerStarted","Data":"b9bf5444250965815244d748e8e820a0cf2d8a99146572d5216617a3312e8775"} Jun 12 18:33:40.980805 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:40.980768 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerStarted","Data":"3a57c52a1cdd9f8901853945026e515da25d00c10e84f3b9b9ddc135d43cc528"} Jun 12 18:33:40.981187 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:40.980856 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerStarted","Data":"e7dc96526af00fb228fbde28f1adee242d18c0f8918ae9a4e33197af41ac30ff"} Jun 12 18:33:40.981187 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:40.980882 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerStarted","Data":"f7e07bc01631249a499bd981c42d9278f7e489d78364654a40320bb2e4c3c5a8"} Jun 12 18:33:40.981187 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:40.980906 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerStarted","Data":"0e6ac314b3acfcbc335166a4e70268c72c76038e7206f76acc2b51dd512e8a9b"} Jun 12 18:33:40.981187 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:40.980933 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerStarted","Data":"54617e5e1c3cd3363ac8b449b98d62384611f6311533fca799838e3d06f6fdee"} Jun 12 18:33:40.981187 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:40.980956 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"876e0cb3-5cff-43e6-99b2-32ba93fa9cbe","Type":"ContainerStarted","Data":"991dafde6aa40e79fd86f11169ce7604d337e618e80db91f66cecfabf08d43e4"} Jun 12 18:33:41.053858 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:41.053789 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.036936325 podStartE2EDuration="2.053774575s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.83825ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:33:41.049457948 +0000 UTC m=+168.249411036" watchObservedRunningTime="2026-06-12 18:33:41.053774575 +0000 UTC m=+168.253727625" Jun 12 18:33:44.346125 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:33:44.346089 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:34:39.346777 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:34:39.346724 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:34:39.361745 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:34:39.361724 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:34:40.215924 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:34:40.215898 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:35:53.228127 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:35:53.228099 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:35:53.228638 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:35:53.228525 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:35:53.230602 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:35:53.230582 2561 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 18:37:07.354778 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.354742 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x"] Jun 12 18:37:07.357850 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.357834 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.361688 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.361665 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 18:37:07.361790 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.361736 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 18:37:07.363139 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.363119 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 18:37:07.363139 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.363135 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 18:37:07.363387 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.363374 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-dz8cx\"" Jun 12 18:37:07.379556 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.379535 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f2e395c-3986-45c6-894d-daf9f86bffbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.379649 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.379567 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f2e395c-3986-45c6-894d-daf9f86bffbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.379649 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.379609 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f2e395c-3986-45c6-894d-daf9f86bffbe-tmp\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.379717 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.379651 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4x2k\" (UniqueName: \"kubernetes.io/projected/3f2e395c-3986-45c6-894d-daf9f86bffbe-kube-api-access-x4x2k\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.379750 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.379711 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f2e395c-3986-45c6-894d-daf9f86bffbe-manifests\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.397057 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.397034 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x"] Jun 12 18:37:07.480218 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.480192 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f2e395c-3986-45c6-894d-daf9f86bffbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.480420 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.480243 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f2e395c-3986-45c6-894d-daf9f86bffbe-tmp\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.480420 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.480264 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4x2k\" (UniqueName: \"kubernetes.io/projected/3f2e395c-3986-45c6-894d-daf9f86bffbe-kube-api-access-x4x2k\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.480420 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.480286 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f2e395c-3986-45c6-894d-daf9f86bffbe-manifests\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.480420 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.480327 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f2e395c-3986-45c6-894d-daf9f86bffbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.482977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.480955 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3f2e395c-3986-45c6-894d-daf9f86bffbe-manifests\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.482977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.483396 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3f2e395c-3986-45c6-894d-daf9f86bffbe-tmp\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.482977 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.483750 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3f2e395c-3986-45c6-894d-daf9f86bffbe-apiservice-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.487279 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.487260 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3f2e395c-3986-45c6-894d-daf9f86bffbe-webhook-cert\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.506845 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.506819 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4x2k\" (UniqueName: \"kubernetes.io/projected/3f2e395c-3986-45c6-894d-daf9f86bffbe-kube-api-access-x4x2k\") pod \"opendatahub-operator-controller-manager-666df475c6-9zh6x\" (UID: \"3f2e395c-3986-45c6-894d-daf9f86bffbe\") " pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.668228 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.668141 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:07.839593 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.839561 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x"] Jun 12 18:37:07.842924 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:37:07.842894 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f2e395c_3986_45c6_894d_daf9f86bffbe.slice/crio-9a658806bacec5cfcff57d3a876e1a019bef96be0e21225fd15fad1197e2c90e WatchSource:0}: Error finding container 9a658806bacec5cfcff57d3a876e1a019bef96be0e21225fd15fad1197e2c90e: Status 404 returned error can't find the container with id 9a658806bacec5cfcff57d3a876e1a019bef96be0e21225fd15fad1197e2c90e Jun 12 18:37:07.844704 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:07.844686 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:37:08.734950 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:08.734908 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" event={"ID":"3f2e395c-3986-45c6-894d-daf9f86bffbe","Type":"ContainerStarted","Data":"9a658806bacec5cfcff57d3a876e1a019bef96be0e21225fd15fad1197e2c90e"} Jun 12 18:37:11.748661 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:11.748624 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" event={"ID":"3f2e395c-3986-45c6-894d-daf9f86bffbe","Type":"ContainerStarted","Data":"46ae743a4a21e8bec73bddfe52451b4ad041b7ab60d30f9a5d6fa348ef765c77"} Jun 12 18:37:12.753288 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:12.753254 2561 generic.go:356] "Generic (PLEG): container finished" podID="3f2e395c-3986-45c6-894d-daf9f86bffbe" containerID="46ae743a4a21e8bec73bddfe52451b4ad041b7ab60d30f9a5d6fa348ef765c77" exitCode=0 Jun 12 18:37:12.753712 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:12.753342 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" event={"ID":"3f2e395c-3986-45c6-894d-daf9f86bffbe","Type":"ContainerDied","Data":"46ae743a4a21e8bec73bddfe52451b4ad041b7ab60d30f9a5d6fa348ef765c77"} Jun 12 18:37:13.764069 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:13.764028 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" event={"ID":"3f2e395c-3986-45c6-894d-daf9f86bffbe","Type":"ContainerStarted","Data":"9974bb65a78f4f45bd08044d0fbe9347b3d9f65770d08499e896fde54e77d006"} Jun 12 18:37:13.764581 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:13.764187 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:13.795799 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:13.795750 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" podStartSLOduration=2.605213167 podStartE2EDuration="6.795736183s" totalImagesPullingTime="3.213738764s" totalInitContainerRuntime="976.784252ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:07 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:13.795263459 +0000 UTC m=+380.995216545" watchObservedRunningTime="2026-06-12 18:37:13.795736183 +0000 UTC m=+380.995689234" Jun 12 18:37:24.139191 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.139155 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb"] Jun 12 18:37:24.247738 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.247702 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb"] Jun 12 18:37:24.247909 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.247824 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.250830 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.250805 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 18:37:24.250995 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.250846 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 18:37:24.252055 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.252021 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:37:24.252055 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.252019 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 18:37:24.252055 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.252050 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 18:37:24.252298 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.252179 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5s5mb\"" Jun 12 18:37:24.321847 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.321817 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e404ca4d-8324-4e29-ae8e-cd84282d00bd-metrics-cert\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.321993 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.321913 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldpnl\" (UniqueName: \"kubernetes.io/projected/e404ca4d-8324-4e29-ae8e-cd84282d00bd-kube-api-access-ldpnl\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.322091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.322067 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e404ca4d-8324-4e29-ae8e-cd84282d00bd-cert\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.322187 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.322163 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e404ca4d-8324-4e29-ae8e-cd84282d00bd-manager-config\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.423388 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.423303 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e404ca4d-8324-4e29-ae8e-cd84282d00bd-manager-config\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.423542 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.423397 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e404ca4d-8324-4e29-ae8e-cd84282d00bd-metrics-cert\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.423542 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.423428 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldpnl\" (UniqueName: \"kubernetes.io/projected/e404ca4d-8324-4e29-ae8e-cd84282d00bd-kube-api-access-ldpnl\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.423542 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.423466 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e404ca4d-8324-4e29-ae8e-cd84282d00bd-cert\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.424077 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.424055 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/e404ca4d-8324-4e29-ae8e-cd84282d00bd-manager-config\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.425714 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.425694 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/e404ca4d-8324-4e29-ae8e-cd84282d00bd-metrics-cert\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.425793 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.425771 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e404ca4d-8324-4e29-ae8e-cd84282d00bd-cert\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.434755 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.434733 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldpnl\" (UniqueName: \"kubernetes.io/projected/e404ca4d-8324-4e29-ae8e-cd84282d00bd-kube-api-access-ldpnl\") pod \"lws-controller-manager-7dc544865f-vz8kb\" (UID: \"e404ca4d-8324-4e29-ae8e-cd84282d00bd\") " pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.557627 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.557588 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:24.687189 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.687112 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb"] Jun 12 18:37:24.690210 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:37:24.690186 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode404ca4d_8324_4e29_ae8e_cd84282d00bd.slice/crio-de9c9295e82f973307d81ddc5411323a1120239779e913e9ae945bf19a1b8789 WatchSource:0}: Error finding container de9c9295e82f973307d81ddc5411323a1120239779e913e9ae945bf19a1b8789: Status 404 returned error can't find the container with id de9c9295e82f973307d81ddc5411323a1120239779e913e9ae945bf19a1b8789 Jun 12 18:37:24.770399 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.770365 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-666df475c6-9zh6x" Jun 12 18:37:24.808432 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:24.808398 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" event={"ID":"e404ca4d-8324-4e29-ae8e-cd84282d00bd","Type":"ContainerStarted","Data":"de9c9295e82f973307d81ddc5411323a1120239779e913e9ae945bf19a1b8789"} Jun 12 18:37:27.043830 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.043764 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-75986b966d-2xcjk"] Jun 12 18:37:27.046606 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.046585 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.053355 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.053327 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 18:37:27.053638 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.053594 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 18:37:27.053771 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.053721 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 18:37:27.054465 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.054447 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-6f49g\"" Jun 12 18:37:27.054782 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.054752 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 18:37:27.079943 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.079915 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75986b966d-2xcjk"] Jun 12 18:37:27.150068 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.150045 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tls-certs\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.150167 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.150085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9g45b\" (UniqueName: \"kubernetes.io/projected/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-kube-api-access-9g45b\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.150203 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.150166 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tmp\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.251544 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.251508 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tls-certs\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.251696 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.251559 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9g45b\" (UniqueName: \"kubernetes.io/projected/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-kube-api-access-9g45b\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.251696 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.251605 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tmp\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.251696 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:37:27.251657 2561 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jun 12 18:37:27.251834 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:37:27.251730 2561 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tls-certs podName:9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6 nodeName:}" failed. No retries permitted until 2026-06-12 18:37:27.751713616 +0000 UTC m=+394.951666657 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tls-certs") pod "kube-auth-proxy-75986b966d-2xcjk" (UID: "9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6") : secret "kube-auth-proxy-tls" not found Jun 12 18:37:27.253882 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.253860 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tmp\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.267094 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.267069 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9g45b\" (UniqueName: \"kubernetes.io/projected/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-kube-api-access-9g45b\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.755973 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.755936 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tls-certs\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.758312 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.758284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6-tls-certs\") pod \"kube-auth-proxy-75986b966d-2xcjk\" (UID: \"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6\") " pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:27.824165 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.824132 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" event={"ID":"e404ca4d-8324-4e29-ae8e-cd84282d00bd","Type":"ContainerStarted","Data":"c59505f7ceb6b10d93fa6140268565d8da0ed738775b06f6fd7bcdf400006e85"} Jun 12 18:37:27.824308 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.824246 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:37:27.860852 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.860794 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" podStartSLOduration=1.446939821 podStartE2EDuration="3.860779759s" totalImagesPullingTime="2.413839938s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:27.853969162 +0000 UTC m=+395.053922214" watchObservedRunningTime="2026-06-12 18:37:27.860779759 +0000 UTC m=+395.060732809" Jun 12 18:37:27.960391 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:27.960364 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" Jun 12 18:37:28.090799 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:28.090773 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-75986b966d-2xcjk"] Jun 12 18:37:28.092901 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:37:28.092877 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c72f37d_5405_4a4d_a7d9_0cb9fba84dd6.slice/crio-fd2b6518cd16ba52c8b350f4a28826b3a1fcb1a5bdf2d75c9e7db56f915c9ebb WatchSource:0}: Error finding container fd2b6518cd16ba52c8b350f4a28826b3a1fcb1a5bdf2d75c9e7db56f915c9ebb: Status 404 returned error can't find the container with id fd2b6518cd16ba52c8b350f4a28826b3a1fcb1a5bdf2d75c9e7db56f915c9ebb Jun 12 18:37:28.830740 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:28.830702 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" event={"ID":"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6","Type":"ContainerStarted","Data":"fd2b6518cd16ba52c8b350f4a28826b3a1fcb1a5bdf2d75c9e7db56f915c9ebb"} Jun 12 18:37:30.840554 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:30.840516 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" event={"ID":"9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6","Type":"ContainerStarted","Data":"aaafb3211c9692fb47d672a07effaa4dae5734d1809aaaff68f97b3c00d097e6"} Jun 12 18:37:30.858268 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:30.858218 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-75986b966d-2xcjk" podStartSLOduration=1.191226073 podStartE2EDuration="3.858202467s" totalImagesPullingTime="2.666976394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:37:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:37:30.856709589 +0000 UTC m=+398.056662640" watchObservedRunningTime="2026-06-12 18:37:30.858202467 +0000 UTC m=+398.058155518" Jun 12 18:37:38.832718 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:37:38.832688 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7dc544865f-vz8kb" Jun 12 18:39:18.457135 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.457099 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5"] Jun 12 18:39:18.460295 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.460279 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.463020 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.462993 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 12 18:39:18.463145 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.462993 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:39:18.463145 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.463031 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:39:18.464381 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.464362 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 12 18:39:18.464381 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.464376 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g5vqp\"" Jun 12 18:39:18.470385 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.470362 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5"] Jun 12 18:39:18.580497 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.580440 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a59538aa-0aab-491d-8e3a-5b4b297ecf81-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.580497 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.580500 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a59538aa-0aab-491d-8e3a-5b4b297ecf81-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.580718 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.580607 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkksw\" (UniqueName: \"kubernetes.io/projected/a59538aa-0aab-491d-8e3a-5b4b297ecf81-kube-api-access-bkksw\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.681869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.681831 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a59538aa-0aab-491d-8e3a-5b4b297ecf81-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.681869 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.681872 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a59538aa-0aab-491d-8e3a-5b4b297ecf81-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.682126 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.681937 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkksw\" (UniqueName: \"kubernetes.io/projected/a59538aa-0aab-491d-8e3a-5b4b297ecf81-kube-api-access-bkksw\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.682513 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.682466 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a59538aa-0aab-491d-8e3a-5b4b297ecf81-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.684271 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.684248 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/a59538aa-0aab-491d-8e3a-5b4b297ecf81-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.690171 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.690153 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkksw\" (UniqueName: \"kubernetes.io/projected/a59538aa-0aab-491d-8e3a-5b4b297ecf81-kube-api-access-bkksw\") pod \"kuadrant-console-plugin-66b5774985-j6ln5\" (UID: \"a59538aa-0aab-491d-8e3a-5b4b297ecf81\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.769793 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.769700 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" Jun 12 18:39:18.897650 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:18.897614 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5"] Jun 12 18:39:18.900129 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:39:18.900101 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda59538aa_0aab_491d_8e3a_5b4b297ecf81.slice/crio-e422ec1d198c103d37318fcfc7119d5c4c2f9ea97773bda1d6291850672f1215 WatchSource:0}: Error finding container e422ec1d198c103d37318fcfc7119d5c4c2f9ea97773bda1d6291850672f1215: Status 404 returned error can't find the container with id e422ec1d198c103d37318fcfc7119d5c4c2f9ea97773bda1d6291850672f1215 Jun 12 18:39:19.255354 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:19.255320 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" event={"ID":"a59538aa-0aab-491d-8e3a-5b4b297ecf81","Type":"ContainerStarted","Data":"e422ec1d198c103d37318fcfc7119d5c4c2f9ea97773bda1d6291850672f1215"} Jun 12 18:39:43.368669 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:43.368628 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" event={"ID":"a59538aa-0aab-491d-8e3a-5b4b297ecf81","Type":"ContainerStarted","Data":"f6e9408ae7117cf2ba2097932a6496aaa36f0978f006b5ebb40d6c0cae273eb4"} Jun 12 18:39:43.384692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:43.384631 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-j6ln5" podStartSLOduration=1.309628966 podStartE2EDuration="25.384611751s" totalImagesPullingTime="24.074982785s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:39:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:43.383559988 +0000 UTC m=+530.583513064" watchObservedRunningTime="2026-06-12 18:39:43.384611751 +0000 UTC m=+530.584564807" Jun 12 18:39:57.754462 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.754428 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht"] Jun 12 18:39:57.773772 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.773742 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht"] Jun 12 18:39:57.773911 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.773838 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.776316 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.776294 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-f8hj7\"" Jun 12 18:39:57.776732 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.776717 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 12 18:39:57.829830 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.829801 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.829923 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.829831 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.829923 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.829865 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.829923 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.829902 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c460a28-c1da-4c84-96c5-c5774a26ade5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.830027 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.829981 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.830027 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.829998 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7cl4\" (UniqueName: \"kubernetes.io/projected/5c460a28-c1da-4c84-96c5-c5774a26ade5-kube-api-access-w7cl4\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.830027 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.830023 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.830119 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.830055 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.830119 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.830071 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931266 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931236 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931434 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931274 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931560 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931540 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931627 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931573 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c460a28-c1da-4c84-96c5-c5774a26ade5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931626 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931644 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7cl4\" (UniqueName: \"kubernetes.io/projected/5c460a28-c1da-4c84-96c5-c5774a26ade5-kube-api-access-w7cl4\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931692 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931675 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931849 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931757 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.931849 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.931781 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.932237 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.932184 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-credential-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.932348 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.932251 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-data\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.932348 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.932284 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-workload-socket\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.932348 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.932314 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5c460a28-c1da-4c84-96c5-c5774a26ade5-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.932543 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.932371 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-workload-certs\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.933745 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.933724 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-envoy\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.933994 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.933974 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-podinfo\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.943264 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.943237 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5c460a28-c1da-4c84-96c5-c5774a26ade5-istio-token\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:57.943467 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:57.943451 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7cl4\" (UniqueName: \"kubernetes.io/projected/5c460a28-c1da-4c84-96c5-c5774a26ade5-kube-api-access-w7cl4\") pod \"maas-default-gateway-openshift-default-687ff6996-ghkht\" (UID: \"5c460a28-c1da-4c84-96c5-c5774a26ade5\") " pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:58.086153 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:58.086066 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:39:58.223025 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:58.223000 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht"] Jun 12 18:39:58.225162 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:39:58.225136 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c460a28_c1da_4c84_96c5_c5774a26ade5.slice/crio-ca9668ff206192d154933bf06d78215f7ce9a733695dd4bf0e9da47b11c4c679 WatchSource:0}: Error finding container ca9668ff206192d154933bf06d78215f7ce9a733695dd4bf0e9da47b11c4c679: Status 404 returned error can't find the container with id ca9668ff206192d154933bf06d78215f7ce9a733695dd4bf0e9da47b11c4c679 Jun 12 18:39:58.430290 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:39:58.430250 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" event={"ID":"5c460a28-c1da-4c84-96c5-c5774a26ade5","Type":"ContainerStarted","Data":"ca9668ff206192d154933bf06d78215f7ce9a733695dd4bf0e9da47b11c4c679"} Jun 12 18:40:00.491042 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:00.490805 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:40:00.491042 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:00.490900 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:40:00.491042 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:00.490939 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:40:01.445013 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:01.444972 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" event={"ID":"5c460a28-c1da-4c84-96c5-c5774a26ade5","Type":"ContainerStarted","Data":"705145595eace83083b7be8834a28bdb26775230e91f634bc32d1734b09f50f3"} Jun 12 18:40:01.469440 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:01.469377 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" podStartSLOduration=2.206138215 podStartE2EDuration="4.469361353s" totalImagesPullingTime="2.263223138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:39:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:40:01.467551357 +0000 UTC m=+548.667504409" watchObservedRunningTime="2026-06-12 18:40:01.469361353 +0000 UTC m=+548.669314404" Jun 12 18:40:02.087143 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.087104 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:40:02.091645 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.091616 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:40:02.449966 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.449934 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:40:02.451096 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.451077 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:40:02.842396 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.842360 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:40:02.894555 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.894514 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:40:02.894555 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.894540 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:02.894798 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.894584 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:40:02.897032 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.897014 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 18:40:02.977299 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.977265 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s8t6r\" (UniqueName: \"kubernetes.io/projected/e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27-kube-api-access-s8t6r\") pod \"limitador-limitador-54d6d988d5-mk5lq\" (UID: \"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:02.977508 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:02.977368 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27-config-file\") pod \"limitador-limitador-54d6d988d5-mk5lq\" (UID: \"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:03.078180 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:03.078143 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27-config-file\") pod \"limitador-limitador-54d6d988d5-mk5lq\" (UID: \"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:03.078356 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:03.078200 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s8t6r\" (UniqueName: \"kubernetes.io/projected/e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27-kube-api-access-s8t6r\") pod \"limitador-limitador-54d6d988d5-mk5lq\" (UID: \"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:03.078852 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:03.078832 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27-config-file\") pod \"limitador-limitador-54d6d988d5-mk5lq\" (UID: \"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:03.086911 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:03.086882 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s8t6r\" (UniqueName: \"kubernetes.io/projected/e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27-kube-api-access-s8t6r\") pod \"limitador-limitador-54d6d988d5-mk5lq\" (UID: \"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:03.204689 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:03.204601 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:03.371223 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:03.368796 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:40:03.455143 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:03.455059 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" event={"ID":"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27","Type":"ContainerStarted","Data":"9315daf5d8857f6aa3f1f6c33ec9a85990238fe5bc9870f434ea315afc1e0d78"} Jun 12 18:40:07.473724 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:07.473689 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" event={"ID":"e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27","Type":"ContainerStarted","Data":"f00d300f89a55db9a8e5e2c7de6b2a329f8d8539899f7d40547d6ed9a663ba94"} Jun 12 18:40:07.474091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:07.473773 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:07.492422 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:07.492369 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" podStartSLOduration=2.400661082 podStartE2EDuration="5.492353363s" totalImagesPullingTime="3.091692281s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:40:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:40:07.491101133 +0000 UTC m=+554.691054184" watchObservedRunningTime="2026-06-12 18:40:07.492353363 +0000 UTC m=+554.692306414" Jun 12 18:40:18.478780 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:18.478749 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-mk5lq" Jun 12 18:40:53.254422 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:53.254394 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:40:53.254898 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:40:53.254801 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:41:05.773968 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.773881 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:41:05.776401 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.776378 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:05.778955 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.778927 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-85pkw\"" Jun 12 18:41:05.779049 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.778932 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 18:41:05.779881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.779859 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 18:41:05.779979 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.779925 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 18:41:05.785872 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.785847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:41:05.928616 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:05.928586 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bkzx7\" (UniqueName: \"kubernetes.io/projected/bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea-kube-api-access-bkzx7\") pod \"maas-keycloak-0\" (UID: \"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:06.029714 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:06.029619 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bkzx7\" (UniqueName: \"kubernetes.io/projected/bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea-kube-api-access-bkzx7\") pod \"maas-keycloak-0\" (UID: \"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:06.038779 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:06.038747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bkzx7\" (UniqueName: \"kubernetes.io/projected/bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea-kube-api-access-bkzx7\") pod \"maas-keycloak-0\" (UID: \"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:06.086742 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:06.086702 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:06.213872 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:06.213848 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:41:06.216273 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:41:06.216235 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf8b3d62_5bc5_4e45_be58_0a7d4983a2ea.slice/crio-d82a996097180247e118ce79b2afbbefaa6b9dcf81198bca1379d233af707b79 WatchSource:0}: Error finding container d82a996097180247e118ce79b2afbbefaa6b9dcf81198bca1379d233af707b79: Status 404 returned error can't find the container with id d82a996097180247e118ce79b2afbbefaa6b9dcf81198bca1379d233af707b79 Jun 12 18:41:06.724671 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:06.724633 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea","Type":"ContainerStarted","Data":"d82a996097180247e118ce79b2afbbefaa6b9dcf81198bca1379d233af707b79"} Jun 12 18:41:11.750601 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:11.750556 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea","Type":"ContainerStarted","Data":"316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb"} Jun 12 18:41:11.770009 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:11.769943 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.730489462 podStartE2EDuration="6.769923004s" totalImagesPullingTime="5.039433542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:41:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:41:11.767533224 +0000 UTC m=+618.967486296" watchObservedRunningTime="2026-06-12 18:41:11.769923004 +0000 UTC m=+618.969876056" Jun 12 18:41:12.087160 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:12.087049 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:12.088828 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:12.088789 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:13.088091 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:13.088040 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:14.087894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:14.087843 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:15.088193 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:15.088130 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:16.086899 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:16.086857 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:16.087257 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:16.087220 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:17.087321 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:17.087261 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:18.087157 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:18.087110 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:19.087444 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:19.087379 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:20.088177 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:20.088123 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:21.087882 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:21.087828 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:22.087755 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:22.087689 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:23.088022 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:23.087967 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:24.087840 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:24.087800 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.24:9000/health/started\": dial tcp 10.133.0.24:9000: connect: connection refused" Jun 12 18:41:25.208586 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:25.208538 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 18:41:25.229050 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:25.228217 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:41:35.214841 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:41:35.214807 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:42:16.006466 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:16.006427 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:42:24.098417 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:24.098381 2561 generic.go:356] "Generic (PLEG): container finished" podID="5c460a28-c1da-4c84-96c5-c5774a26ade5" containerID="705145595eace83083b7be8834a28bdb26775230e91f634bc32d1734b09f50f3" exitCode=0 Jun 12 18:42:24.098837 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:24.098453 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" event={"ID":"5c460a28-c1da-4c84-96c5-c5774a26ade5","Type":"ContainerDied","Data":"705145595eace83083b7be8834a28bdb26775230e91f634bc32d1734b09f50f3"} Jun 12 18:42:24.098879 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:24.098835 2561 scope.go:117] "RemoveContainer" containerID="705145595eace83083b7be8834a28bdb26775230e91f634bc32d1734b09f50f3" Jun 12 18:42:24.099885 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:24.099839 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:42:24.099947 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:24.099934 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:42:24.099987 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:24.099970 2561 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jun 12 18:42:25.106186 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:25.106152 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" event={"ID":"5c460a28-c1da-4c84-96c5-c5774a26ade5","Type":"ContainerStarted","Data":"9fd6f8488e0a62a797c62ad768c804684d4e327622a3daf0c8f3e692542ba16c"} Jun 12 18:42:26.086651 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:26.086613 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:42:26.086970 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:26.086941 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ghkht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 12 18:42:26.087054 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:26.086997 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" podUID="5c460a28-c1da-4c84-96c5-c5774a26ade5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 12 18:42:27.086926 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:27.086885 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ghkht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 12 18:42:27.087321 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:27.086942 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" podUID="5c460a28-c1da-4c84-96c5-c5774a26ade5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 12 18:42:28.086843 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:28.086805 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ghkht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 12 18:42:28.087015 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:28.086868 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" podUID="5c460a28-c1da-4c84-96c5-c5774a26ade5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 12 18:42:29.086645 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:29.086608 2561 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-687ff6996-ghkht container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" start-of-body= Jun 12 18:42:29.086824 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:29.086658 2561 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" podUID="5c460a28-c1da-4c84-96c5-c5774a26ade5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.22:15021/healthz/ready\": dial tcp 10.133.0.22:15021: connect: connection refused" Jun 12 18:42:30.090372 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:30.090342 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:42:30.090849 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:30.090761 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:42:30.091365 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:42:30.091344 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-687ff6996-ghkht" Jun 12 18:44:28.477964 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:28.477923 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:44:28.478570 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:28.478187 2561 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" containerID="cri-o://316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb" gracePeriod=30 Jun 12 18:44:30.524849 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.524826 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:30.638826 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.638791 2561 generic.go:356] "Generic (PLEG): container finished" podID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerID="316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb" exitCode=143 Jun 12 18:44:30.639007 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.638834 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:30.639007 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.638842 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea","Type":"ContainerDied","Data":"316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb"} Jun 12 18:44:30.639007 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.638891 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea","Type":"ContainerDied","Data":"d82a996097180247e118ce79b2afbbefaa6b9dcf81198bca1379d233af707b79"} Jun 12 18:44:30.639007 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.638917 2561 scope.go:117] "RemoveContainer" containerID="316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb" Jun 12 18:44:30.647756 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.647739 2561 scope.go:117] "RemoveContainer" containerID="316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb" Jun 12 18:44:30.648024 ip-10-0-128-4 kubenswrapper[2561]: E0612 18:44:30.648004 2561 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb\": container with ID starting with 316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb not found: ID does not exist" containerID="316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb" Jun 12 18:44:30.648086 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.648035 2561 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb"} err="failed to get container status \"316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb\": rpc error: code = NotFound desc = could not find container \"316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb\": container with ID starting with 316b290b27da9915e05cdab47613abeab61b567f00ffca2ba43532e36d09ceeb not found: ID does not exist" Jun 12 18:44:30.700874 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.700845 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bkzx7\" (UniqueName: \"kubernetes.io/projected/bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea-kube-api-access-bkzx7\") pod \"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea\" (UID: \"bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea\") " Jun 12 18:44:30.702880 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.702856 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea-kube-api-access-bkzx7" (OuterVolumeSpecName: "kube-api-access-bkzx7") pod "bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" (UID: "bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea"). InnerVolumeSpecName "kube-api-access-bkzx7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:44:30.801852 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.801820 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bkzx7\" (UniqueName: \"kubernetes.io/projected/bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea-kube-api-access-bkzx7\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:44:30.959434 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.959377 2561 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:44:30.961178 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.961157 2561 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:44:30.984750 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.984714 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:44:30.985034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.985023 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" Jun 12 18:44:30.985076 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.985036 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" Jun 12 18:44:30.985109 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.985094 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" containerName="keycloak" Jun 12 18:44:30.989246 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.989228 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:30.991880 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.991862 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 18:44:30.991985 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.991905 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 18:44:30.991985 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.991930 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-85pkw\"" Jun 12 18:44:30.991985 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.991864 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 12 18:44:30.992163 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.991983 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 12 18:44:30.996519 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:30.996497 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:44:31.103461 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.103429 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7d3d0b0f-a51a-4e61-9104-de21f1ea03a8-test-realms\") pod \"maas-keycloak-0\" (UID: \"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:31.103648 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.103494 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n959f\" (UniqueName: \"kubernetes.io/projected/7d3d0b0f-a51a-4e61-9104-de21f1ea03a8-kube-api-access-n959f\") pod \"maas-keycloak-0\" (UID: \"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:31.205064 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.204973 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7d3d0b0f-a51a-4e61-9104-de21f1ea03a8-test-realms\") pod \"maas-keycloak-0\" (UID: \"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:31.205064 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.205050 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n959f\" (UniqueName: \"kubernetes.io/projected/7d3d0b0f-a51a-4e61-9104-de21f1ea03a8-kube-api-access-n959f\") pod \"maas-keycloak-0\" (UID: \"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:31.205794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.205777 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/7d3d0b0f-a51a-4e61-9104-de21f1ea03a8-test-realms\") pod \"maas-keycloak-0\" (UID: \"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:31.213589 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.213569 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n959f\" (UniqueName: \"kubernetes.io/projected/7d3d0b0f-a51a-4e61-9104-de21f1ea03a8-kube-api-access-n959f\") pod \"maas-keycloak-0\" (UID: \"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8\") " pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:31.276319 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.276285 2561 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea" path="/var/lib/kubelet/pods/bf8b3d62-5bc5-4e45-be58-0a7d4983a2ea/volumes" Jun 12 18:44:31.300611 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.300591 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:31.429443 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.429418 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 12 18:44:31.431629 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:44:31.431603 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d3d0b0f_a51a_4e61_9104_de21f1ea03a8.slice/crio-5436d59149a7f58810ebc1c14ec3db2f3a8004602fda494cbfc98cb116480fde WatchSource:0}: Error finding container 5436d59149a7f58810ebc1c14ec3db2f3a8004602fda494cbfc98cb116480fde: Status 404 returned error can't find the container with id 5436d59149a7f58810ebc1c14ec3db2f3a8004602fda494cbfc98cb116480fde Jun 12 18:44:31.432835 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.432820 2561 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:44:31.646063 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:31.646030 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8","Type":"ContainerStarted","Data":"5436d59149a7f58810ebc1c14ec3db2f3a8004602fda494cbfc98cb116480fde"} Jun 12 18:44:32.653110 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:32.653076 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"7d3d0b0f-a51a-4e61-9104-de21f1ea03a8","Type":"ContainerStarted","Data":"29b421deb554024c035876691eb7590f27547546ba3ed441554271ba84df9592"} Jun 12 18:44:32.671713 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:32.671664 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=2.240765725 podStartE2EDuration="2.671648418s" totalImagesPullingTime="430.882693ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:44:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:44:32.669863043 +0000 UTC m=+819.869816120" watchObservedRunningTime="2026-06-12 18:44:32.671648418 +0000 UTC m=+819.871601472" Jun 12 18:44:33.301826 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:33.301779 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:33.303711 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:33.303667 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:34.302040 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:34.301986 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:35.301634 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:35.301586 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:36.301901 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:36.301845 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:37.301363 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:37.301306 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:38.302028 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:38.301964 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:39.302028 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:39.301975 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:40.301930 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:40.301881 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:41.301028 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:41.300980 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:41.301400 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:41.301363 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:42.301171 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:42.301120 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:43.301809 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:43.301769 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:44.301914 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:44.301868 2561 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.25:9000/health/started\": dial tcp 10.133.0.25:9000: connect: connection refused" Jun 12 18:44:45.395282 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:45.395242 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 12 18:44:45.418942 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:45.418887 2561 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="7d3d0b0f-a51a-4e61-9104-de21f1ea03a8" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:44:55.401290 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:44:55.401257 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 12 18:45:00.138425 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.138386 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29688165-rcbnc"] Jun 12 18:45:00.142717 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.142692 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" Jun 12 18:45:00.145022 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.144996 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7w96b\"" Jun 12 18:45:00.148843 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.148816 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688165-rcbnc"] Jun 12 18:45:00.281328 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.281287 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jf79s\" (UniqueName: \"kubernetes.io/projected/8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f-kube-api-access-jf79s\") pod \"maas-api-key-cleanup-29688165-rcbnc\" (UID: \"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f\") " pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" Jun 12 18:45:00.382204 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.382156 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jf79s\" (UniqueName: \"kubernetes.io/projected/8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f-kube-api-access-jf79s\") pod \"maas-api-key-cleanup-29688165-rcbnc\" (UID: \"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f\") " pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" Jun 12 18:45:00.391297 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.391233 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jf79s\" (UniqueName: \"kubernetes.io/projected/8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f-kube-api-access-jf79s\") pod \"maas-api-key-cleanup-29688165-rcbnc\" (UID: \"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f\") " pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" Jun 12 18:45:00.455917 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.455877 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" Jun 12 18:45:00.588627 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.588593 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29688165-rcbnc"] Jun 12 18:45:00.592095 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:45:00.592066 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f9c3491_deaa_40d1_9ae8_3cbf5d77f63f.slice/crio-1502eedc96e2377a211eb0b99ac71bcf044fa7d3c055ea65c39e3661e0c9eb42 WatchSource:0}: Error finding container 1502eedc96e2377a211eb0b99ac71bcf044fa7d3c055ea65c39e3661e0c9eb42: Status 404 returned error can't find the container with id 1502eedc96e2377a211eb0b99ac71bcf044fa7d3c055ea65c39e3661e0c9eb42 Jun 12 18:45:00.810385 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:00.810294 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" event={"ID":"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f","Type":"ContainerStarted","Data":"1502eedc96e2377a211eb0b99ac71bcf044fa7d3c055ea65c39e3661e0c9eb42"} Jun 12 18:45:03.824955 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:03.824917 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" event={"ID":"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f","Type":"ContainerStarted","Data":"5fd7c7f9b53410ea0514372151ac162cb880bda7b6a4105e0dc09acecdcf0579"} Jun 12 18:45:03.851894 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:03.851845 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" podStartSLOduration=1.062613911 podStartE2EDuration="3.851827798s" totalImagesPullingTime="2.789213887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:45:03.851378401 +0000 UTC m=+851.051331452" watchObservedRunningTime="2026-06-12 18:45:03.851827798 +0000 UTC m=+851.051780848" Jun 12 18:45:04.830728 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:04.830697 2561 generic.go:356] "Generic (PLEG): container finished" podID="8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f" containerID="5fd7c7f9b53410ea0514372151ac162cb880bda7b6a4105e0dc09acecdcf0579" exitCode=0 Jun 12 18:45:04.831108 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:04.830750 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" event={"ID":"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f","Type":"ContainerDied","Data":"5fd7c7f9b53410ea0514372151ac162cb880bda7b6a4105e0dc09acecdcf0579"} Jun 12 18:45:05.961881 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:05.961853 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" Jun 12 18:45:06.037979 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:06.037942 2561 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jf79s\" (UniqueName: \"kubernetes.io/projected/8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f-kube-api-access-jf79s\") pod \"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f\" (UID: \"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f\") " Jun 12 18:45:06.040076 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:06.040052 2561 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f-kube-api-access-jf79s" (OuterVolumeSpecName: "kube-api-access-jf79s") pod "8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f" (UID: "8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f"). InnerVolumeSpecName "kube-api-access-jf79s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:45:06.139098 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:06.139011 2561 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jf79s\" (UniqueName: \"kubernetes.io/projected/8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f-kube-api-access-jf79s\") on node \"ip-10-0-128-4.ec2.internal\" DevicePath \"\"" Jun 12 18:45:06.842148 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:06.842115 2561 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" Jun 12 18:45:06.842344 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:06.842109 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29688165-rcbnc" event={"ID":"8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f","Type":"ContainerDied","Data":"1502eedc96e2377a211eb0b99ac71bcf044fa7d3c055ea65c39e3661e0c9eb42"} Jun 12 18:45:06.842344 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:06.842263 2561 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1502eedc96e2377a211eb0b99ac71bcf044fa7d3c055ea65c39e3661e0c9eb42" Jun 12 18:45:14.286290 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:14.286248 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:45:25.385805 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.385773 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb"] Jun 12 18:45:25.386231 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.386091 2561 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f" containerName="cleanup" Jun 12 18:45:25.386231 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.386102 2561 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f" containerName="cleanup" Jun 12 18:45:25.386231 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.386199 2561 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f" containerName="cleanup" Jun 12 18:45:25.394049 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.394022 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.399352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.399319 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 12 18:45:25.399513 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.399388 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 18:45:25.399847 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.399720 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-qqghg\"" Jun 12 18:45:25.399955 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.399862 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 18:45:25.401377 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.401349 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb"] Jun 12 18:45:25.507318 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.507280 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.507318 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.507321 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.507589 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.507343 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.507589 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.507360 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead36313-e83e-4409-8c9c-822998b2704a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.507589 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.507469 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdrkb\" (UniqueName: \"kubernetes.io/projected/ead36313-e83e-4409-8c9c-822998b2704a-kube-api-access-bdrkb\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.507589 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.507521 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608150 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608105 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bdrkb\" (UniqueName: \"kubernetes.io/projected/ead36313-e83e-4409-8c9c-822998b2704a-kube-api-access-bdrkb\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608150 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608152 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608224 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608253 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608284 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608352 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608305 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead36313-e83e-4409-8c9c-822998b2704a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608698 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608674 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608777 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608758 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.608813 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.608778 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.610574 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.610555 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ead36313-e83e-4409-8c9c-822998b2704a-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.610921 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.610905 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ead36313-e83e-4409-8c9c-822998b2704a-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.615767 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.615744 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdrkb\" (UniqueName: \"kubernetes.io/projected/ead36313-e83e-4409-8c9c-822998b2704a-kube-api-access-bdrkb\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-z2mgb\" (UID: \"ead36313-e83e-4409-8c9c-822998b2704a\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.706034 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.706008 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:25.838110 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.838083 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb"] Jun 12 18:45:25.840116 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:45:25.840093 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podead36313_e83e_4409_8c9c_822998b2704a.slice/crio-a39e2fefddbe42cd8c49caccc54b30286e9c9da5cbdc869767021e45921fc67c WatchSource:0}: Error finding container a39e2fefddbe42cd8c49caccc54b30286e9c9da5cbdc869767021e45921fc67c: Status 404 returned error can't find the container with id a39e2fefddbe42cd8c49caccc54b30286e9c9da5cbdc869767021e45921fc67c Jun 12 18:45:25.919268 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:25.919232 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" event={"ID":"ead36313-e83e-4409-8c9c-822998b2704a","Type":"ContainerStarted","Data":"a39e2fefddbe42cd8c49caccc54b30286e9c9da5cbdc869767021e45921fc67c"} Jun 12 18:45:26.078953 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:26.078847 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:45:29.941587 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:29.941554 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" event={"ID":"ead36313-e83e-4409-8c9c-822998b2704a","Type":"ContainerStarted","Data":"8913a615d651bc7979aa529a6fa5e9abbee06fcd5e5713585c6b17e7d097c477"} Jun 12 18:45:32.957122 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:32.957085 2561 generic.go:356] "Generic (PLEG): container finished" podID="ead36313-e83e-4409-8c9c-822998b2704a" containerID="8913a615d651bc7979aa529a6fa5e9abbee06fcd5e5713585c6b17e7d097c477" exitCode=0 Jun 12 18:45:32.957517 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:32.957155 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" event={"ID":"ead36313-e83e-4409-8c9c-822998b2704a","Type":"ContainerDied","Data":"8913a615d651bc7979aa529a6fa5e9abbee06fcd5e5713585c6b17e7d097c477"} Jun 12 18:45:34.968953 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:34.968918 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" event={"ID":"ead36313-e83e-4409-8c9c-822998b2704a","Type":"ContainerStarted","Data":"8c83a52999e99e87d6cd7fafecd93e13ef04b59bcde39056710f35e32f3c6191"} Jun 12 18:45:34.988847 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:34.988795 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" podStartSLOduration=2.631266007 podStartE2EDuration="9.988779297s" totalImagesPullingTime="4.208093694s" totalInitContainerRuntime="3.149419596s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:45:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:45:34.988289485 +0000 UTC m=+882.188242559" watchObservedRunningTime="2026-06-12 18:45:34.988779297 +0000 UTC m=+882.188732348" Jun 12 18:45:35.706949 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:35.706906 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:35.707134 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:35.706982 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:35.719306 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:35.719284 2561 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:35.984458 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:35.984371 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-z2mgb" Jun 12 18:45:37.976198 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:37.976161 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:45:45.912416 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:45.912378 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:45:53.283203 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:53.283174 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:45:53.283625 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:53.283592 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:45:54.780711 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:45:54.780674 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:46:01.780380 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:46:01.780339 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-mk5lq"] Jun 12 18:50:53.308930 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:50:53.308901 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:50:53.310082 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:50:53.310063 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:53:48.843856 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:48.843824 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688165-rcbnc_8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f/cleanup/0.log" Jun 12 18:53:49.531066 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:49.531034 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-9zh6x_3f2e395c-3986-45c6-894d-daf9f86bffbe/copy-manifests/0.log" Jun 12 18:53:49.541336 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:49.541316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-9zh6x_3f2e395c-3986-45c6-894d-daf9f86bffbe/manager/0.log" Jun 12 18:53:51.242318 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:51.242290 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-j6ln5_a59538aa-0aab-491d-8e3a-5b4b297ecf81/kuadrant-console-plugin/0.log" Jun 12 18:53:51.585318 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:51.585239 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mk5lq_e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27/limitador/0.log" Jun 12 18:53:52.268935 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:52.268901 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-2xcjk_9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6/kube-auth-proxy/0.log" Jun 12 18:53:52.504799 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:52.501005 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/1.log" Jun 12 18:53:53.283532 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:53.283505 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-z2mgb_ead36313-e83e-4409-8c9c-822998b2704a/storage-initializer/0.log" Jun 12 18:53:53.290140 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:53:53.290118 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-z2mgb_ead36313-e83e-4409-8c9c-822998b2704a/main/0.log" Jun 12 18:54:00.696988 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:00.696957 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-hx5qr_236a8efa-2ef3-4ddb-9c11-95e34b5bb32f/global-pull-secret-syncer/0.log" Jun 12 18:54:00.812988 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:00.812957 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-f2xrr_f1cccbad-7ec4-46dc-8eac-5c1207d77342/konnectivity-agent/0.log" Jun 12 18:54:00.834240 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:00.834215 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-4.ec2.internal_798e762c20fd11c14bfe9899eb68218f/haproxy/0.log" Jun 12 18:54:06.079344 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:06.079316 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-j6ln5_a59538aa-0aab-491d-8e3a-5b4b297ecf81/kuadrant-console-plugin/0.log" Jun 12 18:54:06.212097 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:06.212070 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-mk5lq_e1a5cd6d-cb9e-44c6-8e9d-728588e2ee27/limitador/0.log" Jun 12 18:54:07.767647 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.767614 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c71abf5-e71f-43ca-a3ae-89230f928b33/alertmanager/0.log" Jun 12 18:54:07.789235 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.789212 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c71abf5-e71f-43ca-a3ae-89230f928b33/config-reloader/0.log" Jun 12 18:54:07.813367 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.813337 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c71abf5-e71f-43ca-a3ae-89230f928b33/kube-rbac-proxy-web/0.log" Jun 12 18:54:07.835735 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.835706 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c71abf5-e71f-43ca-a3ae-89230f928b33/kube-rbac-proxy/0.log" Jun 12 18:54:07.860907 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.860876 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c71abf5-e71f-43ca-a3ae-89230f928b33/kube-rbac-proxy-metric/0.log" Jun 12 18:54:07.882653 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.882627 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c71abf5-e71f-43ca-a3ae-89230f928b33/prom-label-proxy/0.log" Jun 12 18:54:07.904252 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.904229 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_2c71abf5-e71f-43ca-a3ae-89230f928b33/init-config-reloader/0.log" Jun 12 18:54:07.976380 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.976310 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-6ghzb_794501c9-4f9b-4509-b7fa-e595452367e6/kube-state-metrics/0.log" Jun 12 18:54:07.997504 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:07.997467 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-6ghzb_794501c9-4f9b-4509-b7fa-e595452367e6/kube-rbac-proxy-main/0.log" Jun 12 18:54:08.019351 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.019323 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-6ghzb_794501c9-4f9b-4509-b7fa-e595452367e6/kube-rbac-proxy-self/0.log" Jun 12 18:54:08.237170 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.237092 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mqd6d_493a0159-b2c0-45c9-b1d0-fd7712df59a2/node-exporter/0.log" Jun 12 18:54:08.269612 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.269581 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mqd6d_493a0159-b2c0-45c9-b1d0-fd7712df59a2/kube-rbac-proxy/0.log" Jun 12 18:54:08.295751 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.295727 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mqd6d_493a0159-b2c0-45c9-b1d0-fd7712df59a2/init-textfile/0.log" Jun 12 18:54:08.491514 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.491407 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_876e0cb3-5cff-43e6-99b2-32ba93fa9cbe/prometheus/0.log" Jun 12 18:54:08.513572 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.513548 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_876e0cb3-5cff-43e6-99b2-32ba93fa9cbe/config-reloader/0.log" Jun 12 18:54:08.535281 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.535259 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_876e0cb3-5cff-43e6-99b2-32ba93fa9cbe/thanos-sidecar/0.log" Jun 12 18:54:08.556614 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.556573 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_876e0cb3-5cff-43e6-99b2-32ba93fa9cbe/kube-rbac-proxy-web/0.log" Jun 12 18:54:08.578711 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.578687 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_876e0cb3-5cff-43e6-99b2-32ba93fa9cbe/kube-rbac-proxy/0.log" Jun 12 18:54:08.599389 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.599365 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_876e0cb3-5cff-43e6-99b2-32ba93fa9cbe/kube-rbac-proxy-thanos/0.log" Jun 12 18:54:08.624206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:08.624180 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_876e0cb3-5cff-43e6-99b2-32ba93fa9cbe/init-config-reloader/0.log" Jun 12 18:54:11.477709 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.477666 2561 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh"] Jun 12 18:54:11.481223 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.481200 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.483495 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.483460 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svkd8\"/\"openshift-service-ca.crt\"" Jun 12 18:54:11.484594 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.484533 2561 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-svkd8\"/\"kube-root-ca.crt\"" Jun 12 18:54:11.484719 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.484610 2561 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-svkd8\"/\"default-dockercfg-98mkc\"" Jun 12 18:54:11.489923 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.489899 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh"] Jun 12 18:54:11.581917 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.581880 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-sys\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.582088 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.581932 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-lib-modules\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.582088 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.582025 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-proc\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.582088 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.582065 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5l4k7\" (UniqueName: \"kubernetes.io/projected/5a01c11b-9f56-46a4-8cfb-4831371ca35c-kube-api-access-5l4k7\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.582088 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.582085 2561 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-podres\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.683579 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683545 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-sys\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.683747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683600 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-lib-modules\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.683747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683646 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-proc\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.683747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683666 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5l4k7\" (UniqueName: \"kubernetes.io/projected/5a01c11b-9f56-46a4-8cfb-4831371ca35c-kube-api-access-5l4k7\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.683747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683682 2561 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-podres\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.683747 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683679 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-sys\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.684000 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683747 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-proc\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.684000 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683798 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-podres\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.684000 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.683831 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5a01c11b-9f56-46a4-8cfb-4831371ca35c-lib-modules\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.691607 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.691578 2561 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5l4k7\" (UniqueName: \"kubernetes.io/projected/5a01c11b-9f56-46a4-8cfb-4831371ca35c-kube-api-access-5l4k7\") pod \"perf-node-gather-daemonset-nstxh\" (UID: \"5a01c11b-9f56-46a4-8cfb-4831371ca35c\") " pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.791934 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.791839 2561 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:11.923537 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:11.923509 2561 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh"] Jun 12 18:54:11.926052 ip-10-0-128-4 kubenswrapper[2561]: W0612 18:54:11.926025 2561 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5a01c11b_9f56_46a4_8cfb_4831371ca35c.slice/crio-107d5dbc9102a7a45b1599e31d70f6b7f12620c75e1434af0a3e566640279730 WatchSource:0}: Error finding container 107d5dbc9102a7a45b1599e31d70f6b7f12620c75e1434af0a3e566640279730: Status 404 returned error can't find the container with id 107d5dbc9102a7a45b1599e31d70f6b7f12620c75e1434af0a3e566640279730 Jun 12 18:54:12.210206 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:12.210170 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" event={"ID":"5a01c11b-9f56-46a4-8cfb-4831371ca35c","Type":"ContainerStarted","Data":"87baba6b06832fc7a22cd78df03ebc2f99826c48c89bdf627b8025e29db5e109"} Jun 12 18:54:12.210405 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:12.210248 2561 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" event={"ID":"5a01c11b-9f56-46a4-8cfb-4831371ca35c","Type":"ContainerStarted","Data":"107d5dbc9102a7a45b1599e31d70f6b7f12620c75e1434af0a3e566640279730"} Jun 12 18:54:12.210405 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:12.210269 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:12.226486 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:12.226429 2561 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" podStartSLOduration=1.226414035 podStartE2EDuration="1.226414035s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:54:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:54:12.22523154 +0000 UTC m=+1399.425184591" watchObservedRunningTime="2026-06-12 18:54:12.226414035 +0000 UTC m=+1399.426367086" Jun 12 18:54:13.337407 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:13.337364 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qc6mc_bbf8239d-3790-466b-9dd8-df9f5181a109/dns/0.log" Jun 12 18:54:13.357270 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:13.357236 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qc6mc_bbf8239d-3790-466b-9dd8-df9f5181a109/kube-rbac-proxy/0.log" Jun 12 18:54:13.426664 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:13.426639 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-j7n2c_22e07909-8555-4f40-86b1-d97e1e5e5e4f/dns-node-resolver/0.log" Jun 12 18:54:14.026801 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:14.026772 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69c88697f7-2vbw7_f9402b82-9ea5-4fc2-9ecb-54d085c25352/registry/0.log" Jun 12 18:54:14.069842 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:14.069812 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-btmjg_b023889a-3206-4b10-a251-629bb1837618/node-ca/0.log" Jun 12 18:54:15.116029 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:15.115976 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-2xcjk_9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6/kube-auth-proxy/0.log" Jun 12 18:54:15.166751 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:15.166723 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/1.log" Jun 12 18:54:15.167133 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:15.167120 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/0.log" Jun 12 18:54:15.864383 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:15.864352 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kmdqs_7db6b1a0-efdd-468a-9248-ec9ee933f106/serve-healthcheck-canary/0.log" Jun 12 18:54:16.428051 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:16.428020 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6gkk_01a5532c-8a97-4979-b7dd-b81be0e17f56/kube-rbac-proxy/0.log" Jun 12 18:54:16.450450 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:16.450422 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6gkk_01a5532c-8a97-4979-b7dd-b81be0e17f56/exporter/0.log" Jun 12 18:54:16.471101 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:16.471074 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-g6gkk_01a5532c-8a97-4979-b7dd-b81be0e17f56/extractor/0.log" Jun 12 18:54:18.223342 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:18.223313 2561 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-svkd8/perf-node-gather-daemonset-nstxh" Jun 12 18:54:18.929643 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:18.929609 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29688165-rcbnc_8f9c3491-deaa-40d1-9ae8-3cbf5d77f63f/cleanup/0.log" Jun 12 18:54:19.205558 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:19.205451 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-9zh6x_3f2e395c-3986-45c6-894d-daf9f86bffbe/manager/0.log" Jun 12 18:54:19.225533 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:19.225508 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-666df475c6-9zh6x_3f2e395c-3986-45c6-894d-daf9f86bffbe/copy-manifests/0.log" Jun 12 18:54:20.750956 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:20.750916 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7dc544865f-vz8kb_e404ca4d-8324-4e29-ae8e-cd84282d00bd/manager/0.log" Jun 12 18:54:26.001742 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:26.001711 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-2xcjk_9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6/kube-auth-proxy/0.log" Jun 12 18:54:26.041895 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:26.041850 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/1.log" Jun 12 18:54:26.042252 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:26.042237 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/0.log" Jun 12 18:54:27.292738 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:27.292701 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-2xcjk_9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6/kube-auth-proxy/0.log" Jun 12 18:54:27.332214 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:27.332188 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/1.log" Jun 12 18:54:27.332566 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:27.332549 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/0.log" Jun 12 18:54:28.083321 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.083295 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ld2ff_e010037a-6a90-4583-a287-0a2f71c385de/kube-multus-additional-cni-plugins/0.log" Jun 12 18:54:28.107794 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.107771 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ld2ff_e010037a-6a90-4583-a287-0a2f71c385de/egress-router-binary-copy/0.log" Jun 12 18:54:28.134613 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.134587 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ld2ff_e010037a-6a90-4583-a287-0a2f71c385de/cni-plugins/0.log" Jun 12 18:54:28.158259 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.158240 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ld2ff_e010037a-6a90-4583-a287-0a2f71c385de/bond-cni-plugin/0.log" Jun 12 18:54:28.182075 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.182048 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ld2ff_e010037a-6a90-4583-a287-0a2f71c385de/routeoverride-cni/0.log" Jun 12 18:54:28.212136 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.212106 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ld2ff_e010037a-6a90-4583-a287-0a2f71c385de/whereabouts-cni-bincopy/0.log" Jun 12 18:54:28.236435 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.236406 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ld2ff_e010037a-6a90-4583-a287-0a2f71c385de/whereabouts-cni/0.log" Jun 12 18:54:28.664588 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.664563 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-hmn94_ca9f855a-4e2c-45fe-b3b0-531b67863c31/kube-multus/0.log" Jun 12 18:54:28.824333 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.824304 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rvspg_79883943-cedb-4352-bf3d-05b99afe7224/network-metrics-daemon/0.log" Jun 12 18:54:28.846600 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:28.846574 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-rvspg_79883943-cedb-4352-bf3d-05b99afe7224/kube-rbac-proxy/0.log" Jun 12 18:54:29.037179 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:29.037088 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-75986b966d-2xcjk_9c72f37d-5405-4a4d-a7d9-0cb9fba84dd6/kube-auth-proxy/0.log" Jun 12 18:54:29.071885 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:29.071854 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/1.log" Jun 12 18:54:29.072220 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:29.072204 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-687ff6996-ghkht_5c460a28-c1da-4c84-96c5-c5774a26ade5/istio-proxy/0.log" Jun 12 18:54:30.310847 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.310817 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-controller/0.log" Jun 12 18:54:30.331957 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.331925 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/0.log" Jun 12 18:54:30.331957 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.331938 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovn-acl-logging/1.log" Jun 12 18:54:30.348289 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.348264 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/kube-rbac-proxy-node/0.log" Jun 12 18:54:30.368029 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.368008 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/kube-rbac-proxy-ovn-metrics/0.log" Jun 12 18:54:30.389037 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.389020 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/northd/0.log" Jun 12 18:54:30.408019 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.408000 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/nbdb/0.log" Jun 12 18:54:30.428377 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.428356 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/sbdb/0.log" Jun 12 18:54:30.465891 ip-10-0-128-4 kubenswrapper[2561]: I0612 18:54:30.465870 2561 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-vl785_02ecfda6-cc62-41e6-8d42-2bb93795ba27/ovnkube-controller/0.log"