Jun 10 12:03:22.695090 ip-10-0-130-187 systemd[1]: Starting Kubernetes Kubelet... Jun 10 12:03:23.127810 ip-10-0-130-187 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:03:23.127810 ip-10-0-130-187 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 10 12:03:23.127810 ip-10-0-130-187 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:03:23.128431 ip-10-0-130-187 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 10 12:03:23.128431 ip-10-0-130-187 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 10 12:03:23.128883 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.128787 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 10 12:03:23.133744 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133729 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:23.133744 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133744 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133747 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133750 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133753 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133757 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133766 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133770 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133772 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133775 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133778 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133780 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133783 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133785 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133788 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133790 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133807 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133810 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133813 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133815 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133818 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:23.133826 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133820 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133823 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133825 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133828 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133831 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133834 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133837 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133840 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133842 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133847 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133850 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133854 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133856 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133859 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133862 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133864 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133867 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133869 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133872 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:23.134323 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133875 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133877 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133880 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133882 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133885 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133887 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133890 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133893 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133895 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133898 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133900 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133902 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133905 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133907 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133910 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133913 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133918 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133921 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133924 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:23.134887 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133927 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133929 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133932 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133935 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133938 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133941 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133943 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133946 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133949 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133952 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133954 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133957 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133959 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133962 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133965 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133967 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133970 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133973 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133976 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133978 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:23.135345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133981 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133984 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133986 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133989 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133991 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133994 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133996 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.133999 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134003 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134006 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134008 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134012 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134016 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134019 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134022 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134024 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134027 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134029 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134032 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134034 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:23.135867 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134747 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134754 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134756 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134759 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134763 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134765 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134768 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134771 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134773 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134776 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134779 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134781 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134783 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134786 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134788 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134791 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134810 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134813 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134816 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134819 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:23.136345 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134823 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134825 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134828 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134831 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134834 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134836 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134839 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134841 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134844 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134846 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134849 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134851 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134854 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134856 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134859 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134862 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134864 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134867 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134870 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134873 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:23.137088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134876 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134878 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134881 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134883 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134886 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134888 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134893 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134897 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134900 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134903 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134906 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134909 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134914 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134918 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134921 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134924 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134927 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134930 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134932 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:23.137640 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134935 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134937 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134940 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134945 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134948 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134951 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134954 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134957 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134959 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134962 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134965 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134968 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134971 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134974 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134977 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134979 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134982 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134985 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134988 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134991 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:23.138143 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134993 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134996 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.134998 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135001 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135003 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135006 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135009 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135011 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135014 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135017 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135019 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135022 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135024 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135026 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135029 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135031 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135034 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135036 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135038 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135041 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:23.138630 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135440 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135445 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135448 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135451 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135454 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135458 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135461 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135464 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135467 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135470 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135474 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135477 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135480 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135483 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135485 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135488 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135491 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135494 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135497 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135499 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:23.139158 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135502 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135505 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135507 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135510 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135512 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135515 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135517 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135520 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135522 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135524 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135527 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135529 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135532 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135534 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135537 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135539 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135541 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135544 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135547 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135549 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:23.139642 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135552 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135556 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135560 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135562 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135565 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135567 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135570 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135572 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135574 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135577 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135581 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135585 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135587 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135590 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135593 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135595 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135597 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135600 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135602 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:23.140163 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135605 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135607 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135609 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135612 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135614 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135616 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135619 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135622 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135624 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135626 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135629 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135631 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135634 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135637 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135640 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135643 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135645 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135648 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135650 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135652 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:23.140631 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135655 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135658 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135660 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135664 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135667 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135669 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135672 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135676 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135678 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135681 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135684 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135687 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135689 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135692 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135694 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135696 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135699 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135701 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135704 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:23.141146 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.135706 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135769 2570 flags.go:64] FLAG: --address="0.0.0.0" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135775 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135781 2570 flags.go:64] FLAG: --anonymous-auth="true" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135785 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135788 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135792 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135812 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135816 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135819 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135822 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135826 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135829 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135832 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135835 2570 flags.go:64] FLAG: --cgroup-root="" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135838 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135841 2570 flags.go:64] FLAG: --client-ca-file="" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135844 2570 flags.go:64] FLAG: --cloud-provider="external" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135846 2570 flags.go:64] FLAG: --cluster-dns="[]" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135851 2570 flags.go:64] FLAG: --cluster-domain="" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135854 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135857 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135860 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135863 2570 flags.go:64] FLAG: --container-log-max-files="5" Jun 10 12:03:23.141620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135866 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135869 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135872 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135875 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135878 2570 flags.go:64] FLAG: --contention-profiling="false" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135881 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135884 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135887 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135890 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135894 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135897 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135899 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135902 2570 flags.go:64] FLAG: --enable-load-reader="false" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135905 2570 flags.go:64] FLAG: --enable-server="true" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135907 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135912 2570 flags.go:64] FLAG: --event-burst="100" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135915 2570 flags.go:64] FLAG: --event-qps="50" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135918 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135921 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135924 2570 flags.go:64] FLAG: --eviction-hard="" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135927 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135930 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135933 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135936 2570 flags.go:64] FLAG: --eviction-soft="" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135939 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 10 12:03:23.142218 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135942 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135944 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135947 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135950 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135952 2570 flags.go:64] FLAG: --fail-swap-on="true" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135955 2570 flags.go:64] FLAG: --feature-gates="" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135958 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135961 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135964 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135967 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135970 2570 flags.go:64] FLAG: --healthz-port="10248" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135973 2570 flags.go:64] FLAG: --help="false" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135976 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135978 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135981 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135984 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135987 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135990 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135993 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135996 2570 flags.go:64] FLAG: --image-service-endpoint="" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.135998 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136001 2570 flags.go:64] FLAG: --kube-api-burst="100" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136004 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136007 2570 flags.go:64] FLAG: --kube-api-qps="50" Jun 10 12:03:23.142836 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136012 2570 flags.go:64] FLAG: --kube-reserved="" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136014 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136017 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136020 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136022 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136025 2570 flags.go:64] FLAG: --lock-file="" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136028 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136030 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136033 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136039 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136042 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136044 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136047 2570 flags.go:64] FLAG: --logging-format="text" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136050 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136053 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136056 2570 flags.go:64] FLAG: --manifest-url="" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136059 2570 flags.go:64] FLAG: --manifest-url-header="" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136063 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136066 2570 flags.go:64] FLAG: --max-open-files="1000000" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136070 2570 flags.go:64] FLAG: --max-pods="110" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136073 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136076 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136078 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136081 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136084 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 10 12:03:23.143416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136087 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136090 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136096 2570 flags.go:64] FLAG: --node-status-max-images="50" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136099 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136102 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136105 2570 flags.go:64] FLAG: --pod-cidr="" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136108 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136114 2570 flags.go:64] FLAG: --pod-manifest-path="" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136118 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136121 2570 flags.go:64] FLAG: --pods-per-core="0" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136124 2570 flags.go:64] FLAG: --port="10250" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136127 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136130 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-03382e70b29755bde" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136133 2570 flags.go:64] FLAG: --qos-reserved="" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136136 2570 flags.go:64] FLAG: --read-only-port="10255" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136139 2570 flags.go:64] FLAG: --register-node="true" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136142 2570 flags.go:64] FLAG: --register-with-taints="" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136145 2570 flags.go:64] FLAG: --registry-burst="10" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136147 2570 flags.go:64] FLAG: --registry-qps="5" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136150 2570 flags.go:64] FLAG: --reserved-cpus="" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136153 2570 flags.go:64] FLAG: --reserved-memory="" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136156 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136159 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136161 2570 flags.go:64] FLAG: --rotate-certificates="false" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136164 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 10 12:03:23.144027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136167 2570 flags.go:64] FLAG: --runonce="false" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136169 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136172 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136175 2570 flags.go:64] FLAG: --seccomp-default="false" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136178 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136180 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136183 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136186 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136189 2570 flags.go:64] FLAG: --storage-driver-password="root" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136191 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136194 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136196 2570 flags.go:64] FLAG: --storage-driver-user="root" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136199 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136202 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136205 2570 flags.go:64] FLAG: --system-cgroups="" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136209 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136214 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136216 2570 flags.go:64] FLAG: --tls-cert-file="" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136219 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136223 2570 flags.go:64] FLAG: --tls-min-version="" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136226 2570 flags.go:64] FLAG: --tls-private-key-file="" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136229 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136232 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136234 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136237 2570 flags.go:64] FLAG: --v="2" Jun 10 12:03:23.144637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136246 2570 flags.go:64] FLAG: --version="false" Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136250 2570 flags.go:64] FLAG: --vmodule="" Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136253 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.136256 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138465 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138477 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138481 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138484 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138488 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138495 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138499 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138501 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138504 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138507 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138510 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138512 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138515 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138518 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138521 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138526 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138529 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:23.145299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138532 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138538 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138551 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138554 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138557 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138560 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138563 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138566 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138568 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138571 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138574 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138576 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138579 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138582 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138587 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138590 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138592 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138595 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138598 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:23.145848 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138601 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138603 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138606 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138609 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138611 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138614 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138617 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138622 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138625 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138627 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138630 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138634 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138637 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138640 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138644 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138647 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138655 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138658 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138661 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138663 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:23.146299 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138669 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138671 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138674 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138677 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138679 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138682 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138685 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138687 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138690 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138693 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138695 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138698 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138703 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138706 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138709 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138712 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138714 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138717 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138720 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138723 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:23.146788 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138726 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138728 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138731 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138735 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138737 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138744 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138748 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138751 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138755 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138758 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138761 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138763 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138766 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138768 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138772 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138776 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138779 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138784 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138787 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:23.147298 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138789 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138792 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138806 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.138811 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.139627 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.146411 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.146424 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.146443 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.146449 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146501 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146505 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146508 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146511 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146514 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:23.147745 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146517 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146520 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146523 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146526 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146528 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146532 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146536 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146539 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146541 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146544 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146546 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146549 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146551 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146553 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146556 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146558 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146561 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146563 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146566 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146569 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:23.148102 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146571 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146574 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146576 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146579 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146581 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146583 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146586 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146588 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146590 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146593 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146595 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146598 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146600 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146603 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146605 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146608 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146610 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146613 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146616 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:23.148618 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146619 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146621 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146624 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146626 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146629 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146631 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146634 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146636 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146638 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146641 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146643 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146646 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146648 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146650 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146653 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146656 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146658 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146661 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146663 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146666 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:23.149083 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146668 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146671 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146674 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146677 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146681 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146684 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146686 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146690 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146692 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146695 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146698 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146702 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146705 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146708 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146711 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146714 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146717 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146720 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146722 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:23.149565 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146725 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146727 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146730 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146732 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146735 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146738 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146741 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146744 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146746 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146749 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146752 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146755 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146757 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146760 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146762 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:23.150093 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146764 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.146769 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146903 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146908 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146911 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146914 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146917 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146919 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146923 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146926 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146929 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146932 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146936 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146939 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146941 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 10 12:03:23.150482 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146944 2570 feature_gate.go:328] unrecognized feature gate: Example Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146946 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146949 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146951 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146954 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146957 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146959 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146962 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146964 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146966 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146969 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146971 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146973 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146976 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146979 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146981 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146983 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146986 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146988 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146990 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 10 12:03:23.150998 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146993 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146995 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.146998 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147000 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147002 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147005 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147009 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147012 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147015 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147018 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147021 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147023 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147026 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147028 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147031 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147033 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147036 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147038 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147041 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 10 12:03:23.151514 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147043 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147046 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147048 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147050 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147053 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147055 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147057 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147061 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147064 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147066 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147069 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147071 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147074 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147076 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147078 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147081 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147083 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147085 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147088 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 10 12:03:23.152001 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147090 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147093 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147095 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147098 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147100 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147103 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147105 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147108 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147110 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147113 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147115 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147117 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147120 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147122 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147124 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147127 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147130 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147133 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147136 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147138 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 10 12:03:23.152453 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147142 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147144 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147147 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147149 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147152 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147154 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147157 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:23.147159 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.147164 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.147268 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.150197 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.151613 2570 server.go:1019] "Starting client certificate rotation" Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.151706 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:03:23.152958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.151737 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 10 12:03:23.154222 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.154207 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:03:23.155348 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.155326 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 10 12:03:23.169519 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.169503 2570 log.go:25] "Validated CRI v1 runtime API" Jun 10 12:03:23.172659 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.172641 2570 log.go:25] "Validated CRI v1 image API" Jun 10 12:03:23.174421 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.174405 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 10 12:03:23.178058 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.178039 2570 fs.go:135] Filesystem UUIDs: map[17bb0eb3-e0e2-435a-b20a-bc820c3314d1:/dev/nvme0n1p4 4bbcdca1-b0b5-4a8f-b8fc-8ac2cf84f715:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 10 12:03:23.178111 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.178058 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 10 12:03:23.184145 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.184038 2570 manager.go:216] Machine: {Timestamp:2026-06-10 12:03:23.181874022 +0000 UTC m=+0.366996060 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3107527 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec24c370ef26bb531720b104120c383e SystemUUID:ec24c370-ef26-bb53-1720-b104120c383e BootID:0c5121f5-a6a5-49be-b046-6eca2f5c502e Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:35:c3:b6:b5:f1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:35:c3:b6:b5:f1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:1a:bb:00:36:fd:e7 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 10 12:03:23.184145 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.184141 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 10 12:03:23.184254 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.184243 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 10 12:03:23.185216 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.185198 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:03:23.187502 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.187478 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 10 12:03:23.187639 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.187505 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-187.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 10 12:03:23.189296 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.189284 2570 topology_manager.go:138] "Creating topology manager with none policy" Jun 10 12:03:23.189329 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.189299 2570 container_manager_linux.go:309] "Creating device plugin manager" Jun 10 12:03:23.189329 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.189307 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:03:23.189771 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.189760 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 10 12:03:23.190518 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.190509 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 10 12:03:23.193213 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193202 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:03:23.193485 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193475 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 10 12:03:23.193527 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193504 2570 kubelet.go:486] "Attempting to sync node with API server" Jun 10 12:03:23.193527 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193515 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 10 12:03:23.193598 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193531 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 10 12:03:23.193598 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193540 2570 kubelet.go:398] "Adding apiserver pod source" Jun 10 12:03:23.193598 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193549 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 10 12:03:23.193920 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193906 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:03:23.193979 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.193944 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 10 12:03:23.196578 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.196564 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 10 12:03:23.199393 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.199378 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 10 12:03:23.199463 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.199408 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 10 12:03:23.200423 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200403 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 10 12:03:23.200423 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200421 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 10 12:03:23.200423 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200427 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200433 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200443 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200452 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200465 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200472 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200479 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200485 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200504 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 10 12:03:23.200564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.200509 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 10 12:03:23.202156 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.202136 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 10 12:03:23.202156 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.202113 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 10 12:03:23.202273 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.202162 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 10 12:03:23.202273 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.202171 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 10 12:03:23.205196 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.205183 2570 server.go:1268] "Started kubelet" Jun 10 12:03:23.205530 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.205512 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 10 12:03:23.205788 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.205746 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 10 12:03:23.205874 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.205824 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 10 12:03:23.205909 ip-10-0-130-187 systemd[1]: Started Kubernetes Kubelet. Jun 10 12:03:23.207690 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.207671 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 10 12:03:23.207871 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.207856 2570 server.go:310] "Adding debug handlers to kubelet server" Jun 10 12:03:23.211893 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.211879 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 10 12:03:23.211981 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.211899 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 10 12:03:23.212282 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.212259 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.212945 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.212913 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 10 12:03:23.212945 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.212946 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 10 12:03:23.213106 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.212970 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 10 12:03:23.213236 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.213222 2570 reconstruct.go:97] "Volume reconstruction finished" Jun 10 12:03:23.213295 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.213238 2570 reconciler.go:29] "Reconciler: start to sync state" Jun 10 12:03:23.214229 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.214102 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 10 12:03:23.214229 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.214171 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gjpc4" Jun 10 12:03:23.214444 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.214427 2570 factory.go:55] Registering systemd factory Jun 10 12:03:23.214444 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.214441 2570 factory.go:223] Registration of the systemd container factory successfully Jun 10 12:03:23.215050 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.213847 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-187.ec2.internal.18b7b6a657f9cf7e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-187.ec2.internal,UID:ip-10-0-130-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-187.ec2.internal,},FirstTimestamp:2026-06-10 12:03:23.205136254 +0000 UTC m=+0.390258276,LastTimestamp:2026-06-10 12:03:23.205136254 +0000 UTC m=+0.390258276,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-187.ec2.internal,}" Jun 10 12:03:23.215158 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.215069 2570 factory.go:153] Registering CRI-O factory Jun 10 12:03:23.215158 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.215083 2570 factory.go:223] Registration of the crio container factory successfully Jun 10 12:03:23.215255 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.215161 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 10 12:03:23.215255 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.215185 2570 factory.go:103] Registering Raw factory Jun 10 12:03:23.215255 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.215208 2570 manager.go:1196] Started watching for new ooms in manager Jun 10 12:03:23.215773 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.215754 2570 manager.go:349] Starting recovery of all containers Jun 10 12:03:23.215867 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.215852 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-187.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 10 12:03:23.216552 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.216526 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 10 12:03:23.222584 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.222424 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-gjpc4" Jun 10 12:03:23.222702 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.222676 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-187.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 10 12:03:23.226241 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.226227 2570 manager.go:354] Recovery completed Jun 10 12:03:23.230702 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.230686 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:23.232788 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.232743 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:23.232788 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.232783 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:23.232912 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.232814 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:23.233318 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.233300 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 10 12:03:23.233318 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.233318 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 10 12:03:23.233423 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.233309 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:23.233423 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.233335 2570 state_mem.go:36] "Initialized new in-memory state store" Jun 10 12:03:23.234115 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.234099 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:23.234158 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.234127 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:23.234158 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.234138 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:23.234505 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.234494 2570 policy_none.go:49] "None policy: Start" Jun 10 12:03:23.234535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.234511 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 10 12:03:23.234535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.234522 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 10 12:03:23.235277 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.235196 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-187.ec2.internal.18b7b6a6599f5f6c default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-187.ec2.internal,UID:ip-10-0-130-187.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-187.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-187.ec2.internal,},FirstTimestamp:2026-06-10 12:03:23.232763756 +0000 UTC m=+0.417885783,LastTimestamp:2026-06-10 12:03:23.232763756 +0000 UTC m=+0.417885783,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-187.ec2.internal,}" Jun 10 12:03:23.235492 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.235479 2570 policy_none.go:47] "Start" Jun 10 12:03:23.278447 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.278432 2570 manager.go:337] "Starting Device Plugin manager" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.278463 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.278473 2570 server.go:87] "Starting device plugin registration server" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.278740 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.278758 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.278920 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.279000 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.279010 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.279607 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.279656 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.286115 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.287334 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.287379 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.287403 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jun 10 12:03:23.288315 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.287509 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 10 12:03:23.289048 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.288927 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:23.379849 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.379816 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:23.381094 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.381078 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:23.381149 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.381108 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:23.381149 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.381120 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:23.381149 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.381141 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.387777 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.387759 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal"] Jun 10 12:03:23.387869 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.387836 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:23.388712 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.388699 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:23.388783 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.388725 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:23.388783 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.388739 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:23.388921 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.388907 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.388977 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.388932 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-187.ec2.internal\": node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.390042 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.390029 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:23.390154 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.390139 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.390198 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.390167 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:23.393274 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.393256 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:23.393369 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.393278 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:23.393369 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.393287 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:23.393369 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.393342 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:23.393369 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.393366 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:23.393568 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.393379 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:23.395932 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.395910 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.396017 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.395965 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 10 12:03:23.397056 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.397037 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientMemory" Jun 10 12:03:23.397153 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.397065 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasNoDiskPressure" Jun 10 12:03:23.397153 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.397080 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeHasSufficientPID" Jun 10 12:03:23.402936 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.402921 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.421598 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.421575 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-187.ec2.internal\" not found" node="ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.425972 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.425957 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-187.ec2.internal\" not found" node="ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.503580 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.503512 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.514528 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.514506 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71b9fc6a00a2fd7f537b48fb8ddff410-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal\" (UID: \"71b9fc6a00a2fd7f537b48fb8ddff410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.514583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.514537 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71b9fc6a00a2fd7f537b48fb8ddff410-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal\" (UID: \"71b9fc6a00a2fd7f537b48fb8ddff410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.514583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.514555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c260edd97696a65a12fb99bc6379a012-config\") pod \"kube-apiserver-proxy-ip-10-0-130-187.ec2.internal\" (UID: \"c260edd97696a65a12fb99bc6379a012\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.603619 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.603596 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.614874 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.614855 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71b9fc6a00a2fd7f537b48fb8ddff410-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal\" (UID: \"71b9fc6a00a2fd7f537b48fb8ddff410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.614918 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.614882 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71b9fc6a00a2fd7f537b48fb8ddff410-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal\" (UID: \"71b9fc6a00a2fd7f537b48fb8ddff410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.614918 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.614898 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c260edd97696a65a12fb99bc6379a012-config\") pod \"kube-apiserver-proxy-ip-10-0-130-187.ec2.internal\" (UID: \"c260edd97696a65a12fb99bc6379a012\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.614985 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.614941 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/c260edd97696a65a12fb99bc6379a012-config\") pod \"kube-apiserver-proxy-ip-10-0-130-187.ec2.internal\" (UID: \"c260edd97696a65a12fb99bc6379a012\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.614985 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.614968 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71b9fc6a00a2fd7f537b48fb8ddff410-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal\" (UID: \"71b9fc6a00a2fd7f537b48fb8ddff410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.615045 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.614972 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71b9fc6a00a2fd7f537b48fb8ddff410-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal\" (UID: \"71b9fc6a00a2fd7f537b48fb8ddff410\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.704309 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.704281 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.725751 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.725732 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.730190 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:23.730175 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" Jun 10 12:03:23.805325 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.805257 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:23.905808 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:23.905775 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:24.006248 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:24.006222 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:24.106869 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:24.106842 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:24.151292 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.151271 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 10 12:03:24.151861 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.151397 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 10 12:03:24.207711 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:24.207688 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:24.220266 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:24.220240 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc260edd97696a65a12fb99bc6379a012.slice/crio-f95018bb517194f01de0a852baa7e727bee3aff9b15d32de4d71dcd434cbb2ba WatchSource:0}: Error finding container f95018bb517194f01de0a852baa7e727bee3aff9b15d32de4d71dcd434cbb2ba: Status 404 returned error can't find the container with id f95018bb517194f01de0a852baa7e727bee3aff9b15d32de4d71dcd434cbb2ba Jun 10 12:03:24.221446 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:24.221417 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b9fc6a00a2fd7f537b48fb8ddff410.slice/crio-ca78cea24f349e5742bbe825d52bcabb66026054758602fc9d972a173c5e13c3 WatchSource:0}: Error finding container ca78cea24f349e5742bbe825d52bcabb66026054758602fc9d972a173c5e13c3: Status 404 returned error can't find the container with id ca78cea24f349e5742bbe825d52bcabb66026054758602fc9d972a173c5e13c3 Jun 10 12:03:24.224287 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.224264 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:03:24.226193 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.226166 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 11:58:23 +0000 UTC" deadline="2027-12-01 08:20:15.345938811 +0000 UTC" Jun 10 12:03:24.226193 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.226191 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12932h16m51.119750452s" Jun 10 12:03:24.290155 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.290113 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" event={"ID":"71b9fc6a00a2fd7f537b48fb8ddff410","Type":"ContainerStarted","Data":"ca78cea24f349e5742bbe825d52bcabb66026054758602fc9d972a173c5e13c3"} Jun 10 12:03:24.291118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.291097 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" event={"ID":"c260edd97696a65a12fb99bc6379a012","Type":"ContainerStarted","Data":"f95018bb517194f01de0a852baa7e727bee3aff9b15d32de4d71dcd434cbb2ba"} Jun 10 12:03:24.308232 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:24.308214 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:24.408834 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:24.408777 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:24.442197 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.442172 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:24.509558 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:24.509533 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-187.ec2.internal\" not found" Jun 10 12:03:24.533523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.533501 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:24.613758 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.613734 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" Jun 10 12:03:24.623933 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.623913 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:03:24.626321 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.626302 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" Jun 10 12:03:24.636775 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.636743 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 10 12:03:24.766532 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:24.766459 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:25.194903 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.194870 2570 apiserver.go:52] "Watching apiserver" Jun 10 12:03:25.202497 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.202476 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 10 12:03:25.203488 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.203458 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-hptlr","kube-system/global-pull-secret-syncer-wrm7q","kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh","openshift-cluster-node-tuning-operator/tuned-2v9w9","openshift-dns/node-resolver-5mjvb","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal","openshift-multus/multus-qpb9m","openshift-multus/network-metrics-daemon-ftjkg","kube-system/konnectivity-agent-ft8pz","openshift-image-registry/node-ca-wmrbk","openshift-multus/multus-additional-cni-plugins-wdf85","openshift-network-diagnostics/network-check-target-4r469","openshift-network-operator/iptables-alerter-md7kx"] Jun 10 12:03:25.204844 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.204824 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.205896 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.205876 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:25.205997 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.205972 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:25.206893 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.206876 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.207546 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.207530 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 10 12:03:25.207639 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.207575 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 10 12:03:25.207698 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.207674 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-5m77r\"" Jun 10 12:03:25.208098 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.208082 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.209699 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.209840 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7zn47\"" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.210003 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.210076 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.210288 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.210827 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-q5cpt\"" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.211116 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 10 12:03:25.211597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.211369 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 10 12:03:25.212022 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.211887 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.212883 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.212865 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 10 12:03:25.213228 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.213205 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.214186 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.214170 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 10 12:03:25.214407 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.214391 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:03:25.214512 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.214464 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:25.214571 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.214522 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:25.214571 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.214538 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7wzrb\"" Jun 10 12:03:25.215569 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.215552 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 10 12:03:25.215707 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.215692 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 10 12:03:25.215765 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.215561 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.215871 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.215692 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hgscp\"" Jun 10 12:03:25.217236 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.217218 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.217331 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.217281 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:25.218133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.218116 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 10 12:03:25.218229 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.218192 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 10 12:03:25.218356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.218338 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mj8rs\"" Jun 10 12:03:25.218538 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.218520 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 10 12:03:25.218674 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.218656 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 10 12:03:25.218967 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.218950 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.220175 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.220155 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.221460 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.221441 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 10 12:03:25.221549 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.221513 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.222215 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.222196 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 10 12:03:25.222524 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.222507 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 10 12:03:25.222860 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.222623 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-57mpp\"" Jun 10 12:03:25.222860 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.222621 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 10 12:03:25.222860 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.222680 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 10 12:03:25.223030 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.222890 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 10 12:03:25.223898 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.223872 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bzv5w\"" Jun 10 12:03:25.223990 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.223908 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 10 12:03:25.223990 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.223969 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8hqm9\"" Jun 10 12:03:25.224168 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224147 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 10 12:03:25.224352 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224337 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 10 12:03:25.224540 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224523 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 10 12:03:25.224683 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224666 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3ed9392-3dff-43dc-8873-214b67187418-iptables-alerter-script\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.224740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224700 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.224740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-sys-fs\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.224842 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224751 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e496a51-4b3f-4df5-8001-ff39c586db50-tmp-dir\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.224842 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysctl-conf\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.224842 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-lib-modules\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.224942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224859 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95e58e6b-53ef-4b91-b4a3-1724e9cf4f62-agent-certs\") pod \"konnectivity-agent-ft8pz\" (UID: \"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62\") " pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.224942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224881 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-systemd\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.224942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224907 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-run\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.224942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224927 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-var-lib-kubelet\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224950 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r89vl\" (UniqueName: \"kubernetes.io/projected/bcc7c99d-f825-448b-be78-6cc93f5c93df-kube-api-access-r89vl\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224976 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3ed9392-3dff-43dc-8873-214b67187418-host-slash\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224992 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-modprobe-d\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225005 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-sys\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-socket-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-device-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225056 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225069 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysconfig\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e8e51e-0e20-4de0-9618-1f52705dc53b-tmp\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95e58e6b-53ef-4b91-b4a3-1724e9cf4f62-konnectivity-ca\") pod \"konnectivity-agent-ft8pz\" (UID: \"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62\") " pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225106 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 10 12:03:25.225128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225140 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr8vh\" (UniqueName: \"kubernetes.io/projected/de2c4393-fc07-48bd-b0a6-49208a234c65-kube-api-access-qr8vh\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-kubernetes\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225197 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysctl-d\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-tuned\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225224 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltx68\" (UniqueName: \"kubernetes.io/projected/b3e8e51e-0e20-4de0-9618-1f52705dc53b-kube-api-access-ltx68\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.224908 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225314 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6ktv\" (UniqueName: \"kubernetes.io/projected/b3ed9392-3dff-43dc-8873-214b67187418-kube-api-access-p6ktv\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225332 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e496a51-4b3f-4df5-8001-ff39c586db50-hosts-file\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225347 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj4qq\" (UniqueName: \"kubernetes.io/projected/7e496a51-4b3f-4df5-8001-ff39c586db50-kube-api-access-vj4qq\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225366 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-registration-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.225696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.225380 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-host\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.248846 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.248827 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 10 12:03:25.249601 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.249580 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-8669m" Jun 10 12:03:25.257372 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.257355 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-8669m" Jun 10 12:03:25.313676 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.313637 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 10 12:03:25.325990 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.325962 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-etc-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.325993 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326016 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-system-cni-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.326133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326074 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-cni-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.326133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326100 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48wfv\" (UniqueName: \"kubernetes.io/projected/0ede99d5-75f9-403c-a97c-d8a2032a2006-kube-api-access-48wfv\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.326285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326152 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3ed9392-3dff-43dc-8873-214b67187418-host-slash\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.326285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-kubelet\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326220 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b3ed9392-3dff-43dc-8873-214b67187418-host-slash\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.326285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326250 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-os-release\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.326461 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326312 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-socket-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.326461 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326333 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-ovn\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326461 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovnkube-script-lib\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326461 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326404 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-socket-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.326461 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326421 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.326652 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:25.326652 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326520 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-run-netns\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326652 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326599 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-os-release\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.326766 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326647 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-cni-bin\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.326766 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326677 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qr8vh\" (UniqueName: \"kubernetes.io/projected/de2c4393-fc07-48bd-b0a6-49208a234c65-kube-api-access-qr8vh\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.326766 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326705 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysctl-d\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.326890 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:25.326890 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326828 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-node-log\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326890 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326856 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-run-ovn-kubernetes\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.326890 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326857 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysctl-d\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327044 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.326890 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:25.327044 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.326883 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p6ktv\" (UniqueName: \"kubernetes.io/projected/b3ed9392-3dff-43dc-8873-214b67187418-kube-api-access-p6ktv\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.327044 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.326988 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:03:25.826948677 +0000 UTC m=+3.012070708 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:25.327044 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e496a51-4b3f-4df5-8001-ff39c586db50-hosts-file\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.327044 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327039 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-log-socket\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327066 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-cnibin\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-netns\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327114 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-etc-kubernetes\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327120 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/7e496a51-4b3f-4df5-8001-ff39c586db50-hosts-file\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327137 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-serviceca\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327166 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3ed9392-3dff-43dc-8873-214b67187418-iptables-alerter-script\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327193 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327217 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-var-lib-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.327244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327241 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysctl-conf\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327275 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-lib-modules\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327305 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-cni-bin\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327326 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9gg6g\" (UniqueName: \"kubernetes.io/projected/ed88afa3-143b-4f7e-928c-5734df568c17-kube-api-access-9gg6g\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327350 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-cni-multus\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327330 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysctl-conf\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327374 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-conf-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327380 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-etc-selinux\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327401 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-lib-modules\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327403 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-systemd\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-var-lib-kubelet\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327441 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-kubelet\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327457 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-modprobe-d\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-sys\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327477 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-systemd\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-systemd-units\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327503 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-var-lib-kubelet\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.327535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327523 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-systemd\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327527 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-sys\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327542 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-cni-netd\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327557 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovnkube-config\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327579 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovn-node-metrics-cert\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327595 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-modprobe-d\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327604 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-cnibin\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327624 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-host\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327648 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-device-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327672 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysconfig\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327694 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e8e51e-0e20-4de0-9618-1f52705dc53b-tmp\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327712 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b3ed9392-3dff-43dc-8873-214b67187418-iptables-alerter-script\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327748 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-sysconfig\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327717 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95e58e6b-53ef-4b91-b4a3-1724e9cf4f62-konnectivity-ca\") pod \"konnectivity-agent-ft8pz\" (UID: \"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62\") " pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327754 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-device-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-env-overrides\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327855 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.328294 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327882 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zsq7s\" (UniqueName: \"kubernetes.io/projected/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-kube-api-access-zsq7s\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327909 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327931 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-kubernetes\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327955 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-tuned\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.327981 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltx68\" (UniqueName: \"kubernetes.io/projected/b3e8e51e-0e20-4de0-9618-1f52705dc53b-kube-api-access-ltx68\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328009 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ede99d5-75f9-403c-a97c-d8a2032a2006-cni-binary-copy\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328027 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-hostroot\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328042 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj4qq\" (UniqueName: \"kubernetes.io/projected/7e496a51-4b3f-4df5-8001-ff39c586db50-kube-api-access-vj4qq\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328049 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328109 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-registration-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328183 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328225 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/95e58e6b-53ef-4b91-b4a3-1724e9cf4f62-konnectivity-ca\") pod \"konnectivity-agent-ft8pz\" (UID: \"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62\") " pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328235 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-kubernetes\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328056 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-registration-dir\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-host\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328468 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-system-cni-dir\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328512 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.329159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328534 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-host\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328541 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328574 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-socket-dir-parent\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328609 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-sys-fs\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328633 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-dbus\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328657 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328682 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-slash\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328687 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/de2c4393-fc07-48bd-b0a6-49208a234c65-sys-fs\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328704 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-k8s-cni-cncf-io\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-daemon-config\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328765 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e496a51-4b3f-4df5-8001-ff39c586db50-tmp-dir\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328789 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95e58e6b-53ef-4b91-b4a3-1724e9cf4f62-agent-certs\") pod \"konnectivity-agent-ft8pz\" (UID: \"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62\") " pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328865 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n98kg\" (UniqueName: \"kubernetes.io/projected/2f865afd-f97c-4c75-8ae0-5866b7df2e53-kube-api-access-n98kg\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328891 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-multus-certs\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328915 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-run\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328938 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r89vl\" (UniqueName: \"kubernetes.io/projected/bcc7c99d-f825-448b-be78-6cc93f5c93df-kube-api-access-r89vl\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.328962 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-kubelet-config\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.329951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.329068 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/b3e8e51e-0e20-4de0-9618-1f52705dc53b-run\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.330711 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.329085 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7e496a51-4b3f-4df5-8001-ff39c586db50-tmp-dir\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.331523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.331501 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b3e8e51e-0e20-4de0-9618-1f52705dc53b-tmp\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.331689 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.331526 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/b3e8e51e-0e20-4de0-9618-1f52705dc53b-etc-tuned\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.331950 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.331930 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/95e58e6b-53ef-4b91-b4a3-1724e9cf4f62-agent-certs\") pod \"konnectivity-agent-ft8pz\" (UID: \"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62\") " pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.335941 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.335914 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:25.335941 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.335939 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:25.336124 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.335949 2570 projected.go:196] Error preparing data for projected volume kube-api-access-44fs4 for pod openshift-network-diagnostics/network-check-target-4r469: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:25.336124 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.336008 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4 podName:41173b40-c654-4a53-8832-ed11b931f54c nodeName:}" failed. No retries permitted until 2026-06-10 12:03:25.835994507 +0000 UTC m=+3.021116517 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-44fs4" (UniqueName: "kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4") pod "network-check-target-4r469" (UID: "41173b40-c654-4a53-8832-ed11b931f54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:25.338490 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.338453 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr8vh\" (UniqueName: \"kubernetes.io/projected/de2c4393-fc07-48bd-b0a6-49208a234c65-kube-api-access-qr8vh\") pod \"aws-ebs-csi-driver-node-j2hrh\" (UID: \"de2c4393-fc07-48bd-b0a6-49208a234c65\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.338841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.338777 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj4qq\" (UniqueName: \"kubernetes.io/projected/7e496a51-4b3f-4df5-8001-ff39c586db50-kube-api-access-vj4qq\") pod \"node-resolver-5mjvb\" (UID: \"7e496a51-4b3f-4df5-8001-ff39c586db50\") " pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.339667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.339648 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltx68\" (UniqueName: \"kubernetes.io/projected/b3e8e51e-0e20-4de0-9618-1f52705dc53b-kube-api-access-ltx68\") pod \"tuned-2v9w9\" (UID: \"b3e8e51e-0e20-4de0-9618-1f52705dc53b\") " pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.339742 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.339719 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r89vl\" (UniqueName: \"kubernetes.io/projected/bcc7c99d-f825-448b-be78-6cc93f5c93df-kube-api-access-r89vl\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:25.339846 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.339830 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6ktv\" (UniqueName: \"kubernetes.io/projected/b3ed9392-3dff-43dc-8873-214b67187418-kube-api-access-p6ktv\") pod \"iptables-alerter-md7kx\" (UID: \"b3ed9392-3dff-43dc-8873-214b67187418\") " pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.429266 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429227 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-systemd-units\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429266 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429266 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-systemd\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429281 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-cni-netd\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429299 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovnkube-config\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429339 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovn-node-metrics-cert\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429349 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-systemd-units\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-cnibin\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429359 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-systemd\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429370 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-cni-netd\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429443 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-cnibin\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.429503 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-host\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-env-overrides\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429543 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429559 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zsq7s\" (UniqueName: \"kubernetes.io/projected/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-kube-api-access-zsq7s\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429584 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ede99d5-75f9-403c-a97c-d8a2032a2006-cni-binary-copy\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429608 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-hostroot\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429633 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-system-cni-dir\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429649 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-host\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429665 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429690 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429714 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-socket-dir-parent\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429736 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-dbus\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.429943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.429882 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-dbus\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430000 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430023 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-env-overrides\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430043 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-slash\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430073 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-k8s-cni-cncf-io\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430073 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovnkube-config\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430090 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-socket-dir-parent\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430097 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-daemon-config\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430142 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-hostroot\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430143 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-cni-binary-copy\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430166 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n98kg\" (UniqueName: \"kubernetes.io/projected/2f865afd-f97c-4c75-8ae0-5866b7df2e53-kube-api-access-n98kg\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430145 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-slash\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430183 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-system-cni-dir\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-multus-certs\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430228 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-kubelet-config\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430252 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-etc-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.430261 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430274 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.430508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430291 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-multus-certs\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430298 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-system-cni-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430155 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-k8s-cni-cncf-io\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.430311 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret podName:1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa nodeName:}" failed. No retries permitted until 2026-06-10 12:03:25.930294511 +0000 UTC m=+3.115416534 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret") pod "global-pull-secret-syncer-wrm7q" (UID: "1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430345 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-cni-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430362 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48wfv\" (UniqueName: \"kubernetes.io/projected/0ede99d5-75f9-403c-a97c-d8a2032a2006-kube-api-access-48wfv\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430377 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-kubelet\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430345 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-system-cni-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430382 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-kubelet-config\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430258 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430401 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ed88afa3-143b-4f7e-928c-5734df568c17-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430424 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430439 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-etc-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430455 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-kubelet\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430461 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-os-release\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.431259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430550 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430567 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-ovn\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430575 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-os-release\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430588 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-cni-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430610 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovnkube-script-lib\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430626 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-run-ovn\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430661 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430683 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-daemon-config\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430733 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0ede99d5-75f9-403c-a97c-d8a2032a2006-cni-binary-copy\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430763 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-run-netns\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-os-release\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430830 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430820 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-run-netns\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-cni-bin\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430872 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-os-release\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430888 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-node-log\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430911 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-run-ovn-kubernetes\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430937 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-log-socket\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.431854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430944 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-run-ovn-kubernetes\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430943 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-node-log\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430960 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-cnibin\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430974 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-log-socket\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-netns\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430991 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ed88afa3-143b-4f7e-928c-5734df568c17-cnibin\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.430912 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-cni-bin\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431013 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-etc-kubernetes\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431019 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-run-netns\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431037 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-serviceca\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431046 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-etc-kubernetes\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431063 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-var-lib-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431087 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovnkube-script-lib\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431113 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-var-lib-openvswitch\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431097 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-cni-bin\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431153 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9gg6g\" (UniqueName: \"kubernetes.io/projected/ed88afa3-143b-4f7e-928c-5734df568c17-kube-api-access-9gg6g\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431223 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2f865afd-f97c-4c75-8ae0-5866b7df2e53-host-cni-bin\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431305 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-cni-multus\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.432489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431326 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-conf-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.433191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-kubelet\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.433191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431405 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-cni-multus\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.433191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431412 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-host-var-lib-kubelet\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.433191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431429 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0ede99d5-75f9-403c-a97c-d8a2032a2006-multus-conf-dir\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.433191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.431470 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-serviceca\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.433191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.433012 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/2f865afd-f97c-4c75-8ae0-5866b7df2e53-ovn-node-metrics-cert\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.441024 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.440992 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zsq7s\" (UniqueName: \"kubernetes.io/projected/4fe40800-cc65-44ed-9482-c8f9b9f7aeb5-kube-api-access-zsq7s\") pod \"node-ca-wmrbk\" (UID: \"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5\") " pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.441736 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.441716 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n98kg\" (UniqueName: \"kubernetes.io/projected/2f865afd-f97c-4c75-8ae0-5866b7df2e53-kube-api-access-n98kg\") pod \"ovnkube-node-hptlr\" (UID: \"2f865afd-f97c-4c75-8ae0-5866b7df2e53\") " pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.442069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.442049 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48wfv\" (UniqueName: \"kubernetes.io/projected/0ede99d5-75f9-403c-a97c-d8a2032a2006-kube-api-access-48wfv\") pod \"multus-qpb9m\" (UID: \"0ede99d5-75f9-403c-a97c-d8a2032a2006\") " pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.442149 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.442133 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9gg6g\" (UniqueName: \"kubernetes.io/projected/ed88afa3-143b-4f7e-928c-5734df568c17-kube-api-access-9gg6g\") pod \"multus-additional-cni-plugins-wdf85\" (UID: \"ed88afa3-143b-4f7e-928c-5734df568c17\") " pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.517331 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.517252 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:25.524975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.524948 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-md7kx" Jun 10 12:03:25.533179 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.533159 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" Jun 10 12:03:25.539776 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.539753 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" Jun 10 12:03:25.545232 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.545214 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-5mjvb" Jun 10 12:03:25.551853 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.551830 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-qpb9m" Jun 10 12:03:25.558564 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.558545 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:25.568163 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.568147 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wmrbk" Jun 10 12:03:25.572620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.572602 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wdf85" Jun 10 12:03:25.834419 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.834350 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:25.834549 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.834458 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:25.834549 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.834506 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:03:26.834492154 +0000 UTC m=+4.019614166 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:25.935552 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.935516 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:25.935703 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:25.935573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:25.935703 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.935684 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:25.935830 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.935704 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:25.935830 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.935724 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:25.935830 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.935737 2570 projected.go:196] Error preparing data for projected volume kube-api-access-44fs4 for pod openshift-network-diagnostics/network-check-target-4r469: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:25.935830 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.935743 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret podName:1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa nodeName:}" failed. No retries permitted until 2026-06-10 12:03:26.935726723 +0000 UTC m=+4.120848737 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret") pod "global-pull-secret-syncer-wrm7q" (UID: "1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:25.935830 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:25.935785 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4 podName:41173b40-c654-4a53-8832-ed11b931f54c nodeName:}" failed. No retries permitted until 2026-06-10 12:03:26.935774974 +0000 UTC m=+4.120896983 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-44fs4" (UniqueName: "kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4") pod "network-check-target-4r469" (UID: "41173b40-c654-4a53-8832-ed11b931f54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:25.990400 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:25.990369 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3e8e51e_0e20_4de0_9618_1f52705dc53b.slice/crio-2bd3e9dc1ed47f1a21dcfd61256c0d9baa3aad1d7dcd64d48914d52aa4f07f46 WatchSource:0}: Error finding container 2bd3e9dc1ed47f1a21dcfd61256c0d9baa3aad1d7dcd64d48914d52aa4f07f46: Status 404 returned error can't find the container with id 2bd3e9dc1ed47f1a21dcfd61256c0d9baa3aad1d7dcd64d48914d52aa4f07f46 Jun 10 12:03:25.991348 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:25.991323 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f865afd_f97c_4c75_8ae0_5866b7df2e53.slice/crio-3fdd81d54a461075c0d8076ddbb62af77161f8a0a1a678f9daec0c5f3629f40c WatchSource:0}: Error finding container 3fdd81d54a461075c0d8076ddbb62af77161f8a0a1a678f9daec0c5f3629f40c: Status 404 returned error can't find the container with id 3fdd81d54a461075c0d8076ddbb62af77161f8a0a1a678f9daec0c5f3629f40c Jun 10 12:03:25.993417 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:25.993382 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e496a51_4b3f_4df5_8001_ff39c586db50.slice/crio-68a5ac1ebe0d5e99dd956e98746d645ae37a95c0bea681a96f2c651a806e3768 WatchSource:0}: Error finding container 68a5ac1ebe0d5e99dd956e98746d645ae37a95c0bea681a96f2c651a806e3768: Status 404 returned error can't find the container with id 68a5ac1ebe0d5e99dd956e98746d645ae37a95c0bea681a96f2c651a806e3768 Jun 10 12:03:25.996403 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:25.996384 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3ed9392_3dff_43dc_8873_214b67187418.slice/crio-0e104aab9a5f3c4792471473bb49791f1bb8a601aa069d173b3e08972bdeb93a WatchSource:0}: Error finding container 0e104aab9a5f3c4792471473bb49791f1bb8a601aa069d173b3e08972bdeb93a: Status 404 returned error can't find the container with id 0e104aab9a5f3c4792471473bb49791f1bb8a601aa069d173b3e08972bdeb93a Jun 10 12:03:25.997211 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:25.997184 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4fe40800_cc65_44ed_9482_c8f9b9f7aeb5.slice/crio-852e7e2647698c40ce5b9641ed748c592b1bafa1f6080f3178d9559f6b2a5c21 WatchSource:0}: Error finding container 852e7e2647698c40ce5b9641ed748c592b1bafa1f6080f3178d9559f6b2a5c21: Status 404 returned error can't find the container with id 852e7e2647698c40ce5b9641ed748c592b1bafa1f6080f3178d9559f6b2a5c21 Jun 10 12:03:25.998374 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:25.998350 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e58e6b_53ef_4b91_b4a3_1724e9cf4f62.slice/crio-9b985c859221b578bc262950fbcf5c06ff3e158443cf10ac36ca37fe17741080 WatchSource:0}: Error finding container 9b985c859221b578bc262950fbcf5c06ff3e158443cf10ac36ca37fe17741080: Status 404 returned error can't find the container with id 9b985c859221b578bc262950fbcf5c06ff3e158443cf10ac36ca37fe17741080 Jun 10 12:03:25.999680 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:25.999651 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ede99d5_75f9_403c_a97c_d8a2032a2006.slice/crio-fb67e1227f6dc08ba3397c42d6b3dcb281a70f94990d3e82b840bbb94a756cb4 WatchSource:0}: Error finding container fb67e1227f6dc08ba3397c42d6b3dcb281a70f94990d3e82b840bbb94a756cb4: Status 404 returned error can't find the container with id fb67e1227f6dc08ba3397c42d6b3dcb281a70f94990d3e82b840bbb94a756cb4 Jun 10 12:03:26.001925 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:26.001900 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded88afa3_143b_4f7e_928c_5734df568c17.slice/crio-84fa5872092b68d473a659f2baee23ae402b732e175d8ee2fa8540da20c66da4 WatchSource:0}: Error finding container 84fa5872092b68d473a659f2baee23ae402b732e175d8ee2fa8540da20c66da4: Status 404 returned error can't find the container with id 84fa5872092b68d473a659f2baee23ae402b732e175d8ee2fa8540da20c66da4 Jun 10 12:03:26.259819 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.259626 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:58:25 +0000 UTC" deadline="2028-01-02 22:14:40.815450094 +0000 UTC" Jun 10 12:03:26.259819 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.259793 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13714h11m14.555660056s" Jun 10 12:03:26.295243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.295204 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpb9m" event={"ID":"0ede99d5-75f9-403c-a97c-d8a2032a2006","Type":"ContainerStarted","Data":"fb67e1227f6dc08ba3397c42d6b3dcb281a70f94990d3e82b840bbb94a756cb4"} Jun 10 12:03:26.296491 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.296466 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmrbk" event={"ID":"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5","Type":"ContainerStarted","Data":"852e7e2647698c40ce5b9641ed748c592b1bafa1f6080f3178d9559f6b2a5c21"} Jun 10 12:03:26.297380 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.297348 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-md7kx" event={"ID":"b3ed9392-3dff-43dc-8873-214b67187418","Type":"ContainerStarted","Data":"0e104aab9a5f3c4792471473bb49791f1bb8a601aa069d173b3e08972bdeb93a"} Jun 10 12:03:26.298342 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.298317 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mjvb" event={"ID":"7e496a51-4b3f-4df5-8001-ff39c586db50","Type":"ContainerStarted","Data":"68a5ac1ebe0d5e99dd956e98746d645ae37a95c0bea681a96f2c651a806e3768"} Jun 10 12:03:26.301070 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.300026 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"3fdd81d54a461075c0d8076ddbb62af77161f8a0a1a678f9daec0c5f3629f40c"} Jun 10 12:03:26.303493 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.303472 2570 generic.go:356] "Generic (PLEG): container finished" podID="71b9fc6a00a2fd7f537b48fb8ddff410" containerID="86666b0f2ad7afdd63a5b169279d2ed9334daa1720fd595c07c72ddbe8730f0a" exitCode=0 Jun 10 12:03:26.303625 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.303501 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" event={"ID":"71b9fc6a00a2fd7f537b48fb8ddff410","Type":"ContainerDied","Data":"86666b0f2ad7afdd63a5b169279d2ed9334daa1720fd595c07c72ddbe8730f0a"} Jun 10 12:03:26.307416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.307392 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerStarted","Data":"84fa5872092b68d473a659f2baee23ae402b732e175d8ee2fa8540da20c66da4"} Jun 10 12:03:26.308364 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.308338 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ft8pz" event={"ID":"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62","Type":"ContainerStarted","Data":"9b985c859221b578bc262950fbcf5c06ff3e158443cf10ac36ca37fe17741080"} Jun 10 12:03:26.309841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.309816 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" event={"ID":"b3e8e51e-0e20-4de0-9618-1f52705dc53b","Type":"ContainerStarted","Data":"2bd3e9dc1ed47f1a21dcfd61256c0d9baa3aad1d7dcd64d48914d52aa4f07f46"} Jun 10 12:03:26.311302 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.311281 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" event={"ID":"c260edd97696a65a12fb99bc6379a012","Type":"ContainerStarted","Data":"7bbab18b9c00d1db3aba57af54238ece1e20bf314673d21b1ce1beecb8b5b58c"} Jun 10 12:03:26.312630 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.312606 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" event={"ID":"de2c4393-fc07-48bd-b0a6-49208a234c65","Type":"ContainerStarted","Data":"d5e9ab3afdb1d1353076e14600a906aa74ee76065f92666624506b7af86afc2d"} Jun 10 12:03:26.336990 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.336947 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-187.ec2.internal" podStartSLOduration=2.336929988 podStartE2EDuration="2.336929988s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:26.336140812 +0000 UTC m=+3.521262844" watchObservedRunningTime="2026-06-10 12:03:26.336929988 +0000 UTC m=+3.522051999" Jun 10 12:03:26.844059 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.844018 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:26.844247 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.844206 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:26.844314 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.844268 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:03:28.844249818 +0000 UTC m=+6.029371847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:26.944522 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.944479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:26.944685 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:26.944550 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:26.944756 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.944683 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:26.944756 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.944701 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:26.944756 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.944714 2570 projected.go:196] Error preparing data for projected volume kube-api-access-44fs4 for pod openshift-network-diagnostics/network-check-target-4r469: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:26.944937 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.944772 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4 podName:41173b40-c654-4a53-8832-ed11b931f54c nodeName:}" failed. No retries permitted until 2026-06-10 12:03:28.944753969 +0000 UTC m=+6.129875979 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-44fs4" (UniqueName: "kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4") pod "network-check-target-4r469" (UID: "41173b40-c654-4a53-8832-ed11b931f54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:26.945199 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.945178 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:26.945271 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:26.945236 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret podName:1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa nodeName:}" failed. No retries permitted until 2026-06-10 12:03:28.945220945 +0000 UTC m=+6.130342958 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret") pod "global-pull-secret-syncer-wrm7q" (UID: "1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:27.260406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:27.260279 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 11:58:25 +0000 UTC" deadline="2028-02-25 07:44:55.32127597 +0000 UTC" Jun 10 12:03:27.260406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:27.260347 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14995h41m28.060933942s" Jun 10 12:03:27.290606 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:27.290574 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:27.290781 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:27.290707 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:27.291230 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:27.291210 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:27.291346 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:27.291325 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:27.291414 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:27.291396 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:27.291491 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:27.291470 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:27.331558 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:27.331525 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" event={"ID":"71b9fc6a00a2fd7f537b48fb8ddff410","Type":"ContainerStarted","Data":"64a6745012fd2841c53ba2dd1afe70b429020da5e057ceb95a3ed671d7a4a960"} Jun 10 12:03:28.860448 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:28.859851 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:28.860448 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.859991 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:28.860448 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.860072 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:03:32.860053935 +0000 UTC m=+10.045175971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:28.960165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:28.960225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.960375 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.960393 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.960406 2570 projected.go:196] Error preparing data for projected volume kube-api-access-44fs4 for pod openshift-network-diagnostics/network-check-target-4r469: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.960464 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4 podName:41173b40-c654-4a53-8832-ed11b931f54c nodeName:}" failed. No retries permitted until 2026-06-10 12:03:32.9604458 +0000 UTC m=+10.145567812 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-44fs4" (UniqueName: "kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4") pod "network-check-target-4r469" (UID: "41173b40-c654-4a53-8832-ed11b931f54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.960533 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:28.960943 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:28.960567 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret podName:1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa nodeName:}" failed. No retries permitted until 2026-06-10 12:03:32.960556281 +0000 UTC m=+10.145678293 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret") pod "global-pull-secret-syncer-wrm7q" (UID: "1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:29.289000 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:29.288919 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:29.289137 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:29.289073 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:29.289501 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:29.289481 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:29.289610 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:29.289583 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:29.289668 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:29.289656 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:29.289742 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:29.289726 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:31.290579 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:31.290544 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:31.291018 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:31.290682 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:31.291018 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:31.291014 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:31.291137 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:31.291097 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:31.291195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:31.291139 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:31.291249 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:31.291197 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:32.889834 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:32.889747 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:32.890261 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.889929 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:32.890261 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.890010 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:03:40.889987931 +0000 UTC m=+18.075109960 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:32.990399 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:32.990361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:32.990557 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:32.990425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:32.990557 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.990525 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:32.990557 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.990552 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:32.990724 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.990572 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:32.990724 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.990585 2570 projected.go:196] Error preparing data for projected volume kube-api-access-44fs4 for pod openshift-network-diagnostics/network-check-target-4r469: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:32.990724 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.990605 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret podName:1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa nodeName:}" failed. No retries permitted until 2026-06-10 12:03:40.990582398 +0000 UTC m=+18.175704416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret") pod "global-pull-secret-syncer-wrm7q" (UID: "1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:32.990724 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:32.990632 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4 podName:41173b40-c654-4a53-8832-ed11b931f54c nodeName:}" failed. No retries permitted until 2026-06-10 12:03:40.99061658 +0000 UTC m=+18.175738597 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-44fs4" (UniqueName: "kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4") pod "network-check-target-4r469" (UID: "41173b40-c654-4a53-8832-ed11b931f54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:33.297114 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:33.297015 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:33.297114 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:33.297103 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:33.297299 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:33.297124 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:33.297299 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:33.297263 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:33.297815 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:33.297770 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:33.297927 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:33.297905 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:35.287886 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:35.287848 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:35.288351 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:35.287997 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:35.288351 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:35.288313 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:35.288462 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:35.288400 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:35.288462 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:35.288436 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:35.288559 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:35.288475 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:37.287902 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:37.287869 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:37.287902 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:37.287886 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:37.288390 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:37.287879 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:37.288390 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:37.287995 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:37.288390 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:37.288057 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:37.288390 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:37.288138 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:39.288766 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:39.288721 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:39.289246 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:39.288728 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:39.289246 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:39.288870 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:39.289246 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:39.288911 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:39.289246 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:39.289019 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:39.289246 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:39.289113 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:40.950702 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:40.950668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:40.951099 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:40.950778 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:40.951099 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:40.950860 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:03:56.950844669 +0000 UTC m=+34.135966688 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:41.051644 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:41.051611 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:41.051832 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:41.051653 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:41.051832 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.051771 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:41.051832 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.051785 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:41.051832 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.051812 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:41.051832 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.051822 2570 projected.go:196] Error preparing data for projected volume kube-api-access-44fs4 for pod openshift-network-diagnostics/network-check-target-4r469: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:41.052045 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.051988 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret podName:1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa nodeName:}" failed. No retries permitted until 2026-06-10 12:03:57.051837189 +0000 UTC m=+34.236959201 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret") pod "global-pull-secret-syncer-wrm7q" (UID: "1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:41.052045 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.052013 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4 podName:41173b40-c654-4a53-8832-ed11b931f54c nodeName:}" failed. No retries permitted until 2026-06-10 12:03:57.05200567 +0000 UTC m=+34.237127682 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-44fs4" (UniqueName: "kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4") pod "network-check-target-4r469" (UID: "41173b40-c654-4a53-8832-ed11b931f54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:41.288775 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:41.288683 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:41.288775 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:41.288729 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:41.289009 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:41.288691 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:41.289009 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.288832 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:41.289009 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.288910 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:41.289009 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:41.288983 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:43.288530 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:43.288499 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:43.289097 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:43.288598 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:43.289097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:43.288967 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:43.289097 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:43.289055 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:43.289257 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:43.289181 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:43.289257 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:43.289245 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:45.288064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.287879 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:45.288718 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:45.288169 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:45.288718 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.288223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:45.288718 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:45.288308 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:45.288718 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.288382 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:45.288718 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:45.288465 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:45.368325 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.368133 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" event={"ID":"de2c4393-fc07-48bd-b0a6-49208a234c65","Type":"ContainerStarted","Data":"deace9beaf08e3d33337e149c477103998acc2c43d79e4c38a6c01a6bdbd6a2b"} Jun 10 12:03:45.369465 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.369441 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-qpb9m" event={"ID":"0ede99d5-75f9-403c-a97c-d8a2032a2006","Type":"ContainerStarted","Data":"c1bc000954ebb7b96ed26259f00905fdba4bc818c0395b492070bcfd7026f13f"} Jun 10 12:03:45.370936 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.370912 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wmrbk" event={"ID":"4fe40800-cc65-44ed-9482-c8f9b9f7aeb5","Type":"ContainerStarted","Data":"acfab5b185fe8cee88cfda9a98229e7e5a86c3bff6ebd84ce9efbd873f949820"} Jun 10 12:03:45.372280 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.372250 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-5mjvb" event={"ID":"7e496a51-4b3f-4df5-8001-ff39c586db50","Type":"ContainerStarted","Data":"ee25e81c9423944a4ff4e88329edb59e7418177a1cc34593eea0a9842feb6320"} Jun 10 12:03:45.374944 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.374927 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:03:45.376320 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.376293 2570 generic.go:356] "Generic (PLEG): container finished" podID="2f865afd-f97c-4c75-8ae0-5866b7df2e53" containerID="90327ee6ae4ebbfe03a0005911574b09724afb8a8b5decb28f7165091d40b742" exitCode=1 Jun 10 12:03:45.376460 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.376390 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"0fae75d20e1e1f10531d7178a3a7b3791b52579b91006eb7a6cfcfb85b24e2a0"} Jun 10 12:03:45.376546 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.376524 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"5281c1246185154516d1ae71db8642dd26efd9bac43d604c121ee81911e622aa"} Jun 10 12:03:45.376611 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.376598 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"c1f69bc5baad35cbbe7cd418e8e16844171daacffa92faae7033bc95ce00c0b9"} Jun 10 12:03:45.376680 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.376666 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerDied","Data":"90327ee6ae4ebbfe03a0005911574b09724afb8a8b5decb28f7165091d40b742"} Jun 10 12:03:45.376749 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.376736 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"086b1b7ceb79c0d15c5849c6fc06356af5137688f271178cd1c5252a3e18fa2f"} Jun 10 12:03:45.379350 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.379332 2570 generic.go:356] "Generic (PLEG): container finished" podID="ed88afa3-143b-4f7e-928c-5734df568c17" containerID="35bdf16e8ead377781c7965520d3583ef51e9e242bb757f3cc2d4b8e222d877d" exitCode=0 Jun 10 12:03:45.379447 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.379394 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerDied","Data":"35bdf16e8ead377781c7965520d3583ef51e9e242bb757f3cc2d4b8e222d877d"} Jun 10 12:03:45.380773 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.380755 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ft8pz" event={"ID":"95e58e6b-53ef-4b91-b4a3-1724e9cf4f62","Type":"ContainerStarted","Data":"d0c0823c42d26df2bba1963803c9ae318130f3afd9381aa34ec009b7ee991824"} Jun 10 12:03:45.382142 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.382124 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" event={"ID":"b3e8e51e-0e20-4de0-9618-1f52705dc53b","Type":"ContainerStarted","Data":"6dcfbcb8960399e90b8b424a12c76fb6176252a00932248d062ef2bfb9ddc8d5"} Jun 10 12:03:45.386004 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.385969 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-qpb9m" podStartSLOduration=3.691953856 podStartE2EDuration="22.385945803s" totalImagesPullingTime="18.693991947s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:45.385883961 +0000 UTC m=+22.571005993" watchObservedRunningTime="2026-06-10 12:03:45.385945803 +0000 UTC m=+22.571067811" Jun 10 12:03:45.386626 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.386603 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-187.ec2.internal" podStartSLOduration=21.386596291 podStartE2EDuration="21.386596291s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:27.347167899 +0000 UTC m=+4.532289932" watchObservedRunningTime="2026-06-10 12:03:45.386596291 +0000 UTC m=+22.571718325" Jun 10 12:03:45.399352 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.399317 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ft8pz" podStartSLOduration=11.977469985 podStartE2EDuration="22.399306675s" totalImagesPullingTime="10.42183669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:45.399036496 +0000 UTC m=+22.584158526" watchObservedRunningTime="2026-06-10 12:03:45.399306675 +0000 UTC m=+22.584428706" Jun 10 12:03:45.413593 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.413561 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-5mjvb" podStartSLOduration=8.297214134 podStartE2EDuration="22.41355032s" totalImagesPullingTime="14.116336186s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:45.413493797 +0000 UTC m=+22.598615827" watchObservedRunningTime="2026-06-10 12:03:45.41355032 +0000 UTC m=+22.598672350" Jun 10 12:03:45.429676 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.429639 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wmrbk" podStartSLOduration=4.036268377 podStartE2EDuration="22.42962745s" totalImagesPullingTime="18.393359073s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:45.429132892 +0000 UTC m=+22.614254922" watchObservedRunningTime="2026-06-10 12:03:45.42962745 +0000 UTC m=+22.614749481" Jun 10 12:03:45.444552 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.444468 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-2v9w9" podStartSLOduration=3.752780814 podStartE2EDuration="22.444455826s" totalImagesPullingTime="18.691675012s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:45.4442446 +0000 UTC m=+22.629366631" watchObservedRunningTime="2026-06-10 12:03:45.444455826 +0000 UTC m=+22.629577858" Jun 10 12:03:45.511717 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.511688 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:45.567150 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:45.567121 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:46.385326 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:46.385294 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-md7kx" event={"ID":"b3ed9392-3dff-43dc-8873-214b67187418","Type":"ContainerStarted","Data":"cee896dfafaf2ce6450b9083105e382a7ac93b0356b37d8a9b3e7506a670fbae"} Jun 10 12:03:46.388558 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:46.388540 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:03:46.389698 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:46.389674 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"7f96cc4a8c367fdc76117ac17ee976b556f85c9db920e3e3513bb41de8571361"} Jun 10 12:03:46.400540 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:46.400503 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-md7kx" podStartSLOduration=5.007073511 podStartE2EDuration="23.400490949s" totalImagesPullingTime="18.393417438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:46.400119343 +0000 UTC m=+23.585241373" watchObservedRunningTime="2026-06-10 12:03:46.400490949 +0000 UTC m=+23.585612980" Jun 10 12:03:46.518424 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:46.518400 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:46.554143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:46.553969 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 10 12:03:46.620162 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:46.620115 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:47.288071 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:47.288040 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:47.288250 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:47.288085 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:47.288250 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:47.288040 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:47.288250 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:47.288168 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:47.288410 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:47.288304 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:47.288410 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:47.288374 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:47.291284 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:47.291159 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T12:03:46.553990373Z","UUID":"5d4fc4a8-31bb-453f-a5de-1ea7e993240a","Handler":null,"Name":"","Endpoint":""} Jun 10 12:03:47.292851 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:47.292827 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 10 12:03:47.292937 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:47.292874 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 10 12:03:47.393919 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:47.393880 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" event={"ID":"de2c4393-fc07-48bd-b0a6-49208a234c65","Type":"ContainerStarted","Data":"17c758cd0f5c5c31dc59e3acafeff76dddf402fbb7fd84c0708be901b7eeb597"} Jun 10 12:03:48.169785 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:48.169586 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:48.242169 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:48.242136 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:48.342273 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:48.342240 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:48.398488 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:48.398460 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" event={"ID":"de2c4393-fc07-48bd-b0a6-49208a234c65","Type":"ContainerStarted","Data":"a1cbf8b03b229f0d6c0db558a4ad935f28bda08152e067f4c51610d47de17aa6"} Jun 10 12:03:48.402236 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:48.402214 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:03:48.402652 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:48.402629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"4bb957e807eeca658feef1420dd795944f9a178d468a8e171a86221a13f770b8"} Jun 10 12:03:48.415542 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:48.415504 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j2hrh" podStartSLOduration=4.271600508 podStartE2EDuration="25.415493081s" totalImagesPullingTime="21.143892573s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:48.415246467 +0000 UTC m=+25.600368500" watchObservedRunningTime="2026-06-10 12:03:48.415493081 +0000 UTC m=+25.600615112" Jun 10 12:03:49.138297 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:49.138266 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:49.206854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:49.206752 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:49.288099 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:49.288068 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:49.288253 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:49.288200 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:49.288253 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:49.288208 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:49.288360 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:49.288308 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:49.288466 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:49.288360 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:49.288466 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:49.288449 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:49.740842 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:49.740819 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:49.741406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:49.741282 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:50.410372 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.410210 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:03:50.410738 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.410715 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"a049895aa6d600e0d0443e71b49b0ecc9c8bee1bb3860222724aa2f1b861d8dd"} Jun 10 12:03:50.411040 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.411013 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:50.411183 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.411094 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:50.411236 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.411209 2570 scope.go:117] "RemoveContainer" containerID="90327ee6ae4ebbfe03a0005911574b09724afb8a8b5decb28f7165091d40b742" Jun 10 12:03:50.412726 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.412699 2570 generic.go:356] "Generic (PLEG): container finished" podID="ed88afa3-143b-4f7e-928c-5734df568c17" containerID="063bae3467b6f4bac6736f14282ca1ded70508a050011923ac23dbb4b97be47a" exitCode=0 Jun 10 12:03:50.412849 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.412776 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerDied","Data":"063bae3467b6f4bac6736f14282ca1ded70508a050011923ac23dbb4b97be47a"} Jun 10 12:03:50.428400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.428383 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:50.429766 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:50.429751 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:51.288345 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.288306 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:51.288759 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.288307 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:51.288759 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.288430 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:51.288759 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:51.288429 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:51.288759 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:51.288511 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:51.288759 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:51.288583 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:51.419029 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.419003 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:03:51.419536 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.419502 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" event={"ID":"2f865afd-f97c-4c75-8ae0-5866b7df2e53","Type":"ContainerStarted","Data":"36b5ffc98078db846efa7699b227094a63bc03423d479b87ac7b9439b6cdf4d5"} Jun 10 12:03:51.419536 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.419529 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 12:03:51.421683 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.421662 2570 generic.go:356] "Generic (PLEG): container finished" podID="ed88afa3-143b-4f7e-928c-5734df568c17" containerID="90f1b8e56f2d5a21addaf4b053cae20ffec9b16c639348f5b334801acf3d4c9f" exitCode=0 Jun 10 12:03:51.421767 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.421689 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerDied","Data":"90f1b8e56f2d5a21addaf4b053cae20ffec9b16c639348f5b334801acf3d4c9f"} Jun 10 12:03:51.445783 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.445740 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" podStartSLOduration=9.688256233 podStartE2EDuration="28.445726553s" totalImagesPullingTime="18.75747032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:51.443755419 +0000 UTC m=+28.628877449" watchObservedRunningTime="2026-06-10 12:03:51.445726553 +0000 UTC m=+28.630848583" Jun 10 12:03:51.809855 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.809734 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrm7q"] Jun 10 12:03:51.810004 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.809900 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:51.810075 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:51.810007 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:51.810509 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.810487 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ftjkg"] Jun 10 12:03:51.810591 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.810579 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:51.810680 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:51.810658 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:51.822314 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.822284 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4r469"] Jun 10 12:03:51.822455 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:51.822379 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:51.822524 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:51.822467 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:52.155910 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.155714 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:52.426305 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.426271 2570 generic.go:356] "Generic (PLEG): container finished" podID="ed88afa3-143b-4f7e-928c-5734df568c17" containerID="36b9d2da7740fdf666f10f16ed17ac254c6922518af11836a916956529ef4f3d" exitCode=0 Jun 10 12:03:52.426710 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.426359 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerDied","Data":"36b9d2da7740fdf666f10f16ed17ac254c6922518af11836a916956529ef4f3d"} Jun 10 12:03:52.426710 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.426456 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 12:03:52.691610 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.691540 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:52.691746 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.691655 2570 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jun 10 12:03:52.692211 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.692191 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ft8pz" Jun 10 12:03:52.754222 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:52.754194 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:53.288786 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:53.288750 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:53.288960 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:53.288892 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:53.289035 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:53.289020 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:53.289136 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:53.289117 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:53.289189 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:53.289167 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:53.289270 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:53.289246 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:53.638505 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:53.638464 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:03:55.287859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:55.287819 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:55.287859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:55.287859 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:55.288479 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:55.287818 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:55.288479 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:55.287977 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:55.288479 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:55.288093 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:55.288479 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:55.288150 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:56.975919 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:56.975886 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:56.976350 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:56.975989 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:56.976350 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:56.976038 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:04:28.976025226 +0000 UTC m=+66.161147235 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 10 12:03:57.076209 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.076128 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:57.076209 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.076197 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:57.076395 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.076292 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:57.076395 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.076296 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 10 12:03:57.076395 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.076321 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 10 12:03:57.076395 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.076335 2570 projected.go:196] Error preparing data for projected volume kube-api-access-44fs4 for pod openshift-network-diagnostics/network-check-target-4r469: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:57.076395 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.076353 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret podName:1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa nodeName:}" failed. No retries permitted until 2026-06-10 12:04:29.076336984 +0000 UTC m=+66.261459006 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret") pod "global-pull-secret-syncer-wrm7q" (UID: "1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa") : object "kube-system"/"original-pull-secret" not registered Jun 10 12:03:57.076395 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.076375 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4 podName:41173b40-c654-4a53-8832-ed11b931f54c nodeName:}" failed. No retries permitted until 2026-06-10 12:04:29.076364893 +0000 UTC m=+66.261486906 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-44fs4" (UniqueName: "kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4") pod "network-check-target-4r469" (UID: "41173b40-c654-4a53-8832-ed11b931f54c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 10 12:03:57.288025 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.287994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:57.288241 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.287994 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:57.288241 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.288116 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:03:57.288241 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.288131 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:57.288241 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.288196 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-4r469" podUID="41173b40-c654-4a53-8832-ed11b931f54c" Jun 10 12:03:57.288412 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.288269 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wrm7q" podUID="1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa" Jun 10 12:03:57.441901 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.441873 2570 generic.go:356] "Generic (PLEG): container finished" podID="ed88afa3-143b-4f7e-928c-5734df568c17" containerID="1c423bea9d814edbc4fcfdf25299760cac76a5bd48141416d856f733c0f5d3e8" exitCode=0 Jun 10 12:03:57.442039 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.441914 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerDied","Data":"1c423bea9d814edbc4fcfdf25299760cac76a5bd48141416d856f733c0f5d3e8"} Jun 10 12:03:57.584602 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.584583 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-187.ec2.internal" event="NodeReady" Jun 10 12:03:57.584727 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.584692 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 10 12:03:57.636816 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.636745 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-2wx2n"] Jun 10 12:03:57.651303 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.651275 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6fkp9"] Jun 10 12:03:57.651469 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.651394 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.654054 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.654033 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 10 12:03:57.654166 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.654090 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xc76w\"" Jun 10 12:03:57.654166 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.654137 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 10 12:03:57.663390 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.663374 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fkp9"] Jun 10 12:03:57.663470 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.663401 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wx2n"] Jun 10 12:03:57.663507 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.663478 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:57.665964 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.665949 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 10 12:03:57.666117 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.666104 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 10 12:03:57.666173 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.666149 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 10 12:03:57.666317 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.666305 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-kwnl9\"" Jun 10 12:03:57.782526 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.782499 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28f58d87-88fb-41e4-9ef4-31bab030a6b8-config-volume\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.782695 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.782539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhwgz\" (UniqueName: \"kubernetes.io/projected/853bb5c4-9b76-46e2-b48e-925fbb772f20-kube-api-access-dhwgz\") pod \"ingress-canary-6fkp9\" (UID: \"853bb5c4-9b76-46e2-b48e-925fbb772f20\") " pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:57.782695 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.782618 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/853bb5c4-9b76-46e2-b48e-925fbb772f20-cert\") pod \"ingress-canary-6fkp9\" (UID: \"853bb5c4-9b76-46e2-b48e-925fbb772f20\") " pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:57.782695 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.782644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f58d87-88fb-41e4-9ef4-31bab030a6b8-tmp-dir\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.782695 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.782694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.782903 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.782717 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jkzl9\" (UniqueName: \"kubernetes.io/projected/28f58d87-88fb-41e4-9ef4-31bab030a6b8-kube-api-access-jkzl9\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.883226 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883200 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28f58d87-88fb-41e4-9ef4-31bab030a6b8-config-volume\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.883316 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883231 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhwgz\" (UniqueName: \"kubernetes.io/projected/853bb5c4-9b76-46e2-b48e-925fbb772f20-kube-api-access-dhwgz\") pod \"ingress-canary-6fkp9\" (UID: \"853bb5c4-9b76-46e2-b48e-925fbb772f20\") " pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:57.883316 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883269 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/853bb5c4-9b76-46e2-b48e-925fbb772f20-cert\") pod \"ingress-canary-6fkp9\" (UID: \"853bb5c4-9b76-46e2-b48e-925fbb772f20\") " pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:57.883316 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f58d87-88fb-41e4-9ef4-31bab030a6b8-tmp-dir\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.883454 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883317 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.883454 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883332 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jkzl9\" (UniqueName: \"kubernetes.io/projected/28f58d87-88fb-41e4-9ef4-31bab030a6b8-kube-api-access-jkzl9\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.883535 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.883470 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:03:57.883570 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:57.883538 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:58.383518357 +0000 UTC m=+35.568640366 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:03:57.883663 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883643 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28f58d87-88fb-41e4-9ef4-31bab030a6b8-tmp-dir\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.883869 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.883854 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/28f58d87-88fb-41e4-9ef4-31bab030a6b8-config-volume\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.887510 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.887459 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/853bb5c4-9b76-46e2-b48e-925fbb772f20-cert\") pod \"ingress-canary-6fkp9\" (UID: \"853bb5c4-9b76-46e2-b48e-925fbb772f20\") " pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:57.895509 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.895480 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jkzl9\" (UniqueName: \"kubernetes.io/projected/28f58d87-88fb-41e4-9ef4-31bab030a6b8-kube-api-access-jkzl9\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:57.895748 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.895728 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhwgz\" (UniqueName: \"kubernetes.io/projected/853bb5c4-9b76-46e2-b48e-925fbb772f20-kube-api-access-dhwgz\") pod \"ingress-canary-6fkp9\" (UID: \"853bb5c4-9b76-46e2-b48e-925fbb772f20\") " pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:57.986375 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:57.986344 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6fkp9" Jun 10 12:03:58.152915 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:58.152662 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6fkp9"] Jun 10 12:03:58.156316 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:03:58.156291 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod853bb5c4_9b76_46e2_b48e_925fbb772f20.slice/crio-cb284a9844378df8c145d4c67024fddad9340d9d083f70680b7324e587155a64 WatchSource:0}: Error finding container cb284a9844378df8c145d4c67024fddad9340d9d083f70680b7324e587155a64: Status 404 returned error can't find the container with id cb284a9844378df8c145d4c67024fddad9340d9d083f70680b7324e587155a64 Jun 10 12:03:58.387982 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:58.387945 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:58.388200 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:58.388080 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:03:58.388200 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:58.388141 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:03:59.388123227 +0000 UTC m=+36.573245239 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:03:58.447256 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:58.447165 2570 generic.go:356] "Generic (PLEG): container finished" podID="ed88afa3-143b-4f7e-928c-5734df568c17" containerID="ae6b213bcd1ad443bac2ab6956523de325bb876862ac2944a5b1e6b73ef7618c" exitCode=0 Jun 10 12:03:58.447428 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:58.447250 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerDied","Data":"ae6b213bcd1ad443bac2ab6956523de325bb876862ac2944a5b1e6b73ef7618c"} Jun 10 12:03:58.448434 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:58.448408 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fkp9" event={"ID":"853bb5c4-9b76-46e2-b48e-925fbb772f20","Type":"ContainerStarted","Data":"cb284a9844378df8c145d4c67024fddad9340d9d083f70680b7324e587155a64"} Jun 10 12:03:59.287973 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.287935 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:03:59.288496 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.287934 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:03:59.288496 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.287934 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:03:59.291673 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.291042 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:03:59.291673 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.291043 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bjlvn\"" Jun 10 12:03:59.292239 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.292221 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:03:59.292344 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.292259 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:03:59.292539 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.292517 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:03:59.292642 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.292582 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xl6cp\"" Jun 10 12:03:59.396989 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.396945 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:03:59.397175 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:59.397064 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:03:59.397175 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:03:59.397121 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:01.397106047 +0000 UTC m=+38.582228072 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:03:59.455135 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.455100 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wdf85" event={"ID":"ed88afa3-143b-4f7e-928c-5734df568c17","Type":"ContainerStarted","Data":"3504505d0c7eb1a30d308bfbe3b66adb68228774f5244e0c5f2e1a1cde4c49db"} Jun 10 12:03:59.476538 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.476474 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wdf85" podStartSLOduration=8.495569112 podStartE2EDuration="36.476453484s" totalImagesPullingTime="27.980884372s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:03:59.474872643 +0000 UTC m=+36.659994671" watchObservedRunningTime="2026-06-10 12:03:59.476453484 +0000 UTC m=+36.661575516" Jun 10 12:03:59.597037 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.597003 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:03:59.652974 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:03:59.652938 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:00.066134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:00.066045 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:00.116472 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:00.116419 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:01.411253 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:01.411079 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:04:01.411253 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:01.411249 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:01.411665 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:01.411317 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:05.411299799 +0000 UTC m=+42.596421809 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:04:01.462638 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:01.462604 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6fkp9" event={"ID":"853bb5c4-9b76-46e2-b48e-925fbb772f20","Type":"ContainerStarted","Data":"9045b2471c5811fca0712beeef112a21a6dd1d8830ce46bd32e56e2cb8852faf"} Jun 10 12:04:01.478038 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:01.477981 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6fkp9" podStartSLOduration=1.944015001 podStartE2EDuration="4.477964193s" totalImagesPullingTime="2.533949192s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:01.476513114 +0000 UTC m=+38.661635155" watchObservedRunningTime="2026-06-10 12:04:01.477964193 +0000 UTC m=+38.663086223" Jun 10 12:04:03.580910 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:03.580873 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:03.628586 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:03.628554 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:04.028773 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:04.028740 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:04.099150 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:04.099117 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:04.227159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:04.227130 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:04.281384 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:04.281310 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:05.441854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:05.441791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:04:05.442235 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:05.441911 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:05.442235 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:05.441979 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:13.441962362 +0000 UTC m=+50.627084374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:04:13.499681 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:13.499652 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:04:13.500111 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:13.499748 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:13.500111 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:13.499818 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:04:29.49978939 +0000 UTC m=+66.684911401 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:04:23.649821 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:23.649774 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-hptlr" Jun 10 12:04:23.802887 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:23.802853 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:23.901645 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:23.901561 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:24.155208 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:24.155123 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:24.208547 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:24.208521 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:24.259642 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:24.259616 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:04:29.005855 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.005791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:04:29.008409 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.008390 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 10 12:04:29.016574 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:29.016557 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:04:29.016633 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:29.016615 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:05:33.016601222 +0000 UTC m=+130.201723235 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : secret "metrics-daemon-secret" not found Jun 10 12:04:29.106766 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.106736 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:04:29.106944 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.106774 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:04:29.109710 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.109695 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 10 12:04:29.109766 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.109729 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 10 12:04:29.119837 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.119818 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 10 12:04:29.121588 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.121572 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa-original-pull-secret\") pod \"global-pull-secret-syncer-wrm7q\" (UID: \"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa\") " pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:04:29.130786 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.130765 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44fs4\" (UniqueName: \"kubernetes.io/projected/41173b40-c654-4a53-8832-ed11b931f54c-kube-api-access-44fs4\") pod \"network-check-target-4r469\" (UID: \"41173b40-c654-4a53-8832-ed11b931f54c\") " pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:04:29.300559 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.300491 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wrm7q" Jun 10 12:04:29.317967 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.317950 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-xl6cp\"" Jun 10 12:04:29.326199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.326176 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:04:29.429341 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.429305 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wrm7q"] Jun 10 12:04:29.432632 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:04:29.432599 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ae17e37_e449_4ebe_b49a_fb6cfa53dcaa.slice/crio-2cf30b13cade4a52620372ee1d0943e181a8e020000ad9b4183544093c699799 WatchSource:0}: Error finding container 2cf30b13cade4a52620372ee1d0943e181a8e020000ad9b4183544093c699799: Status 404 returned error can't find the container with id 2cf30b13cade4a52620372ee1d0943e181a8e020000ad9b4183544093c699799 Jun 10 12:04:29.450854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.450833 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-4r469"] Jun 10 12:04:29.453280 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:04:29.453255 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41173b40_c654_4a53_8832_ed11b931f54c.slice/crio-3ceca6a5fe521a43f4492cfda23ea495b3978e0c6fdd3884b4dd9b6cfa9a533e WatchSource:0}: Error finding container 3ceca6a5fe521a43f4492cfda23ea495b3978e0c6fdd3884b4dd9b6cfa9a533e: Status 404 returned error can't find the container with id 3ceca6a5fe521a43f4492cfda23ea495b3978e0c6fdd3884b4dd9b6cfa9a533e Jun 10 12:04:29.508941 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.508908 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:04:29.509045 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:29.509030 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:04:29.509103 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:04:29.509076 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:05:01.509062721 +0000 UTC m=+98.694184730 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:04:29.527049 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.527023 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrm7q" event={"ID":"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa","Type":"ContainerStarted","Data":"2cf30b13cade4a52620372ee1d0943e181a8e020000ad9b4183544093c699799"} Jun 10 12:04:29.528129 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:29.528109 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4r469" event={"ID":"41173b40-c654-4a53-8832-ed11b931f54c","Type":"ContainerStarted","Data":"3ceca6a5fe521a43f4492cfda23ea495b3978e0c6fdd3884b4dd9b6cfa9a533e"} Jun 10 12:04:34.543638 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:34.543598 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wrm7q" event={"ID":"1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa","Type":"ContainerStarted","Data":"dc7099f30b88cb9607ef144daab5e2fab1cb8ebc583edbe7fc15ce013e29c6c7"} Jun 10 12:04:34.544962 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:34.544939 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-4r469" event={"ID":"41173b40-c654-4a53-8832-ed11b931f54c","Type":"ContainerStarted","Data":"d3354461c5795c97f3efb61fc5a7b5f39b2f74380255cea01aa55af1239832c9"} Jun 10 12:04:34.545076 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:34.545061 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:04:34.558104 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:34.558068 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wrm7q" podStartSLOduration=67.038167176 podStartE2EDuration="1m11.558055881s" totalImagesPullingTime="4.519888705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:34.557701446 +0000 UTC m=+71.742823488" watchObservedRunningTime="2026-06-10 12:04:34.558055881 +0000 UTC m=+71.743177911" Jun 10 12:04:34.570787 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:04:34.570752 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-4r469" podStartSLOduration=67.075967504 podStartE2EDuration="1m11.570740923s" totalImagesPullingTime="4.494773419s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:04:34.570550782 +0000 UTC m=+71.755672812" watchObservedRunningTime="2026-06-10 12:04:34.570740923 +0000 UTC m=+71.755862948" Jun 10 12:05:01.524357 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:05:01.524306 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:05:01.524718 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:05:01.524448 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:05:01.524718 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:05:01.524520 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:05.524501785 +0000 UTC m=+162.709623795 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:05:05.550275 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:05:05.550239 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-4r469" Jun 10 12:05:33.024358 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:05:33.024311 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:05:33.024749 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:05:33.024465 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 10 12:05:33.024749 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:05:33.024543 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs podName:bcc7c99d-f825-448b-be78-6cc93f5c93df nodeName:}" failed. No retries permitted until 2026-06-10 12:07:35.024527755 +0000 UTC m=+252.209649763 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs") pod "network-metrics-daemon-ftjkg" (UID: "bcc7c99d-f825-448b-be78-6cc93f5c93df") : secret "metrics-daemon-secret" not found Jun 10 12:05:47.778211 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:05:47.778174 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:05:50.721400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:05:50.721334 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:00.682031 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:00.681977 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2wx2n" podUID="28f58d87-88fb-41e4-9ef4-31bab030a6b8" Jun 10 12:06:00.743185 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:00.743158 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wx2n" Jun 10 12:06:02.308958 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:02.308917 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-ftjkg" podUID="bcc7c99d-f825-448b-be78-6cc93f5c93df" Jun 10 12:06:05.535236 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:05.535193 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:06:05.535644 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:05.535305 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 10 12:06:05.535644 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:05.535365 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls podName:28f58d87-88fb-41e4-9ef4-31bab030a6b8 nodeName:}" failed. No retries permitted until 2026-06-10 12:08:07.535350893 +0000 UTC m=+284.720472901 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls") pod "dns-default-2wx2n" (UID: "28f58d87-88fb-41e4-9ef4-31bab030a6b8") : secret "dns-default-metrics-tls" not found Jun 10 12:06:13.237153 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.237078 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm"] Jun 10 12:06:13.238988 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.238972 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.241495 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.241477 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 10 12:06:13.242257 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.242238 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 10 12:06:13.242842 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.242826 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.242904 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.242826 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-v8w57\"" Jun 10 12:06:13.242904 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.242830 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.244688 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.244656 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6f4f846567-6kjch"] Jun 10 12:06:13.246623 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.246606 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.249090 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.249072 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jun 10 12:06:13.249201 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.249090 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jun 10 12:06:13.249201 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.249103 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.249201 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.249130 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2p9dl\"" Jun 10 12:06:13.249414 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.249398 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.249467 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.249413 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jun 10 12:06:13.249467 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.249429 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jun 10 12:06:13.252106 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.252089 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm"] Jun 10 12:06:13.262571 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.262540 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f4f846567-6kjch"] Jun 10 12:06:13.337541 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.337505 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96"] Jun 10 12:06:13.339623 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.339605 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9"] Jun 10 12:06:13.339742 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.339727 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.341474 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.341458 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:13.342141 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.342124 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 10 12:06:13.342229 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.342139 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-5nqrh\"" Jun 10 12:06:13.342229 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.342169 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.342229 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.342185 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.342396 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.342279 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 10 12:06:13.343887 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.343866 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 10 12:06:13.343989 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.343977 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 10 12:06:13.344053 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.343988 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lqg8q\"" Jun 10 12:06:13.353069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.353037 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96"] Jun 10 12:06:13.353764 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.353737 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9"] Jun 10 12:06:13.386096 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386070 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69d9b5fb-8853-48c2-b06d-213ec935c98d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.386216 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386103 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvmbx\" (UniqueName: \"kubernetes.io/projected/69d9b5fb-8853-48c2-b06d-213ec935c98d-kube-api-access-rvmbx\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.386216 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386126 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m52tg\" (UniqueName: \"kubernetes.io/projected/5c61422f-6027-41db-bf1a-5f8ff40d946e-kube-api-access-m52tg\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.386216 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386154 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-stats-auth\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.386216 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386191 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.386341 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386219 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.386341 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386240 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69d9b5fb-8853-48c2-b06d-213ec935c98d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.386341 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.386263 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-default-certificate\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.434037 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.434009 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt"] Jun 10 12:06:13.435845 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.435831 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:13.438395 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.438376 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jun 10 12:06:13.438395 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.438390 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:06:13.438540 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.438442 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jun 10 12:06:13.438657 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.438644 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xsvp5\"" Jun 10 12:06:13.446155 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.446136 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt"] Jun 10 12:06:13.479951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.479926 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:13.486987 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.486964 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-default-certificate\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.487064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.486996 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx9ht\" (UniqueName: \"kubernetes.io/projected/11f0b6bd-6a30-47e9-916d-07cf1190428b-kube-api-access-xx9ht\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.487064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487019 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11f0b6bd-6a30-47e9-916d-07cf1190428b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.487064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487037 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:13.487064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487057 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69d9b5fb-8853-48c2-b06d-213ec935c98d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.487286 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487105 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rvmbx\" (UniqueName: \"kubernetes.io/projected/69d9b5fb-8853-48c2-b06d-213ec935c98d-kube-api-access-rvmbx\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.487286 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487187 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m52tg\" (UniqueName: \"kubernetes.io/projected/5c61422f-6027-41db-bf1a-5f8ff40d946e-kube-api-access-m52tg\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.487286 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487216 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-stats-auth\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.487286 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487246 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4d0b892-d331-48b5-8a1d-126f81f4aba0-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:13.487490 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487297 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.487490 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487362 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.487490 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.487387 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 12:06:13.487490 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487414 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69d9b5fb-8853-48c2-b06d-213ec935c98d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.487490 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.487450 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11f0b6bd-6a30-47e9-916d-07cf1190428b-config\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.487490 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.487479 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:13.987460365 +0000 UTC m=+171.172582393 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : configmap references non-existent config key: service-ca.crt Jun 10 12:06:13.488079 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.488062 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:13.988038122 +0000 UTC m=+171.173160134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : secret "router-metrics-certs-default" not found Jun 10 12:06:13.488265 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.488243 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/69d9b5fb-8853-48c2-b06d-213ec935c98d-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.489501 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.489474 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/69d9b5fb-8853-48c2-b06d-213ec935c98d-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.489649 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.489633 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-default-certificate\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.489719 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.489703 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-stats-auth\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.495031 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.495006 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvmbx\" (UniqueName: \"kubernetes.io/projected/69d9b5fb-8853-48c2-b06d-213ec935c98d-kube-api-access-rvmbx\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-mnfbm\" (UID: \"69d9b5fb-8853-48c2-b06d-213ec935c98d\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.495031 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.495021 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m52tg\" (UniqueName: \"kubernetes.io/projected/5c61422f-6027-41db-bf1a-5f8ff40d946e-kube-api-access-m52tg\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.533765 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.533733 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:13.548363 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.548332 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" Jun 10 12:06:13.588523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.588496 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11f0b6bd-6a30-47e9-916d-07cf1190428b-config\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.588666 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.588531 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx9ht\" (UniqueName: \"kubernetes.io/projected/11f0b6bd-6a30-47e9-916d-07cf1190428b-kube-api-access-xx9ht\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.588666 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.588552 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11f0b6bd-6a30-47e9-916d-07cf1190428b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.588747 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.588674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:13.588747 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.588721 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vhmz\" (UniqueName: \"kubernetes.io/projected/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-kube-api-access-4vhmz\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:13.588841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.588749 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:13.588841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.588779 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4d0b892-d331-48b5-8a1d-126f81f4aba0-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:13.588841 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.588809 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 12:06:13.588943 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.588876 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert podName:a4d0b892-d331-48b5-8a1d-126f81f4aba0 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:14.08885615 +0000 UTC m=+171.273978159 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c72g9" (UID: "a4d0b892-d331-48b5-8a1d-126f81f4aba0") : secret "networking-console-plugin-cert" not found Jun 10 12:06:13.589199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.589168 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/11f0b6bd-6a30-47e9-916d-07cf1190428b-config\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.589378 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.589361 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/a4d0b892-d331-48b5-8a1d-126f81f4aba0-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:13.591008 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.590988 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/11f0b6bd-6a30-47e9-916d-07cf1190428b-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.599395 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.599344 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx9ht\" (UniqueName: \"kubernetes.io/projected/11f0b6bd-6a30-47e9-916d-07cf1190428b-kube-api-access-xx9ht\") pod \"service-ca-operator-6bc5ff68f5-4zm96\" (UID: \"11f0b6bd-6a30-47e9-916d-07cf1190428b\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.650207 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.650181 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" Jun 10 12:06:13.670520 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.670491 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm"] Jun 10 12:06:13.673732 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:13.673709 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69d9b5fb_8853_48c2_b06d_213ec935c98d.slice/crio-1f6ead284093da37bb415360c74cf37ec69f4f01fa3568b2c99181ab7c26c575 WatchSource:0}: Error finding container 1f6ead284093da37bb415360c74cf37ec69f4f01fa3568b2c99181ab7c26c575: Status 404 returned error can't find the container with id 1f6ead284093da37bb415360c74cf37ec69f4f01fa3568b2c99181ab7c26c575 Jun 10 12:06:13.689599 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.689577 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vhmz\" (UniqueName: \"kubernetes.io/projected/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-kube-api-access-4vhmz\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:13.689699 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.689607 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:13.689844 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.689831 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 12:06:13.689898 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.689889 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls podName:ff8d28ab-7712-44b0-9a0a-83b11f81b97a nodeName:}" failed. No retries permitted until 2026-06-10 12:06:14.189875262 +0000 UTC m=+171.374997275 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gskmt" (UID: "ff8d28ab-7712-44b0-9a0a-83b11f81b97a") : secret "samples-operator-tls" not found Jun 10 12:06:13.698415 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.698392 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vhmz\" (UniqueName: \"kubernetes.io/projected/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-kube-api-access-4vhmz\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:13.769945 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.769881 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96"] Jun 10 12:06:13.772635 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:13.772608 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11f0b6bd_6a30_47e9_916d_07cf1190428b.slice/crio-1a6b1542b0593b2f7e63e2456d7243b61d96039d7574a6b3bbff55bc67f62ac9 WatchSource:0}: Error finding container 1a6b1542b0593b2f7e63e2456d7243b61d96039d7574a6b3bbff55bc67f62ac9: Status 404 returned error can't find the container with id 1a6b1542b0593b2f7e63e2456d7243b61d96039d7574a6b3bbff55bc67f62ac9 Jun 10 12:06:13.774883 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.774817 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" event={"ID":"69d9b5fb-8853-48c2-b06d-213ec935c98d","Type":"ContainerStarted","Data":"1f6ead284093da37bb415360c74cf37ec69f4f01fa3568b2c99181ab7c26c575"} Jun 10 12:06:13.992476 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.992446 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.992636 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:13.992483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:13.992636 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.992594 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 12:06:13.992636 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.992596 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:14.992582665 +0000 UTC m=+172.177704678 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : configmap references non-existent config key: service-ca.crt Jun 10 12:06:13.992745 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:13.992648 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:14.992635759 +0000 UTC m=+172.177757769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : secret "router-metrics-certs-default" not found Jun 10 12:06:14.093301 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:14.093223 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:14.093419 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:14.093370 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 12:06:14.093467 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:14.093431 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert podName:a4d0b892-d331-48b5-8a1d-126f81f4aba0 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:15.093416832 +0000 UTC m=+172.278538846 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c72g9" (UID: "a4d0b892-d331-48b5-8a1d-126f81f4aba0") : secret "networking-console-plugin-cert" not found Jun 10 12:06:14.194092 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:14.194060 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:14.194221 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:14.194186 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 12:06:14.194261 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:14.194241 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls podName:ff8d28ab-7712-44b0-9a0a-83b11f81b97a nodeName:}" failed. No retries permitted until 2026-06-10 12:06:15.194223391 +0000 UTC m=+172.379345402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gskmt" (UID: "ff8d28ab-7712-44b0-9a0a-83b11f81b97a") : secret "samples-operator-tls" not found Jun 10 12:06:14.779239 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:14.779196 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" event={"ID":"11f0b6bd-6a30-47e9-916d-07cf1190428b","Type":"ContainerStarted","Data":"1a6b1542b0593b2f7e63e2456d7243b61d96039d7574a6b3bbff55bc67f62ac9"} Jun 10 12:06:15.001169 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:15.001133 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:15.001169 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:15.001174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:15.001378 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:15.001276 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 12:06:15.001378 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:15.001284 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:17.001271696 +0000 UTC m=+174.186393724 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : configmap references non-existent config key: service-ca.crt Jun 10 12:06:15.001378 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:15.001337 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:17.001324824 +0000 UTC m=+174.186446853 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : secret "router-metrics-certs-default" not found Jun 10 12:06:15.101866 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:15.101834 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:15.102015 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:15.101985 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 12:06:15.102079 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:15.102064 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert podName:a4d0b892-d331-48b5-8a1d-126f81f4aba0 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:17.102046853 +0000 UTC m=+174.287168877 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c72g9" (UID: "a4d0b892-d331-48b5-8a1d-126f81f4aba0") : secret "networking-console-plugin-cert" not found Jun 10 12:06:15.203211 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:15.202692 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 12:06:15.203211 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:15.202781 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls podName:ff8d28ab-7712-44b0-9a0a-83b11f81b97a nodeName:}" failed. No retries permitted until 2026-06-10 12:06:17.202762164 +0000 UTC m=+174.387884190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gskmt" (UID: "ff8d28ab-7712-44b0-9a0a-83b11f81b97a") : secret "samples-operator-tls" not found Jun 10 12:06:15.203211 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:15.202818 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:15.487277 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:15.487186 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:15.536209 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:15.536178 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:16.787024 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:16.786983 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" event={"ID":"69d9b5fb-8853-48c2-b06d-213ec935c98d","Type":"ContainerStarted","Data":"8a0bc190d4a504979a63e396542fd463bfec1fc54fbf80061d96fa17a50d00fd"} Jun 10 12:06:16.788495 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:16.788466 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" event={"ID":"11f0b6bd-6a30-47e9-916d-07cf1190428b","Type":"ContainerStarted","Data":"fe55d86bec1a157d9a36c1a9ab3064b692b13f46044d0675b2b2d0e9057f42b4"} Jun 10 12:06:16.803270 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:16.803223 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" podStartSLOduration=1.455037292 podStartE2EDuration="3.803203883s" totalImagesPullingTime="2.348166591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:16.801474362 +0000 UTC m=+173.986596395" watchObservedRunningTime="2026-06-10 12:06:16.803203883 +0000 UTC m=+173.988325916" Jun 10 12:06:16.816094 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:16.816052 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" podStartSLOduration=1.565614508 podStartE2EDuration="3.816038715s" totalImagesPullingTime="2.250424207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:16.815402193 +0000 UTC m=+174.000524225" watchObservedRunningTime="2026-06-10 12:06:16.816038715 +0000 UTC m=+174.001160774" Jun 10 12:06:17.019590 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.019545 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:17.019788 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.019624 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:17.019788 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:17.019698 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 12:06:17.019788 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:17.019776 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:21.019756778 +0000 UTC m=+178.204878790 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : secret "router-metrics-certs-default" not found Jun 10 12:06:17.019946 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:17.019813 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:21.019784603 +0000 UTC m=+178.204906627 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : configmap references non-existent config key: service-ca.crt Jun 10 12:06:17.120731 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.120702 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:17.120898 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:17.120873 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 12:06:17.120941 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:17.120936 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert podName:a4d0b892-d331-48b5-8a1d-126f81f4aba0 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:21.120919819 +0000 UTC m=+178.306041842 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c72g9" (UID: "a4d0b892-d331-48b5-8a1d-126f81f4aba0") : secret "networking-console-plugin-cert" not found Jun 10 12:06:17.221588 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.221546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:17.221834 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:17.221693 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 12:06:17.221834 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:17.221764 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls podName:ff8d28ab-7712-44b0-9a0a-83b11f81b97a nodeName:}" failed. No retries permitted until 2026-06-10 12:06:21.221743891 +0000 UTC m=+178.406865902 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gskmt" (UID: "ff8d28ab-7712-44b0-9a0a-83b11f81b97a") : secret "samples-operator-tls" not found Jun 10 12:06:17.288648 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.288609 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:06:17.320691 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.320623 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:17.422196 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.422121 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:17.571073 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.571042 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:17.576690 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.576665 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h"] Jun 10 12:06:17.578895 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.578876 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" Jun 10 12:06:17.581270 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.581251 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 10 12:06:17.581422 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.581406 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-tj4x4\"" Jun 10 12:06:17.581474 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.581427 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 10 12:06:17.589177 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.589156 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h"] Jun 10 12:06:17.665101 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.665067 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:17.725591 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.725497 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qfcwx\" (UniqueName: \"kubernetes.io/projected/ef24ac79-a0d8-4a67-884f-4f4e425032c9-kube-api-access-qfcwx\") pod \"migrator-955ffdf5f-t5z6h\" (UID: \"ef24ac79-a0d8-4a67-884f-4f4e425032c9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" Jun 10 12:06:17.764344 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.764315 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:17.826161 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.826129 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qfcwx\" (UniqueName: \"kubernetes.io/projected/ef24ac79-a0d8-4a67-884f-4f4e425032c9-kube-api-access-qfcwx\") pod \"migrator-955ffdf5f-t5z6h\" (UID: \"ef24ac79-a0d8-4a67-884f-4f4e425032c9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" Jun 10 12:06:17.834510 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.834478 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qfcwx\" (UniqueName: \"kubernetes.io/projected/ef24ac79-a0d8-4a67-884f-4f4e425032c9-kube-api-access-qfcwx\") pod \"migrator-955ffdf5f-t5z6h\" (UID: \"ef24ac79-a0d8-4a67-884f-4f4e425032c9\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" Jun 10 12:06:17.887768 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.887728 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" Jun 10 12:06:17.964365 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:17.964291 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:18.017453 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:18.017379 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h"] Jun 10 12:06:18.021741 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:18.021712 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef24ac79_a0d8_4a67_884f_4f4e425032c9.slice/crio-58b051815a8e5dc10776720ca7d5d6ef10e4273a5c418ce367091fdbfc81a2c0 WatchSource:0}: Error finding container 58b051815a8e5dc10776720ca7d5d6ef10e4273a5c418ce367091fdbfc81a2c0: Status 404 returned error can't find the container with id 58b051815a8e5dc10776720ca7d5d6ef10e4273a5c418ce367091fdbfc81a2c0 Jun 10 12:06:18.064967 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:18.064939 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:18.165749 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:18.165717 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:18.800765 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:18.800719 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" event={"ID":"ef24ac79-a0d8-4a67-884f-4f4e425032c9","Type":"ContainerStarted","Data":"58b051815a8e5dc10776720ca7d5d6ef10e4273a5c418ce367091fdbfc81a2c0"} Jun 10 12:06:19.726222 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:19.726132 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:19.777057 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:19.776992 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:19.805066 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:19.805035 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" event={"ID":"ef24ac79-a0d8-4a67-884f-4f4e425032c9","Type":"ContainerStarted","Data":"f32c3f4409327f9c7ba2f0b9108862444ea8b0b8f0b3f7bc97ca917ec37dc353"} Jun 10 12:06:19.805200 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:19.805086 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" event={"ID":"ef24ac79-a0d8-4a67-884f-4f4e425032c9","Type":"ContainerStarted","Data":"d3d1c7056fff0f6a93c1e03c07fa5eb32e15a005d422868e9fab1892ddf9fc41"} Jun 10 12:06:19.823211 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:19.823170 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-t5z6h" podStartSLOduration=1.371171186 podStartE2EDuration="2.823160235s" totalImagesPullingTime="1.451989049s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:19.821722013 +0000 UTC m=+177.006844043" watchObservedRunningTime="2026-06-10 12:06:19.823160235 +0000 UTC m=+177.008282266" Jun 10 12:06:19.892416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:19.892365 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:19.945931 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:19.945898 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:20.631245 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:20.631213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:20.665518 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:20.665492 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mjvb_7e496a51-4b3f-4df5-8001-ff39c586db50/dns-node-resolver/0.log" Jun 10 12:06:21.051783 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:21.051687 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:21.051783 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:21.051730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:21.052265 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:21.051884 2570 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jun 10 12:06:21.052265 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:21.051922 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:29.051906993 +0000 UTC m=+186.237029012 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : configmap references non-existent config key: service-ca.crt Jun 10 12:06:21.052265 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:21.051953 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:29.051932407 +0000 UTC m=+186.237054428 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : secret "router-metrics-certs-default" not found Jun 10 12:06:21.152172 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:21.152134 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:21.152325 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:21.152271 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 12:06:21.152365 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:21.152333 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert podName:a4d0b892-d331-48b5-8a1d-126f81f4aba0 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:29.152318928 +0000 UTC m=+186.337440940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c72g9" (UID: "a4d0b892-d331-48b5-8a1d-126f81f4aba0") : secret "networking-console-plugin-cert" not found Jun 10 12:06:21.252587 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:21.252546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:21.252766 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:21.252712 2570 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jun 10 12:06:21.252832 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:21.252780 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls podName:ff8d28ab-7712-44b0-9a0a-83b11f81b97a nodeName:}" failed. No retries permitted until 2026-06-10 12:06:29.252762746 +0000 UTC m=+186.437884777 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls") pod "cluster-samples-operator-854f8b96b6-gskmt" (UID: "ff8d28ab-7712-44b0-9a0a-83b11f81b97a") : secret "samples-operator-tls" not found Jun 10 12:06:21.664818 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:21.664771 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmrbk_4fe40800-cc65-44ed-9482-c8f9b9f7aeb5/node-ca/0.log" Jun 10 12:06:22.264788 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:22.264756 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fkp9_853bb5c4-9b76-46e2-b48e-925fbb772f20/serve-healthcheck-canary/0.log" Jun 10 12:06:22.864413 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:22.864381 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-t5z6h_ef24ac79-a0d8-4a67-884f-4f4e425032c9/migrator/0.log" Jun 10 12:06:23.065164 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:23.065135 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-t5z6h_ef24ac79-a0d8-4a67-884f-4f4e425032c9/graceful-termination/0.log" Jun 10 12:06:23.266348 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:23.266271 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mnfbm_69d9b5fb-8853-48c2-b06d-213ec935c98d/kube-storage-version-migrator-operator/0.log" Jun 10 12:06:23.485108 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:23.485074 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:23.586036 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:23.585939 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:23.688316 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:23.688286 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:23.785987 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:23.785954 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:23.893790 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:23.893741 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:24.199674 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:24.199594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:25.179300 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:25.179254 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:25.582118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:25.582031 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:25.780205 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:25.780174 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:25.980663 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:25.980627 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:26.179338 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:26.179308 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:27.179190 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:27.179158 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:27.233806 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:27.233777 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:27.379020 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:27.378990 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:27.479352 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:27.479267 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:27.786426 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:27.786323 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:27.986867 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:27.986789 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:28.382363 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:28.382302 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:28.980238 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:28.980209 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:29.114066 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.114032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:29.114254 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.114072 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:29.114254 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:29.114210 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle podName:5c61422f-6027-41db-bf1a-5f8ff40d946e nodeName:}" failed. No retries permitted until 2026-06-10 12:06:45.11419076 +0000 UTC m=+202.299312784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle") pod "router-default-6f4f846567-6kjch" (UID: "5c61422f-6027-41db-bf1a-5f8ff40d946e") : configmap references non-existent config key: service-ca.crt Jun 10 12:06:29.116575 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.116551 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c61422f-6027-41db-bf1a-5f8ff40d946e-metrics-certs\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:29.215143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.215090 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:29.215340 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:29.215242 2570 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 10 12:06:29.215340 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:29.215308 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert podName:a4d0b892-d331-48b5-8a1d-126f81f4aba0 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:45.215292647 +0000 UTC m=+202.400414659 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-c72g9" (UID: "a4d0b892-d331-48b5-8a1d-126f81f4aba0") : secret "networking-console-plugin-cert" not found Jun 10 12:06:29.316187 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.316094 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:29.318601 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.318570 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/ff8d28ab-7712-44b0-9a0a-83b11f81b97a-samples-operator-tls\") pod \"cluster-samples-operator-854f8b96b6-gskmt\" (UID: \"ff8d28ab-7712-44b0-9a0a-83b11f81b97a\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:29.347266 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.347235 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-xsvp5\"" Jun 10 12:06:29.355160 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.355138 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" Jun 10 12:06:29.482390 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.482347 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt"] Jun 10 12:06:29.580647 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.580564 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:29.824348 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.824312 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:29.837967 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.837885 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" event={"ID":"ff8d28ab-7712-44b0-9a0a-83b11f81b97a","Type":"ContainerStarted","Data":"6ab048c2ea7ea92905f9667edfa3c53c06575ea6603a815db4aae6431117d075"} Jun 10 12:06:29.983960 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:29.983932 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:30.059272 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:30.059241 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:30.179303 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:30.179272 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:30.643200 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:30.643174 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:30.981659 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:30.981581 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:31.583341 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:31.583308 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:31.844922 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:31.844885 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" event={"ID":"ff8d28ab-7712-44b0-9a0a-83b11f81b97a","Type":"ContainerStarted","Data":"639e6123dd860638412d91929898d4ab1efc8f0199ca9d60b430326777382aa8"} Jun 10 12:06:31.845480 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:31.844942 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" event={"ID":"ff8d28ab-7712-44b0-9a0a-83b11f81b97a","Type":"ContainerStarted","Data":"3c08c0eb2210c3a9c55a0c27b65e7ac1dca082737b653314d79ae164272c5264"} Jun 10 12:06:31.861624 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:31.861565 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-854f8b96b6-gskmt" podStartSLOduration=16.791044387 podStartE2EDuration="18.861544904s" totalImagesPullingTime="2.070500517s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:31.860525146 +0000 UTC m=+189.045647178" watchObservedRunningTime="2026-06-10 12:06:31.861544904 +0000 UTC m=+189.046666935" Jun 10 12:06:31.862260 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:31.862237 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:31.976851 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:31.976816 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:32.377527 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:32.377494 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:33.183155 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:33.183123 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:33.587845 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:33.587741 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:33.782250 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:33.782217 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:33.988414 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:33.988381 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:34.184644 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:34.184610 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:40.089349 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.089308 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-n5ctw"] Jun 10 12:06:40.091623 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.091605 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.095567 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.095543 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 10 12:06:40.096557 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.096536 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 10 12:06:40.096684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.096547 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 10 12:06:40.097831 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.097784 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-mkwwn\"" Jun 10 12:06:40.099148 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.099125 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 10 12:06:40.129906 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.129875 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n5ctw"] Jun 10 12:06:40.198168 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.198129 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d6c4da2-930c-4017-99cf-82613151a539-crio-socket\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.198354 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.198210 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d6c4da2-930c-4017-99cf-82613151a539-data-volume\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.198354 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.198279 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hcqc\" (UniqueName: \"kubernetes.io/projected/2d6c4da2-930c-4017-99cf-82613151a539-kube-api-access-9hcqc\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.198354 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.198305 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d6c4da2-930c-4017-99cf-82613151a539-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.198471 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.198359 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d6c4da2-930c-4017-99cf-82613151a539-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.227160 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.227128 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:40.299209 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299167 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d6c4da2-930c-4017-99cf-82613151a539-crio-socket\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.299405 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299222 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d6c4da2-930c-4017-99cf-82613151a539-data-volume\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.299405 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299318 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2d6c4da2-930c-4017-99cf-82613151a539-crio-socket\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.299405 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299336 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hcqc\" (UniqueName: \"kubernetes.io/projected/2d6c4da2-930c-4017-99cf-82613151a539-kube-api-access-9hcqc\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.299405 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d6c4da2-930c-4017-99cf-82613151a539-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.299610 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299452 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d6c4da2-930c-4017-99cf-82613151a539-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.299610 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299516 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2d6c4da2-930c-4017-99cf-82613151a539-data-volume\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.299921 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.299896 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2d6c4da2-930c-4017-99cf-82613151a539-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.301998 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.301968 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2d6c4da2-930c-4017-99cf-82613151a539-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.307760 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.307735 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:40.308632 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.308607 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hcqc\" (UniqueName: \"kubernetes.io/projected/2d6c4da2-930c-4017-99cf-82613151a539-kube-api-access-9hcqc\") pod \"insights-runtime-extractor-n5ctw\" (UID: \"2d6c4da2-930c-4017-99cf-82613151a539\") " pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.401730 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.401689 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-n5ctw" Jun 10 12:06:40.538780 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.538718 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-n5ctw"] Jun 10 12:06:40.541395 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:40.541369 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d6c4da2_930c_4017_99cf_82613151a539.slice/crio-79ded327987c09b718b91a17c7aeff49964a699d6936fcd3e41f9080820f4c63 WatchSource:0}: Error finding container 79ded327987c09b718b91a17c7aeff49964a699d6936fcd3e41f9080820f4c63: Status 404 returned error can't find the container with id 79ded327987c09b718b91a17c7aeff49964a699d6936fcd3e41f9080820f4c63 Jun 10 12:06:40.645874 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.645840 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:40.746146 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.746066 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:40.875026 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.874992 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5ctw" event={"ID":"2d6c4da2-930c-4017-99cf-82613151a539","Type":"ContainerStarted","Data":"dfaa3f486ef5643e79c3a8882ec257406d3c1605179df682c7f29d8cbbb59e4d"} Jun 10 12:06:40.875165 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:40.875044 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5ctw" event={"ID":"2d6c4da2-930c-4017-99cf-82613151a539","Type":"ContainerStarted","Data":"79ded327987c09b718b91a17c7aeff49964a699d6936fcd3e41f9080820f4c63"} Jun 10 12:06:41.879549 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:41.879515 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5ctw" event={"ID":"2d6c4da2-930c-4017-99cf-82613151a539","Type":"ContainerStarted","Data":"673e667e6b64d6c0bcc94ee1aecb42406d887877cf1c5b8f9266fe389dc190b7"} Jun 10 12:06:43.888285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:43.888242 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-n5ctw" event={"ID":"2d6c4da2-930c-4017-99cf-82613151a539","Type":"ContainerStarted","Data":"160e60f513b7bd0468b1b80625c9893244bbd06472ab8c1996c9936aa67d274f"} Jun 10 12:06:43.906691 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:43.906641 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-n5ctw" podStartSLOduration=1.431118827 podStartE2EDuration="3.906627335s" totalImagesPullingTime="2.475508508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:06:40 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:43.905120027 +0000 UTC m=+201.090242069" watchObservedRunningTime="2026-06-10 12:06:43.906627335 +0000 UTC m=+201.091749363" Jun 10 12:06:45.136551 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.136503 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:45.137140 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.137121 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5c61422f-6027-41db-bf1a-5f8ff40d946e-service-ca-bundle\") pod \"router-default-6f4f846567-6kjch\" (UID: \"5c61422f-6027-41db-bf1a-5f8ff40d946e\") " pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:45.237649 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.237604 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:45.240113 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.240080 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a4d0b892-d331-48b5-8a1d-126f81f4aba0-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-c72g9\" (UID: \"a4d0b892-d331-48b5-8a1d-126f81f4aba0\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:45.357961 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.357932 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-2p9dl\"" Jun 10 12:06:45.366110 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.366082 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:45.459081 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.459048 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lqg8q\"" Jun 10 12:06:45.466951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.466923 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" Jun 10 12:06:45.528424 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.528384 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6f4f846567-6kjch"] Jun 10 12:06:45.531534 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:45.531504 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c61422f_6027_41db_bf1a_5f8ff40d946e.slice/crio-ead5757e4259b40ac61f329305e0bc0fa60955536ab97ff4d7562dacb38514d3 WatchSource:0}: Error finding container ead5757e4259b40ac61f329305e0bc0fa60955536ab97ff4d7562dacb38514d3: Status 404 returned error can't find the container with id ead5757e4259b40ac61f329305e0bc0fa60955536ab97ff4d7562dacb38514d3 Jun 10 12:06:45.617684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.617656 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9"] Jun 10 12:06:45.620654 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:45.620628 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4d0b892_d331_48b5_8a1d_126f81f4aba0.slice/crio-f1c38ab48a32d24cb6ddc7a938ab50f70dc299292f8d318152972a27421e81ac WatchSource:0}: Error finding container f1c38ab48a32d24cb6ddc7a938ab50f70dc299292f8d318152972a27421e81ac: Status 404 returned error can't find the container with id f1c38ab48a32d24cb6ddc7a938ab50f70dc299292f8d318152972a27421e81ac Jun 10 12:06:45.895118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.895080 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" event={"ID":"a4d0b892-d331-48b5-8a1d-126f81f4aba0","Type":"ContainerStarted","Data":"f1c38ab48a32d24cb6ddc7a938ab50f70dc299292f8d318152972a27421e81ac"} Jun 10 12:06:45.896385 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.896362 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f4f846567-6kjch" event={"ID":"5c61422f-6027-41db-bf1a-5f8ff40d946e","Type":"ContainerStarted","Data":"5ef7b8b4e9c72be2d5cea44aeceeecf218a0d58ced885d64bf3b37a39844a6a4"} Jun 10 12:06:45.896491 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.896402 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6f4f846567-6kjch" event={"ID":"5c61422f-6027-41db-bf1a-5f8ff40d946e","Type":"ContainerStarted","Data":"ead5757e4259b40ac61f329305e0bc0fa60955536ab97ff4d7562dacb38514d3"} Jun 10 12:06:45.916703 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:45.916656 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6f4f846567-6kjch" podStartSLOduration=32.916642994 podStartE2EDuration="32.916642994s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:45.91526138 +0000 UTC m=+203.100383410" watchObservedRunningTime="2026-06-10 12:06:45.916642994 +0000 UTC m=+203.101765024" Jun 10 12:06:46.366483 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:46.366450 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:46.369082 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:46.369058 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:46.900283 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:46.900251 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:46.901727 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:46.901703 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6f4f846567-6kjch" Jun 10 12:06:47.705115 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.705080 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:47.804623 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.804589 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:47.873290 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.873253 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm"] Jun 10 12:06:47.875389 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.875372 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" Jun 10 12:06:47.878978 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.878958 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-dwq28\"" Jun 10 12:06:47.878978 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.878970 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jun 10 12:06:47.895548 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.895517 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm"] Jun 10 12:06:47.898555 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.898520 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:47.904590 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.904564 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" event={"ID":"a4d0b892-d331-48b5-8a1d-126f81f4aba0","Type":"ContainerStarted","Data":"86f1467c41d73844f1effbd08bed85cb30fa318e0e8244131844b84d6e6d0d4c"} Jun 10 12:06:47.927105 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.927050 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-c72g9" podStartSLOduration=33.540801728 podStartE2EDuration="34.927031388s" totalImagesPullingTime="1.38622966s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:47.925713391 +0000 UTC m=+205.110835447" watchObservedRunningTime="2026-06-10 12:06:47.927031388 +0000 UTC m=+205.112153420" Jun 10 12:06:47.959062 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:47.958878 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b5515201-6dc7-439c-aa69-e94ff6294bff-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2r2dm\" (UID: \"b5515201-6dc7-439c-aa69-e94ff6294bff\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" Jun 10 12:06:48.004596 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.004561 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:48.060235 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.060198 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b5515201-6dc7-439c-aa69-e94ff6294bff-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2r2dm\" (UID: \"b5515201-6dc7-439c-aa69-e94ff6294bff\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" Jun 10 12:06:48.062682 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.062648 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/b5515201-6dc7-439c-aa69-e94ff6294bff-tls-certificates\") pod \"prometheus-operator-admission-webhook-5b6b8f594-2r2dm\" (UID: \"b5515201-6dc7-439c-aa69-e94ff6294bff\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" Jun 10 12:06:48.103985 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.103953 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:48.166707 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.166678 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:48.184729 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.184687 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" Jun 10 12:06:48.309118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.309080 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm"] Jun 10 12:06:48.313038 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:48.313014 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5515201_6dc7_439c_aa69_e94ff6294bff.slice/crio-721e0165053fe620a1301879d4e5903ec960d693d942d393d0311607be34b4ce WatchSource:0}: Error finding container 721e0165053fe620a1301879d4e5903ec960d693d942d393d0311607be34b4ce: Status 404 returned error can't find the container with id 721e0165053fe620a1301879d4e5903ec960d693d942d393d0311607be34b4ce Jun 10 12:06:48.910152 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:48.910117 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" event={"ID":"b5515201-6dc7-439c-aa69-e94ff6294bff","Type":"ContainerStarted","Data":"721e0165053fe620a1301879d4e5903ec960d693d942d393d0311607be34b4ce"} Jun 10 12:06:49.915038 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:49.915004 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" event={"ID":"b5515201-6dc7-439c-aa69-e94ff6294bff","Type":"ContainerStarted","Data":"43b8f98f9b66da01c92ac258b04dca9dd52ea9d1c6a1806ddcf2da5524b6e367"} Jun 10 12:06:49.915498 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:49.915251 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" Jun 10 12:06:49.919742 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:49.919717 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" Jun 10 12:06:49.931528 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:49.931471 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-5b6b8f594-2r2dm" podStartSLOduration=2.053527699 podStartE2EDuration="2.931457242s" totalImagesPullingTime="877.929543ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:49.929953341 +0000 UTC m=+207.115075371" watchObservedRunningTime="2026-06-10 12:06:49.931457242 +0000 UTC m=+207.116579251" Jun 10 12:06:50.906216 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:50.906178 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:50.970520 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:50.970488 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:51.389190 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:51.389162 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:53.633966 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:53.633933 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:55.057079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.057051 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:55.308059 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.307978 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:55.345941 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.345910 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth"] Jun 10 12:06:55.350092 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.350073 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.352737 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.352709 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 10 12:06:55.352877 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.352857 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 10 12:06:55.354105 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.354078 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 10 12:06:55.354105 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.354088 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-7trvj\"" Jun 10 12:06:55.354246 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.354144 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 10 12:06:55.354246 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.354088 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 10 12:06:55.360358 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.360332 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth"] Jun 10 12:06:55.380823 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.380717 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-94jr9"] Jun 10 12:06:55.390657 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.390630 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.393426 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.393403 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 10 12:06:55.393567 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.393532 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 10 12:06:55.393567 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.393537 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-gzc2k\"" Jun 10 12:06:55.393658 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.393567 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 10 12:06:55.403245 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.403226 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:55.417814 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.417765 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-sys\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.417940 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.417832 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51792456-a057-4104-9600-469998d3c8e1-metrics-client-ca\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.417940 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.417858 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.417940 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.417888 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fs6zb\" (UniqueName: \"kubernetes.io/projected/51792456-a057-4104-9600-469998d3c8e1-kube-api-access-fs6zb\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.417940 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.417914 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51792456-a057-4104-9600-469998d3c8e1-node-exporter-textfile\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.418143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.417947 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51792456-a057-4104-9600-469998d3c8e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.418143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.418023 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-tls\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.418143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.418047 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c44e9da2-1bba-4245-8813-9f4da5abee38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.418143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.418086 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c44e9da2-1bba-4245-8813-9f4da5abee38-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.418143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.418102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bstdg\" (UniqueName: \"kubernetes.io/projected/c44e9da2-1bba-4245-8813-9f4da5abee38-kube-api-access-bstdg\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.418143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.418124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-node-exporter-wtmp\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.418143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.418141 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-root\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.418372 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.418163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c44e9da2-1bba-4245-8813-9f4da5abee38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.471717 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.471685 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:55.519445 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519414 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c44e9da2-1bba-4245-8813-9f4da5abee38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.519445 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519454 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-sys\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519475 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51792456-a057-4104-9600-469998d3c8e1-metrics-client-ca\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519495 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519516 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fs6zb\" (UniqueName: \"kubernetes.io/projected/51792456-a057-4104-9600-469998d3c8e1-kube-api-access-fs6zb\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519540 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51792456-a057-4104-9600-469998d3c8e1-node-exporter-textfile\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519543 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-sys\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519564 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51792456-a057-4104-9600-469998d3c8e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519635 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-tls\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.519704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c44e9da2-1bba-4245-8813-9f4da5abee38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519729 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c44e9da2-1bba-4245-8813-9f4da5abee38-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519756 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bstdg\" (UniqueName: \"kubernetes.io/projected/c44e9da2-1bba-4245-8813-9f4da5abee38-kube-api-access-bstdg\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519784 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-node-exporter-wtmp\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519838 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-root\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519931 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-root\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.519967 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/51792456-a057-4104-9600-469998d3c8e1-node-exporter-textfile\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:55.520060 2570 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 10 12:06:55.520133 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:55.520125 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-tls podName:51792456-a057-4104-9600-469998d3c8e1 nodeName:}" failed. No retries permitted until 2026-06-10 12:06:56.020096566 +0000 UTC m=+213.205218576 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-tls") pod "node-exporter-94jr9" (UID: "51792456-a057-4104-9600-469998d3c8e1") : secret "node-exporter-tls" not found Jun 10 12:06:55.520602 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.520186 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51792456-a057-4104-9600-469998d3c8e1-metrics-client-ca\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.520602 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.520270 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/51792456-a057-4104-9600-469998d3c8e1-node-exporter-accelerators-collector-config\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.520602 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.520493 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/51792456-a057-4104-9600-469998d3c8e1-node-exporter-wtmp\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.520721 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.520618 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c44e9da2-1bba-4245-8813-9f4da5abee38-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.522116 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.522088 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.522223 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.522132 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c44e9da2-1bba-4245-8813-9f4da5abee38-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.522567 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.522545 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c44e9da2-1bba-4245-8813-9f4da5abee38-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.528697 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.528675 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bstdg\" (UniqueName: \"kubernetes.io/projected/c44e9da2-1bba-4245-8813-9f4da5abee38-kube-api-access-bstdg\") pod \"openshift-state-metrics-65f78d5c66-mlkth\" (UID: \"c44e9da2-1bba-4245-8813-9f4da5abee38\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.528952 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.528935 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fs6zb\" (UniqueName: \"kubernetes.io/projected/51792456-a057-4104-9600-469998d3c8e1-kube-api-access-fs6zb\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:55.573428 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.573355 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:55.659284 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.659252 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" Jun 10 12:06:55.673048 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.673020 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:55.786407 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.786368 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth"] Jun 10 12:06:55.789589 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:55.789560 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc44e9da2_1bba_4245_8813_9f4da5abee38.slice/crio-d9974c6e9ac83f0b9a56366a65dcf5de905506fcc3d55ca91bbbac0a1899c933 WatchSource:0}: Error finding container d9974c6e9ac83f0b9a56366a65dcf5de905506fcc3d55ca91bbbac0a1899c933: Status 404 returned error can't find the container with id d9974c6e9ac83f0b9a56366a65dcf5de905506fcc3d55ca91bbbac0a1899c933 Jun 10 12:06:55.941758 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.941725 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" event={"ID":"c44e9da2-1bba-4245-8813-9f4da5abee38","Type":"ContainerStarted","Data":"432987ce32a51e8a03cb6a2963abc9acfa6e2e2c82c3763e3e6972f2b876dd6c"} Jun 10 12:06:55.941947 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.941835 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" event={"ID":"c44e9da2-1bba-4245-8813-9f4da5abee38","Type":"ContainerStarted","Data":"c6397c006ebc016583d80af66a594163c00ee07195969b183898d4abfa533e9e"} Jun 10 12:06:55.941947 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:55.941857 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" event={"ID":"c44e9da2-1bba-4245-8813-9f4da5abee38","Type":"ContainerStarted","Data":"d9974c6e9ac83f0b9a56366a65dcf5de905506fcc3d55ca91bbbac0a1899c933"} Jun 10 12:06:56.025598 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.025563 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-tls\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:56.028056 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.028035 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/51792456-a057-4104-9600-469998d3c8e1-node-exporter-tls\") pod \"node-exporter-94jr9\" (UID: \"51792456-a057-4104-9600-469998d3c8e1\") " pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:56.148693 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.148657 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:56.200850 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.200819 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:56.282427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.282394 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:56.299279 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.299253 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-94jr9" Jun 10 12:06:56.309431 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:56.309395 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51792456_a057_4104_9600_469998d3c8e1.slice/crio-efe8a961c445dc30a352685b984a1bb3ff7f2efae3c1b535261d6c73f7633827 WatchSource:0}: Error finding container efe8a961c445dc30a352685b984a1bb3ff7f2efae3c1b535261d6c73f7633827: Status 404 returned error can't find the container with id efe8a961c445dc30a352685b984a1bb3ff7f2efae3c1b535261d6c73f7633827 Jun 10 12:06:56.379505 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.379474 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:56.383694 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.383670 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:06:56.388242 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.388227 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.390812 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.390776 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 10 12:06:56.390952 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.390829 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 10 12:06:56.391059 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.390953 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-mm4z7\"" Jun 10 12:06:56.391059 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.391013 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 10 12:06:56.391059 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.390906 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 10 12:06:56.391059 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.390905 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 10 12:06:56.391059 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.391051 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 10 12:06:56.391285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.390851 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 10 12:06:56.391285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.390880 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 10 12:06:56.391285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.391187 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 10 12:06:56.401004 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.400955 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:06:56.429631 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.429603 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.429813 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.429693 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-web-config\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.429813 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.429767 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.429952 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.429829 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.429952 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.429896 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.429952 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.429943 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.430069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.429975 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.430069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.430017 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.430069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.430042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.430069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.430063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s4xgp\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-kube-api-access-s4xgp\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.430231 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.430112 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-out\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.430231 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.430156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.430231 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.430214 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.531704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.531668 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.531892 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.531720 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.531892 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.531751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.531892 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.531778 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532050 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:56.531903 2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 12:06:56.532050 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:56.531969 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls podName:1f2a1a36-4ffe-4e77-a186-094172b33d4f nodeName:}" failed. No retries permitted until 2026-06-10 12:06:57.031947359 +0000 UTC m=+214.217069389 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f") : secret "alertmanager-main-tls" not found Jun 10 12:06:56.532331 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532286 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532332 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s4xgp\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-kube-api-access-s4xgp\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-out\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532385 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532416 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532445 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532910 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532520 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-web-config\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532910 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532557 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532910 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.532910 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.532736 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.533998 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.533875 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.533998 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:56.533966 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle podName:1f2a1a36-4ffe-4e77-a186-094172b33d4f nodeName:}" failed. No retries permitted until 2026-06-10 12:06:57.033945256 +0000 UTC m=+214.219067280 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f") : configmap references non-existent config key: ca-bundle.crt Jun 10 12:06:56.535349 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.535303 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-volume\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.535457 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.535431 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.536745 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.536715 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.536920 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.536897 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.537667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.537644 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-web-config\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.537859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.537770 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.538008 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.537990 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-out\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.538079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.538002 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-tls-assets\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.541219 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.541169 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s4xgp\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-kube-api-access-s4xgp\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:56.946945 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:56.946909 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94jr9" event={"ID":"51792456-a057-4104-9600-469998d3c8e1","Type":"ContainerStarted","Data":"efe8a961c445dc30a352685b984a1bb3ff7f2efae3c1b535261d6c73f7633827"} Jun 10 12:06:57.037241 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.037201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:57.037408 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.037271 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:57.037408 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:57.037372 2570 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 10 12:06:57.037520 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:06:57.037461 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls podName:1f2a1a36-4ffe-4e77-a186-094172b33d4f nodeName:}" failed. No retries permitted until 2026-06-10 12:06:58.037440395 +0000 UTC m=+215.222562404 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f") : secret "alertmanager-main-tls" not found Jun 10 12:06:57.038175 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.038155 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:57.460818 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.460756 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:57.951707 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.951667 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" event={"ID":"c44e9da2-1bba-4245-8813-9f4da5abee38","Type":"ContainerStarted","Data":"d3916f713d849a5c9cd0931fec0e22aba27ce0bc2a296a7ad63ee74d921a9a43"} Jun 10 12:06:57.953127 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.953104 2570 generic.go:356] "Generic (PLEG): container finished" podID="51792456-a057-4104-9600-469998d3c8e1" containerID="d9b88137510741f3e9b597557446e31bcb2747373073316792b0c2b8e0b4ea0a" exitCode=0 Jun 10 12:06:57.953240 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.953137 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94jr9" event={"ID":"51792456-a057-4104-9600-469998d3c8e1","Type":"ContainerDied","Data":"d9b88137510741f3e9b597557446e31bcb2747373073316792b0c2b8e0b4ea0a"} Jun 10 12:06:57.968708 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:57.968627 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-mlkth" podStartSLOduration=1.296227091 podStartE2EDuration="2.96860534s" totalImagesPullingTime="1.672378249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:57.967816116 +0000 UTC m=+215.152938164" watchObservedRunningTime="2026-06-10 12:06:57.96860534 +0000 UTC m=+215.153727372" Jun 10 12:06:58.046056 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.046027 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:58.048602 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.048575 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:58.198427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.198388 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:06:58.236361 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.236332 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:58.290992 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.290956 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:58.334000 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.333965 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:06:58.337269 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:58.337243 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f2a1a36_4ffe_4e77_a186_094172b33d4f.slice/crio-2c20b1ce342613c8a0f615c419fa8d92acb50ca349c1a8632a855b3c78809740 WatchSource:0}: Error finding container 2c20b1ce342613c8a0f615c419fa8d92acb50ca349c1a8632a855b3c78809740: Status 404 returned error can't find the container with id 2c20b1ce342613c8a0f615c419fa8d92acb50ca349c1a8632a855b3c78809740 Jun 10 12:06:58.403438 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.403403 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7f996959f9-5bqr9"] Jun 10 12:06:58.407975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.407959 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.412077 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.412055 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 10 12:06:58.412195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.412054 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 10 12:06:58.412195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.412145 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 10 12:06:58.412195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.412177 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9nge7d6b3hv1s\"" Jun 10 12:06:58.412360 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.412229 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 10 12:06:58.412402 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.412371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-ppqwq\"" Jun 10 12:06:58.412458 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.412432 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 10 12:06:58.441092 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.441057 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f996959f9-5bqr9"] Jun 10 12:06:58.449025 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.448997 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.449172 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.449061 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-tls\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.449172 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.449139 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-grpc-tls\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.449268 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.449183 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.449268 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.449211 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5cg84\" (UniqueName: \"kubernetes.io/projected/68fb034e-616f-4879-a50c-65dfafd92703-kube-api-access-5cg84\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.449334 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.449303 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.449370 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.449334 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fb034e-616f-4879-a50c-65dfafd92703-metrics-client-ca\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.449370 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.449360 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.548044 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.547956 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:58.550626 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550603 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.550684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550656 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-tls\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.550779 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550764 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-grpc-tls\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.550881 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550810 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.550881 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550829 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5cg84\" (UniqueName: \"kubernetes.io/projected/68fb034e-616f-4879-a50c-65dfafd92703-kube-api-access-5cg84\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.550881 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550877 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.551027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550898 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fb034e-616f-4879-a50c-65dfafd92703-metrics-client-ca\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.551027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.550920 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.551921 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.551867 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/68fb034e-616f-4879-a50c-65dfafd92703-metrics-client-ca\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.553461 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.553429 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.553878 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.553852 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.553963 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.553878 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-tls\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.553963 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.553884 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-grpc-tls\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.554033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.554003 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.554033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.554008 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/68fb034e-616f-4879-a50c-65dfafd92703-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.559017 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.559000 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5cg84\" (UniqueName: \"kubernetes.io/projected/68fb034e-616f-4879-a50c-65dfafd92703-kube-api-access-5cg84\") pod \"thanos-querier-7f996959f9-5bqr9\" (UID: \"68fb034e-616f-4879-a50c-65dfafd92703\") " pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.671832 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.671784 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:06:58.717963 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.717929 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:06:58.869517 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.869479 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7f996959f9-5bqr9"] Jun 10 12:06:58.872974 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:06:58.872931 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68fb034e_616f_4879_a50c_65dfafd92703.slice/crio-ce21c81515d670abcc37b54980ccb81d70f1b82b8509e6f1751c54fb23d5d7c5 WatchSource:0}: Error finding container ce21c81515d670abcc37b54980ccb81d70f1b82b8509e6f1751c54fb23d5d7c5: Status 404 returned error can't find the container with id ce21c81515d670abcc37b54980ccb81d70f1b82b8509e6f1751c54fb23d5d7c5 Jun 10 12:06:58.958012 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.957972 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" event={"ID":"68fb034e-616f-4879-a50c-65dfafd92703","Type":"ContainerStarted","Data":"ce21c81515d670abcc37b54980ccb81d70f1b82b8509e6f1751c54fb23d5d7c5"} Jun 10 12:06:58.960159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.960133 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94jr9" event={"ID":"51792456-a057-4104-9600-469998d3c8e1","Type":"ContainerStarted","Data":"3a49f9c3a2c7a69b7bcd553f9a7b432a350de3611542132da39b6a757d0f834a"} Jun 10 12:06:58.960319 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.960185 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-94jr9" event={"ID":"51792456-a057-4104-9600-469998d3c8e1","Type":"ContainerStarted","Data":"206fb46251ba4032989666c07c98a532aba78f70c82bc818f2711af4ab0120d9"} Jun 10 12:06:58.961387 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.961366 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerStarted","Data":"2c20b1ce342613c8a0f615c419fa8d92acb50ca349c1a8632a855b3c78809740"} Jun 10 12:06:58.977224 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:58.977161 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-94jr9" podStartSLOduration=3.098434012 podStartE2EDuration="3.977142132s" totalImagesPullingTime="806.03649ms" totalInitContainerRuntime="72.67163ms" isStatefulPod=true podCreationTimestamp="2026-06-10 12:06:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:06:58.97699361 +0000 UTC m=+216.162115681" watchObservedRunningTime="2026-06-10 12:06:58.977142132 +0000 UTC m=+216.162264155" Jun 10 12:06:59.616033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.615993 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-576dbbfd99-sjzf4"] Jun 10 12:06:59.619676 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.619651 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.622412 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.622391 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 10 12:06:59.622538 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.622431 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-sev9moc0b0i4\"" Jun 10 12:06:59.623518 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.623482 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 10 12:06:59.623518 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.623483 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-skwd9\"" Jun 10 12:06:59.623740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.623522 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 10 12:06:59.623740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.623531 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 10 12:06:59.626971 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.626950 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-576dbbfd99-sjzf4"] Jun 10 12:06:59.661148 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.661096 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08669458-8a33-42e7-9376-d9a44fd17d6e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.661325 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.661177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-secret-metrics-server-tls\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.661325 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.661205 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/08669458-8a33-42e7-9376-d9a44fd17d6e-audit-log\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.661325 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.661245 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-secret-metrics-server-client-certs\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.661325 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.661275 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q67rj\" (UniqueName: \"kubernetes.io/projected/08669458-8a33-42e7-9376-d9a44fd17d6e-kube-api-access-q67rj\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.661475 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.661369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/08669458-8a33-42e7-9376-d9a44fd17d6e-metrics-server-audit-profiles\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.661475 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.661413 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-client-ca-bundle\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.762809 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.762757 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/08669458-8a33-42e7-9376-d9a44fd17d6e-metrics-server-audit-profiles\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.762975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.762827 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-client-ca-bundle\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.762975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.762878 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08669458-8a33-42e7-9376-d9a44fd17d6e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.762975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.762929 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-secret-metrics-server-tls\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.762975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.762951 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/08669458-8a33-42e7-9376-d9a44fd17d6e-audit-log\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.763199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.762995 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-secret-metrics-server-client-certs\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.763199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.763022 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q67rj\" (UniqueName: \"kubernetes.io/projected/08669458-8a33-42e7-9376-d9a44fd17d6e-kube-api-access-q67rj\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.763633 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.763606 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/08669458-8a33-42e7-9376-d9a44fd17d6e-audit-log\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.763931 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.763630 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/08669458-8a33-42e7-9376-d9a44fd17d6e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.763931 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.763909 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/08669458-8a33-42e7-9376-d9a44fd17d6e-metrics-server-audit-profiles\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.766030 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.766006 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-client-ca-bundle\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.766223 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.766199 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-secret-metrics-server-client-certs\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.766334 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.766314 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/08669458-8a33-42e7-9376-d9a44fd17d6e-secret-metrics-server-tls\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.771982 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.771950 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q67rj\" (UniqueName: \"kubernetes.io/projected/08669458-8a33-42e7-9376-d9a44fd17d6e-kube-api-access-q67rj\") pod \"metrics-server-576dbbfd99-sjzf4\" (UID: \"08669458-8a33-42e7-9376-d9a44fd17d6e\") " pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.932346 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.932256 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:06:59.967902 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.967785 2570 generic.go:356] "Generic (PLEG): container finished" podID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerID="a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e" exitCode=0 Jun 10 12:06:59.967902 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:06:59.967851 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e"} Jun 10 12:07:00.076908 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.076869 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc"] Jun 10 12:07:00.078760 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.078728 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:00.081518 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.081491 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.084007 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.083985 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 10 12:07:00.084109 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.083992 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rjvmj\"" Jun 10 12:07:00.088037 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.088009 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc"] Jun 10 12:07:00.095022 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.095000 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-576dbbfd99-sjzf4"] Jun 10 12:07:00.098057 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:07:00.098033 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod08669458_8a33_42e7_9376_d9a44fd17d6e.slice/crio-95af0bf436524b4d0e2a87d781cbf4486fff81cb024c39b8649a1117fc9b9707 WatchSource:0}: Error finding container 95af0bf436524b4d0e2a87d781cbf4486fff81cb024c39b8649a1117fc9b9707: Status 404 returned error can't find the container with id 95af0bf436524b4d0e2a87d781cbf4486fff81cb024c39b8649a1117fc9b9707 Jun 10 12:07:00.166659 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.166614 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27lf2\" (UniqueName: \"kubernetes.io/projected/fe5c2316-2f48-4d0f-acad-c39afabd9921-kube-api-access-27lf2\") pod \"monitoring-plugin-76b68cc874-zqxkc\" (UID: \"fe5c2316-2f48-4d0f-acad-c39afabd9921\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.166859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.166697 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe5c2316-2f48-4d0f-acad-c39afabd9921-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zqxkc\" (UID: \"fe5c2316-2f48-4d0f-acad-c39afabd9921\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.267895 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.267791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27lf2\" (UniqueName: \"kubernetes.io/projected/fe5c2316-2f48-4d0f-acad-c39afabd9921-kube-api-access-27lf2\") pod \"monitoring-plugin-76b68cc874-zqxkc\" (UID: \"fe5c2316-2f48-4d0f-acad-c39afabd9921\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.267895 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.267885 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe5c2316-2f48-4d0f-acad-c39afabd9921-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zqxkc\" (UID: \"fe5c2316-2f48-4d0f-acad-c39afabd9921\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.268086 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:07:00.268004 2570 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 10 12:07:00.268086 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:07:00.268075 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe5c2316-2f48-4d0f-acad-c39afabd9921-monitoring-plugin-cert podName:fe5c2316-2f48-4d0f-acad-c39afabd9921 nodeName:}" failed. No retries permitted until 2026-06-10 12:07:00.768055109 +0000 UTC m=+217.953177136 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/fe5c2316-2f48-4d0f-acad-c39afabd9921-monitoring-plugin-cert") pod "monitoring-plugin-76b68cc874-zqxkc" (UID: "fe5c2316-2f48-4d0f-acad-c39afabd9921") : secret "monitoring-plugin-cert" not found Jun 10 12:07:00.277041 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.277013 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27lf2\" (UniqueName: \"kubernetes.io/projected/fe5c2316-2f48-4d0f-acad-c39afabd9921-kube-api-access-27lf2\") pod \"monitoring-plugin-76b68cc874-zqxkc\" (UID: \"fe5c2316-2f48-4d0f-acad-c39afabd9921\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.381549 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.381514 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:00.772679 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.772637 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe5c2316-2f48-4d0f-acad-c39afabd9921-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zqxkc\" (UID: \"fe5c2316-2f48-4d0f-acad-c39afabd9921\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.775812 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.775761 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/fe5c2316-2f48-4d0f-acad-c39afabd9921-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-zqxkc\" (UID: \"fe5c2316-2f48-4d0f-acad-c39afabd9921\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:00.974311 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.974276 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" event={"ID":"68fb034e-616f-4879-a50c-65dfafd92703","Type":"ContainerStarted","Data":"beec61877402abae34e9cbf00ab2b7ca37fdd128aa39ad30fc4f7980b20023fe"} Jun 10 12:07:00.975698 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.975674 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" event={"ID":"08669458-8a33-42e7-9376-d9a44fd17d6e","Type":"ContainerStarted","Data":"95af0bf436524b4d0e2a87d781cbf4486fff81cb024c39b8649a1117fc9b9707"} Jun 10 12:07:00.994357 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:00.994336 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:01.140117 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.139168 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc"] Jun 10 12:07:01.142219 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:07:01.142187 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe5c2316_2f48_4d0f_acad_c39afabd9921.slice/crio-8a9849e2707c2d2a47ee5023d0f19112405ae30094778fafbfd9d43a7166cb67 WatchSource:0}: Error finding container 8a9849e2707c2d2a47ee5023d0f19112405ae30094778fafbfd9d43a7166cb67: Status 404 returned error can't find the container with id 8a9849e2707c2d2a47ee5023d0f19112405ae30094778fafbfd9d43a7166cb67 Jun 10 12:07:01.479296 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.479265 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:01.484742 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.484711 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:07:01.489282 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.489255 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.491857 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.491833 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 12:07:01.491973 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.491873 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 12:07:01.491973 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.491833 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 12:07:01.492774 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.492371 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hgxq8\"" Jun 10 12:07:01.492774 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.492399 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 12:07:01.492774 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.492413 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 12:07:01.492774 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.492630 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 12:07:01.492774 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.492719 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 12:07:01.492774 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.492734 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 12:07:01.493787 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.493486 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 12:07:01.493787 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.493499 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 12:07:01.493787 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.493672 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 12:07:01.493983 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.493897 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 12:07:01.493983 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.493974 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 12:07:01.494641 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.494602 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-amr8mjf6msmlf\"" Jun 10 12:07:01.496170 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.496116 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 12:07:01.504007 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.503986 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:07:01.579947 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.579915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.579947 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.579953 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkg7b\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-kube-api-access-mkg7b\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.579977 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580037 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580088 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580142 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-config-out\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580164 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-web-config\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580195 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580217 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580241 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580280 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580324 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580355 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580399 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580423 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580504 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580547 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-config\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580587 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580616 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.580701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.580646 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682045 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-config\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682088 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682113 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682139 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682171 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682192 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkg7b\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-kube-api-access-mkg7b\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682212 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.682406 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682238 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682786 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682880 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-config-out\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682912 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-web-config\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682944 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.682976 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683003 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683035 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683086 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683117 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683175 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683201 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683234 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683545 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683087 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.684002 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683881 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.686027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.685933 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.686197 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.683116 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.686262 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.686245 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.686728 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.686701 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.687144 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.687119 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-config\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.687516 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.687493 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.687956 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.687931 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.688045 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.687962 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.688045 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.687979 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.688603 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.688426 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.688603 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.688558 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-config-out\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.688745 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.688680 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-web-config\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.688831 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.688773 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.689611 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.689588 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.690556 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.690513 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.690771 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.690750 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.691054 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.691028 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkg7b\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-kube-api-access-mkg7b\") pod \"prometheus-k8s-0\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.802425 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.802387 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:01.984052 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.983854 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" event={"ID":"68fb034e-616f-4879-a50c-65dfafd92703","Type":"ContainerStarted","Data":"14a884deaf687a381aa64a90854daa7c2fa8be2bef69a09dd33c745d3af001a6"} Jun 10 12:07:01.984052 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.983945 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" event={"ID":"68fb034e-616f-4879-a50c-65dfafd92703","Type":"ContainerStarted","Data":"d4b9120868037ec8b51b779eeffebf5f5b5a8bca8bb92bc71a9c40805999828e"} Jun 10 12:07:01.985301 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:01.985234 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" event={"ID":"fe5c2316-2f48-4d0f-acad-c39afabd9921","Type":"ContainerStarted","Data":"8a9849e2707c2d2a47ee5023d0f19112405ae30094778fafbfd9d43a7166cb67"} Jun 10 12:07:03.085889 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.085850 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:07:03.089240 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:07:03.089173 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb293709b_e697_488e_8609_6bdc7f93e145.slice/crio-23bc1c5720759e0354557392c02d288778fd428549b47cabdefe1947f918172b WatchSource:0}: Error finding container 23bc1c5720759e0354557392c02d288778fd428549b47cabdefe1947f918172b: Status 404 returned error can't find the container with id 23bc1c5720759e0354557392c02d288778fd428549b47cabdefe1947f918172b Jun 10 12:07:03.997154 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.997118 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerStarted","Data":"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df"} Jun 10 12:07:03.997329 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.997182 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerStarted","Data":"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895"} Jun 10 12:07:03.997329 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.997213 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerStarted","Data":"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21"} Jun 10 12:07:03.997329 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.997250 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerStarted","Data":"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d"} Jun 10 12:07:03.997329 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.997277 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerStarted","Data":"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b"} Jun 10 12:07:03.997329 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.997306 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerStarted","Data":"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d"} Jun 10 12:07:03.998611 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.998589 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" event={"ID":"fe5c2316-2f48-4d0f-acad-c39afabd9921","Type":"ContainerStarted","Data":"c8c8cfc906e3ae26e5a520f780905c079583ffae6989a43c53db7b623964ad3d"} Jun 10 12:07:03.998755 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:03.998736 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:04.001597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.001571 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" event={"ID":"68fb034e-616f-4879-a50c-65dfafd92703","Type":"ContainerStarted","Data":"d16c270a803f83e6b547b3597228e8729ad9ae772b7f6d44700d12dcaccb02c3"} Jun 10 12:07:04.001715 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.001623 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" event={"ID":"68fb034e-616f-4879-a50c-65dfafd92703","Type":"ContainerStarted","Data":"84bafd2682d04d7667fc585581c6e6b9b3b3fecb48c2743c54ab106616174f20"} Jun 10 12:07:04.001715 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.001654 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" event={"ID":"68fb034e-616f-4879-a50c-65dfafd92703","Type":"ContainerStarted","Data":"618a719a1cf5a4cc07616afa7b5e1ed69a4a0af2c2d1fe74b7fec99c11335619"} Jun 10 12:07:04.001858 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.001710 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:07:04.003264 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.003241 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" event={"ID":"08669458-8a33-42e7-9376-d9a44fd17d6e","Type":"ContainerStarted","Data":"c0f2377883c000320264c67bcc592ddd41be3fdc1ebbd39a582e763b3d259c95"} Jun 10 12:07:04.004201 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.004185 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" Jun 10 12:07:04.004750 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.004726 2570 generic.go:356] "Generic (PLEG): container finished" podID="b293709b-e697-488e-8609-6bdc7f93e145" containerID="de75ded67e9c4d114f608cc62184dc77120796c604e42137f5442f8716ca7b1e" exitCode=0 Jun 10 12:07:04.004840 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.004787 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"de75ded67e9c4d114f608cc62184dc77120796c604e42137f5442f8716ca7b1e"} Jun 10 12:07:04.004879 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.004845 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerStarted","Data":"23bc1c5720759e0354557392c02d288778fd428549b47cabdefe1947f918172b"} Jun 10 12:07:04.023454 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.023408 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.153570159 podStartE2EDuration="8.023395659s" totalImagesPullingTime="3.854007885s" totalInitContainerRuntime="15.817615ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:04.021957886 +0000 UTC m=+221.207079952" watchObservedRunningTime="2026-06-10 12:07:04.023395659 +0000 UTC m=+221.208517690" Jun 10 12:07:04.039709 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.039664 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" podStartSLOduration=2.220715454 podStartE2EDuration="5.03964933s" totalImagesPullingTime="2.818933876s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:04.038876107 +0000 UTC m=+221.223998139" watchObservedRunningTime="2026-06-10 12:07:04.03964933 +0000 UTC m=+221.224771361" Jun 10 12:07:04.057111 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.057067 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-zqxkc" podStartSLOduration=2.241142274 podStartE2EDuration="4.057052793s" totalImagesPullingTime="1.815910519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:04.056220685 +0000 UTC m=+221.241342744" watchObservedRunningTime="2026-06-10 12:07:04.057052793 +0000 UTC m=+221.242174824" Jun 10 12:07:04.078507 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:04.078462 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" podStartSLOduration=2.253528201 podStartE2EDuration="6.078450332s" totalImagesPullingTime="3.824922131s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:06:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:04.077115192 +0000 UTC m=+221.262237224" watchObservedRunningTime="2026-06-10 12:07:04.078450332 +0000 UTC m=+221.263572362" Jun 10 12:07:08.026780 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:08.026748 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerStarted","Data":"f3c468f4ecf9b6820612c2c49812f64af30eaf21912182622f97710ac0840add"} Jun 10 12:07:09.033411 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:09.033379 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerStarted","Data":"47fde0fc785496195db45381dddecf3e7525db34c0b3991a13dcc974138d9ad1"} Jun 10 12:07:09.033826 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:09.033472 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerStarted","Data":"37aefa5642cad3c5b5be1a8386c4a843510afc55647334266d2543f7123f82bd"} Jun 10 12:07:09.033826 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:09.033503 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerStarted","Data":"c557dc556f8f3b5791c1c10751786572332f094dbdfd29dc1c791ef7b1849edb"} Jun 10 12:07:09.033826 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:09.033529 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerStarted","Data":"07a889d06e180f1d1e6906e6619dcf056c9bcd9f2d58bf64ab83e1a8f01e6ef8"} Jun 10 12:07:09.033826 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:09.033552 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerStarted","Data":"7f05dfb66cc9b940f2bd794a356b01ede519d297729ba75793e6e9e8c2fc1228"} Jun 10 12:07:09.063647 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:09.063590 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.087068356 podStartE2EDuration="8.063574017s" totalImagesPullingTime="3.947643846s" totalInitContainerRuntime="28.861815ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:07:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:09.060936786 +0000 UTC m=+226.246058828" watchObservedRunningTime="2026-06-10 12:07:09.063574017 +0000 UTC m=+226.248696047" Jun 10 12:07:10.015367 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:10.015341 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7f996959f9-5bqr9" Jun 10 12:07:10.748694 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:10.748658 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:10.844362 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:10.844323 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:10.942790 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:10.942751 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:11.043369 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:11.043279 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:11.386090 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:11.386057 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:11.486657 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:11.486626 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:11.802817 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:11.802705 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:07:12.604182 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:12.604150 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:12.708240 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:12.708204 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:12.805270 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:12.805238 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:12.905464 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:12.905385 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:13.427030 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:13.426997 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:16.110379 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:16.110346 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:16.161928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:16.161892 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:18.493472 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:18.493437 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:19.932780 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:19.932731 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:07:19.933187 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:19.932823 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:07:24.823403 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:24.823374 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:24.923432 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:24.923402 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:25.633367 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:25.633338 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:25.684662 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:25.684636 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:28.631402 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:28.631371 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:28.688332 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:28.688305 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:32.128358 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:32.128323 2570 generic.go:356] "Generic (PLEG): container finished" podID="11f0b6bd-6a30-47e9-916d-07cf1190428b" containerID="fe55d86bec1a157d9a36c1a9ab3064b692b13f46044d0675b2b2d0e9057f42b4" exitCode=0 Jun 10 12:07:32.128773 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:32.128369 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" event={"ID":"11f0b6bd-6a30-47e9-916d-07cf1190428b","Type":"ContainerDied","Data":"fe55d86bec1a157d9a36c1a9ab3064b692b13f46044d0675b2b2d0e9057f42b4"} Jun 10 12:07:32.128773 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:32.128693 2570 scope.go:117] "RemoveContainer" containerID="fe55d86bec1a157d9a36c1a9ab3064b692b13f46044d0675b2b2d0e9057f42b4" Jun 10 12:07:32.222833 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:32.222777 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:33.133505 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:33.133470 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-4zm96" event={"ID":"11f0b6bd-6a30-47e9-916d-07cf1190428b","Type":"ContainerStarted","Data":"13643f242dba3a6232c4825d524b68ab3b2b334a7b9581fbbfb4c4d256bb3e96"} Jun 10 12:07:35.091332 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:35.091295 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:07:35.093759 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:35.093735 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/bcc7c99d-f825-448b-be78-6cc93f5c93df-metrics-certs\") pod \"network-metrics-daemon-ftjkg\" (UID: \"bcc7c99d-f825-448b-be78-6cc93f5c93df\") " pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:07:35.293655 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:35.293628 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-bjlvn\"" Jun 10 12:07:35.299959 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:35.299941 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ftjkg" Jun 10 12:07:35.462308 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:35.462222 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ftjkg"] Jun 10 12:07:35.464949 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:07:35.464926 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcc7c99d_f825_448b_be78_6cc93f5c93df.slice/crio-c3cbc844d64a389888ea932bedea24f13c8bc34fbb5199f03072f92bb0825c64 WatchSource:0}: Error finding container c3cbc844d64a389888ea932bedea24f13c8bc34fbb5199f03072f92bb0825c64: Status 404 returned error can't find the container with id c3cbc844d64a389888ea932bedea24f13c8bc34fbb5199f03072f92bb0825c64 Jun 10 12:07:36.147127 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:36.147092 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ftjkg" event={"ID":"bcc7c99d-f825-448b-be78-6cc93f5c93df","Type":"ContainerStarted","Data":"c3cbc844d64a389888ea932bedea24f13c8bc34fbb5199f03072f92bb0825c64"} Jun 10 12:07:37.152658 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:37.152622 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ftjkg" event={"ID":"bcc7c99d-f825-448b-be78-6cc93f5c93df","Type":"ContainerStarted","Data":"cc8af68218905cb03f29f0b32bca2e21065ec6b9263d3d9c1bdfe11efe239298"} Jun 10 12:07:37.153034 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:37.152675 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ftjkg" event={"ID":"bcc7c99d-f825-448b-be78-6cc93f5c93df","Type":"ContainerStarted","Data":"84d34d81bea9d7e8b7f603f91e13e6b62cd0fea14f66068da1b5b1d065e0b757"} Jun 10 12:07:37.167945 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:37.167896 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ftjkg" podStartSLOduration=253.283946125 podStartE2EDuration="4m14.167877188s" totalImagesPullingTime="883.931063ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:07:37.167506775 +0000 UTC m=+254.352628806" watchObservedRunningTime="2026-06-10 12:07:37.167877188 +0000 UTC m=+254.352999220" Jun 10 12:07:37.248547 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:37.248514 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:37.303676 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:37.303627 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:38.415783 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:38.415754 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:39.938278 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:39.938248 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:07:39.943772 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:39.943747 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-576dbbfd99-sjzf4" Jun 10 12:07:40.932926 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:40.932828 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:41.033893 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:41.033856 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:42.174008 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:42.173972 2570 generic.go:356] "Generic (PLEG): container finished" podID="69d9b5fb-8853-48c2-b06d-213ec935c98d" containerID="8a0bc190d4a504979a63e396542fd463bfec1fc54fbf80061d96fa17a50d00fd" exitCode=0 Jun 10 12:07:42.174388 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:42.174047 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" event={"ID":"69d9b5fb-8853-48c2-b06d-213ec935c98d","Type":"ContainerDied","Data":"8a0bc190d4a504979a63e396542fd463bfec1fc54fbf80061d96fa17a50d00fd"} Jun 10 12:07:42.174430 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:42.174406 2570 scope.go:117] "RemoveContainer" containerID="8a0bc190d4a504979a63e396542fd463bfec1fc54fbf80061d96fa17a50d00fd" Jun 10 12:07:43.180126 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:43.180095 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-mnfbm" event={"ID":"69d9b5fb-8853-48c2-b06d-213ec935c98d","Type":"ContainerStarted","Data":"ae67af41a5f15670c36d1dd8423e9c868ef4831b7519dd9165ecb9895b4f8478"} Jun 10 12:07:47.975615 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:47.975579 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:48.038086 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:48.038032 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:50.508861 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:50.508828 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f2a1a36-4ffe-4e77-a186-094172b33d4f/init-config-reloader/0.log" Jun 10 12:07:50.708849 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:50.708822 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f2a1a36-4ffe-4e77-a186-094172b33d4f/alertmanager/0.log" Jun 10 12:07:50.908868 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:50.908847 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f2a1a36-4ffe-4e77-a186-094172b33d4f/config-reloader/0.log" Jun 10 12:07:51.108429 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:51.108401 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f2a1a36-4ffe-4e77-a186-094172b33d4f/kube-rbac-proxy-web/0.log" Jun 10 12:07:51.308935 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:51.308862 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f2a1a36-4ffe-4e77-a186-094172b33d4f/kube-rbac-proxy/0.log" Jun 10 12:07:51.508726 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:51.508700 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f2a1a36-4ffe-4e77-a186-094172b33d4f/kube-rbac-proxy-metric/0.log" Jun 10 12:07:51.709637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:51.709614 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_1f2a1a36-4ffe-4e77-a186-094172b33d4f/prom-label-proxy/0.log" Jun 10 12:07:52.709357 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:52.709332 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-576dbbfd99-sjzf4_08669458-8a33-42e7-9376-d9a44fd17d6e/metrics-server/0.log" Jun 10 12:07:52.908940 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:52.908913 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-zqxkc_fe5c2316-2f48-4d0f-acad-c39afabd9921/monitoring-plugin/0.log" Jun 10 12:07:53.708639 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:53.708610 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94jr9_51792456-a057-4104-9600-469998d3c8e1/init-textfile/0.log" Jun 10 12:07:53.908475 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:53.908452 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94jr9_51792456-a057-4104-9600-469998d3c8e1/node-exporter/0.log" Jun 10 12:07:54.108411 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:54.108366 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94jr9_51792456-a057-4104-9600-469998d3c8e1/kube-rbac-proxy/0.log" Jun 10 12:07:54.909444 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:54.909367 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mlkth_c44e9da2-1bba-4245-8813-9f4da5abee38/kube-rbac-proxy-main/0.log" Jun 10 12:07:55.108530 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:55.108462 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mlkth_c44e9da2-1bba-4245-8813-9f4da5abee38/kube-rbac-proxy-self/0.log" Jun 10 12:07:55.308962 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:55.308842 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mlkth_c44e9da2-1bba-4245-8813-9f4da5abee38/openshift-state-metrics/0.log" Jun 10 12:07:55.508385 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:55.508358 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b293709b-e697-488e-8609-6bdc7f93e145/init-config-reloader/0.log" Jun 10 12:07:55.710366 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:55.710342 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b293709b-e697-488e-8609-6bdc7f93e145/prometheus/0.log" Jun 10 12:07:55.908357 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:55.908329 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b293709b-e697-488e-8609-6bdc7f93e145/config-reloader/0.log" Jun 10 12:07:56.108992 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:56.108964 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b293709b-e697-488e-8609-6bdc7f93e145/thanos-sidecar/0.log" Jun 10 12:07:56.309480 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:56.309452 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b293709b-e697-488e-8609-6bdc7f93e145/kube-rbac-proxy-web/0.log" Jun 10 12:07:56.508841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:56.508744 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b293709b-e697-488e-8609-6bdc7f93e145/kube-rbac-proxy/0.log" Jun 10 12:07:56.709512 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:56.709484 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_b293709b-e697-488e-8609-6bdc7f93e145/kube-rbac-proxy-thanos/0.log" Jun 10 12:07:57.308054 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:57.308022 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-2r2dm_b5515201-6dc7-439c-aa69-e94ff6294bff/prometheus-operator-admission-webhook/0.log" Jun 10 12:07:57.415316 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:57.415284 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:07:58.110134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:58.110106 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/thanos-query/0.log" Jun 10 12:07:58.309811 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:58.309779 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy-web/0.log" Jun 10 12:07:58.510322 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:58.510243 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy/0.log" Jun 10 12:07:58.709667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:58.709635 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/prom-label-proxy/0.log" Jun 10 12:07:58.909508 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:58.909482 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy-rules/0.log" Jun 10 12:07:59.109951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:59.109921 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy-metrics/0.log" Jun 10 12:07:59.309427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:07:59.309353 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-c72g9_a4d0b892-d331-48b5-8a1d-126f81f4aba0/networking-console-plugin/0.log" Jun 10 12:08:01.803239 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:01.803155 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:01.820602 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:01.820577 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:01.911357 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:01.911334 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mjvb_7e496a51-4b3f-4df5-8001-ff39c586db50/dns-node-resolver/0.log" Jun 10 12:08:02.275259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:02.275232 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:03.110453 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:03.110427 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmrbk_4fe40800-cc65-44ed-9482-c8f9b9f7aeb5/node-ca/0.log" Jun 10 12:08:03.510171 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:03.510107 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f4f846567-6kjch_5c61422f-6027-41db-bf1a-5f8ff40d946e/router/0.log" Jun 10 12:08:03.709025 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:03.709000 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fkp9_853bb5c4-9b76-46e2-b48e-925fbb772f20/serve-healthcheck-canary/0.log" Jun 10 12:08:03.743544 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:03.743510 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-2wx2n" podUID="28f58d87-88fb-41e4-9ef4-31bab030a6b8" Jun 10 12:08:04.267740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:04.267710 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wx2n" Jun 10 12:08:05.792120 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:05.792009 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:07.035502 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.035428 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:07.133097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.133055 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:07.185240 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.185209 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:07.562712 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.562676 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:08:07.565126 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.565096 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/28f58d87-88fb-41e4-9ef4-31bab030a6b8-metrics-tls\") pod \"dns-default-2wx2n\" (UID: \"28f58d87-88fb-41e4-9ef4-31bab030a6b8\") " pod="openshift-dns/dns-default-2wx2n" Jun 10 12:08:07.571514 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.571488 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xc76w\"" Jun 10 12:08:07.579840 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.579818 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-2wx2n" Jun 10 12:08:07.750152 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:07.750123 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-2wx2n"] Jun 10 12:08:07.752048 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:08:07.752015 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f58d87_88fb_41e4_9ef4_31bab030a6b8.slice/crio-94b75f3bbb49728142a1782b647037b04d384bae418ee4416e0117c8e968e171 WatchSource:0}: Error finding container 94b75f3bbb49728142a1782b647037b04d384bae418ee4416e0117c8e968e171: Status 404 returned error can't find the container with id 94b75f3bbb49728142a1782b647037b04d384bae418ee4416e0117c8e968e171 Jun 10 12:08:08.291611 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:08.291571 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wx2n" event={"ID":"28f58d87-88fb-41e4-9ef4-31bab030a6b8","Type":"ContainerStarted","Data":"94b75f3bbb49728142a1782b647037b04d384bae418ee4416e0117c8e968e171"} Jun 10 12:08:08.952969 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:08.952918 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:09.000107 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:09.000074 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:09.222066 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:09.221975 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:09.270628 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:09.270594 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:09.898706 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:09.898668 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:09.999778 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:09.999748 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:10.052352 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:10.052323 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:10.302906 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:10.302837 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wx2n" event={"ID":"28f58d87-88fb-41e4-9ef4-31bab030a6b8","Type":"ContainerStarted","Data":"67c4da195378591f29700b10bb29fb746e68eabb1c40b1ee579fc62d0107c8d1"} Jun 10 12:08:10.302906 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:10.302891 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-2wx2n" event={"ID":"28f58d87-88fb-41e4-9ef4-31bab030a6b8","Type":"ContainerStarted","Data":"460af6bce11d1101ccad9c749eeb3762e13363716d5a2bae32848e8c044e6a02"} Jun 10 12:08:10.303066 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:10.302920 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-2wx2n" Jun 10 12:08:10.322697 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:10.322662 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-2wx2n" podStartSLOduration=251.621696191 podStartE2EDuration="4m13.322648605s" totalImagesPullingTime="1.700952414s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:03:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:10.321040255 +0000 UTC m=+287.506162286" watchObservedRunningTime="2026-06-10 12:08:10.322648605 +0000 UTC m=+287.507770635" Jun 10 12:08:10.374610 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:10.374582 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:11.374400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:11.374370 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:11.475168 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:11.475143 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:12.886166 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:12.886133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:12.935100 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:12.935070 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:15.022462 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.022425 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:15.070268 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.070238 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:15.645056 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.645021 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:08:15.645308 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.645286 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="alertmanager" containerID="cri-o://4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d" gracePeriod=120 Jun 10 12:08:15.645387 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.645359 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-metric" containerID="cri-o://0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895" gracePeriod=120 Jun 10 12:08:15.645452 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.645399 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-web" containerID="cri-o://b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d" gracePeriod=120 Jun 10 12:08:15.645452 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.645431 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="config-reloader" containerID="cri-o://d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b" gracePeriod=120 Jun 10 12:08:15.645562 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.645466 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="prom-label-proxy" containerID="cri-o://dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df" gracePeriod=120 Jun 10 12:08:15.645562 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:15.645483 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy" containerID="cri-o://729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21" gracePeriod=120 Jun 10 12:08:16.333829 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.333780 2570 generic.go:356] "Generic (PLEG): container finished" podID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerID="dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df" exitCode=0 Jun 10 12:08:16.333829 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.333824 2570 generic.go:356] "Generic (PLEG): container finished" podID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerID="729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21" exitCode=0 Jun 10 12:08:16.333829 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.333830 2570 generic.go:356] "Generic (PLEG): container finished" podID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerID="d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b" exitCode=0 Jun 10 12:08:16.333829 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.333836 2570 generic.go:356] "Generic (PLEG): container finished" podID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerID="4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d" exitCode=0 Jun 10 12:08:16.334318 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.333863 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df"} Jun 10 12:08:16.334318 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.333949 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21"} Jun 10 12:08:16.334318 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.333976 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b"} Jun 10 12:08:16.334318 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.334001 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d"} Jun 10 12:08:16.892396 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.892373 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:16.940125 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940095 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-main-db\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940252 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940137 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-metrics-client-ca\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940252 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940165 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-tls-assets\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940252 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940190 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940252 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940220 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940262 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-metric\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940297 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-web-config\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940319 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-out\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940342 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940415 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-volume\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940442 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s4xgp\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-kube-api-access-s4xgp\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940442 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:08:16.940489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940475 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-web\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940502 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-cluster-tls-config\") pod \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\" (UID: \"1f2a1a36-4ffe-4e77-a186-094172b33d4f\") " Jun 10 12:08:16.940928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940504 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:16.940928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940764 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-main-db\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:16.940928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940782 2570 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-metrics-client-ca\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:16.940928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.940867 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:16.943875 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.943761 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-volume" (OuterVolumeSpecName: "config-volume") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:16.944400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.944085 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-out" (OuterVolumeSpecName: "config-out") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:08:16.944400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.944143 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:16.944400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.944164 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:16.944400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.944350 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-kube-api-access-s4xgp" (OuterVolumeSpecName: "kube-api-access-s4xgp") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "kube-api-access-s4xgp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:16.944652 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.944534 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:16.946488 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.946459 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:16.946593 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.946577 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:16.948639 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.948612 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:16.956454 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:16.956401 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-web-config" (OuterVolumeSpecName: "web-config") pod "1f2a1a36-4ffe-4e77-a186-094172b33d4f" (UID: "1f2a1a36-4ffe-4e77-a186-094172b33d4f"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:17.042097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042053 2570 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-volume\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042080 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s4xgp\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-kube-api-access-s4xgp\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042092 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042102 2570 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-cluster-tls-config\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042110 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/1f2a1a36-4ffe-4e77-a186-094172b33d4f-tls-assets\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042119 2570 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f2a1a36-4ffe-4e77-a186-094172b33d4f-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042127 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-main-tls\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042136 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042150 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-web-config\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042160 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/1f2a1a36-4ffe-4e77-a186-094172b33d4f-config-out\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.042489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.042168 2570 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/1f2a1a36-4ffe-4e77-a186-094172b33d4f-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:17.340478 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.340439 2570 generic.go:356] "Generic (PLEG): container finished" podID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerID="0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895" exitCode=0 Jun 10 12:08:17.340478 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.340467 2570 generic.go:356] "Generic (PLEG): container finished" podID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerID="b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d" exitCode=0 Jun 10 12:08:17.340907 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.340518 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 10 12:08:17.340907 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.340518 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895"} Jun 10 12:08:17.340907 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.340586 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d"} Jun 10 12:08:17.340907 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.340615 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"1f2a1a36-4ffe-4e77-a186-094172b33d4f","Type":"ContainerDied","Data":"2c20b1ce342613c8a0f615c419fa8d92acb50ca349c1a8632a855b3c78809740"} Jun 10 12:08:17.340907 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.340654 2570 scope.go:117] "RemoveContainer" containerID="dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df" Jun 10 12:08:17.348644 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.348622 2570 scope.go:117] "RemoveContainer" containerID="0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895" Jun 10 12:08:17.356199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.356180 2570 scope.go:117] "RemoveContainer" containerID="729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21" Jun 10 12:08:17.360774 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.360753 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:08:17.363622 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.363601 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 10 12:08:17.364686 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.364671 2570 scope.go:117] "RemoveContainer" containerID="b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d" Jun 10 12:08:17.371303 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.371284 2570 scope.go:117] "RemoveContainer" containerID="d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b" Jun 10 12:08:17.378134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.378110 2570 scope.go:117] "RemoveContainer" containerID="4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d" Jun 10 12:08:17.385316 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.385293 2570 scope.go:117] "RemoveContainer" containerID="a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e" Jun 10 12:08:17.392066 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.392052 2570 scope.go:117] "RemoveContainer" containerID="dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df" Jun 10 12:08:17.392337 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:17.392316 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df\": container with ID starting with dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df not found: ID does not exist" containerID="dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df" Jun 10 12:08:17.392400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.392347 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df"} err="failed to get container status \"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df\": rpc error: code = NotFound desc = could not find container \"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df\": container with ID starting with dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df not found: ID does not exist" Jun 10 12:08:17.392400 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.392381 2570 scope.go:117] "RemoveContainer" containerID="0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895" Jun 10 12:08:17.392600 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:17.392580 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895\": container with ID starting with 0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895 not found: ID does not exist" containerID="0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895" Jun 10 12:08:17.392644 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.392604 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895"} err="failed to get container status \"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895\": rpc error: code = NotFound desc = could not find container \"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895\": container with ID starting with 0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895 not found: ID does not exist" Jun 10 12:08:17.392644 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.392618 2570 scope.go:117] "RemoveContainer" containerID="729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21" Jun 10 12:08:17.392812 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:17.392784 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21\": container with ID starting with 729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21 not found: ID does not exist" containerID="729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21" Jun 10 12:08:17.392855 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.392816 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21"} err="failed to get container status \"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21\": rpc error: code = NotFound desc = could not find container \"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21\": container with ID starting with 729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21 not found: ID does not exist" Jun 10 12:08:17.392855 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.392828 2570 scope.go:117] "RemoveContainer" containerID="b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d" Jun 10 12:08:17.393019 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:17.393003 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d\": container with ID starting with b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d not found: ID does not exist" containerID="b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d" Jun 10 12:08:17.393054 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393021 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d"} err="failed to get container status \"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d\": rpc error: code = NotFound desc = could not find container \"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d\": container with ID starting with b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d not found: ID does not exist" Jun 10 12:08:17.393054 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393033 2570 scope.go:117] "RemoveContainer" containerID="d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b" Jun 10 12:08:17.393271 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:17.393252 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b\": container with ID starting with d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b not found: ID does not exist" containerID="d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b" Jun 10 12:08:17.393310 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393279 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b"} err="failed to get container status \"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b\": rpc error: code = NotFound desc = could not find container \"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b\": container with ID starting with d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b not found: ID does not exist" Jun 10 12:08:17.393310 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393293 2570 scope.go:117] "RemoveContainer" containerID="4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d" Jun 10 12:08:17.393507 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:17.393490 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d\": container with ID starting with 4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d not found: ID does not exist" containerID="4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d" Jun 10 12:08:17.393556 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393512 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d"} err="failed to get container status \"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d\": rpc error: code = NotFound desc = could not find container \"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d\": container with ID starting with 4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d not found: ID does not exist" Jun 10 12:08:17.393556 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393523 2570 scope.go:117] "RemoveContainer" containerID="a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e" Jun 10 12:08:17.393748 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:08:17.393732 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e\": container with ID starting with a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e not found: ID does not exist" containerID="a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e" Jun 10 12:08:17.393790 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393752 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e"} err="failed to get container status \"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e\": rpc error: code = NotFound desc = could not find container \"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e\": container with ID starting with a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e not found: ID does not exist" Jun 10 12:08:17.393790 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.393766 2570 scope.go:117] "RemoveContainer" containerID="dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df" Jun 10 12:08:17.394061 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394044 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df"} err="failed to get container status \"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df\": rpc error: code = NotFound desc = could not find container \"dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df\": container with ID starting with dc1aa01e8313de7c1c9319a2b24e290c70b2ed083a37487231b15c2f0972e0df not found: ID does not exist" Jun 10 12:08:17.394061 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394060 2570 scope.go:117] "RemoveContainer" containerID="0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895" Jun 10 12:08:17.394299 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394281 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895"} err="failed to get container status \"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895\": rpc error: code = NotFound desc = could not find container \"0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895\": container with ID starting with 0d54a19a988f01050345c107d99f60e4e82acbf8777c0923968c91f7f30db895 not found: ID does not exist" Jun 10 12:08:17.394342 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394299 2570 scope.go:117] "RemoveContainer" containerID="729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21" Jun 10 12:08:17.394514 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394495 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21"} err="failed to get container status \"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21\": rpc error: code = NotFound desc = could not find container \"729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21\": container with ID starting with 729469dc8c8847683c670a7fe09ca05c118d0ceccf0a1add86b5766e751c8d21 not found: ID does not exist" Jun 10 12:08:17.394561 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394513 2570 scope.go:117] "RemoveContainer" containerID="b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d" Jun 10 12:08:17.394741 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394722 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d"} err="failed to get container status \"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d\": rpc error: code = NotFound desc = could not find container \"b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d\": container with ID starting with b4dd4720b45707db1c094e8542482e3b96eb444504e6f261cb71b322dc1a375d not found: ID does not exist" Jun 10 12:08:17.394779 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394743 2570 scope.go:117] "RemoveContainer" containerID="d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b" Jun 10 12:08:17.394991 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394971 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b"} err="failed to get container status \"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b\": rpc error: code = NotFound desc = could not find container \"d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b\": container with ID starting with d1f9e35e54f63d6d18b0fbe8738f7cafb33cbf28ba0e034c974c50b6e8bbea2b not found: ID does not exist" Jun 10 12:08:17.394991 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.394991 2570 scope.go:117] "RemoveContainer" containerID="4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d" Jun 10 12:08:17.395198 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.395183 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d"} err="failed to get container status \"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d\": rpc error: code = NotFound desc = could not find container \"4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d\": container with ID starting with 4a3dff911cbc3dac6db1437bde7386491c5c13afae0b82c75736199a9a4cb07d not found: ID does not exist" Jun 10 12:08:17.395238 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.395199 2570 scope.go:117] "RemoveContainer" containerID="a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e" Jun 10 12:08:17.395407 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.395391 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e"} err="failed to get container status \"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e\": rpc error: code = NotFound desc = could not find container \"a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e\": container with ID starting with a4e2fc2ba1976ecbc4aa6d76fcb387f0e70046642b9f30fedc2453b17049035e not found: ID does not exist" Jun 10 12:08:17.626485 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.626455 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:17.677689 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:17.677667 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:19.292815 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:19.292760 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" path="/var/lib/kubelet/pods/1f2a1a36-4ffe-4e77-a186-094172b33d4f/volumes" Jun 10 12:08:20.173281 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.173245 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:08:20.173544 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.173508 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="prometheus" containerID="cri-o://f3c468f4ecf9b6820612c2c49812f64af30eaf21912182622f97710ac0840add" gracePeriod=600 Jun 10 12:08:20.173544 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.173533 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-thanos" containerID="cri-o://47fde0fc785496195db45381dddecf3e7525db34c0b3991a13dcc974138d9ad1" gracePeriod=600 Jun 10 12:08:20.173700 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.173563 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="config-reloader" containerID="cri-o://7f05dfb66cc9b940f2bd794a356b01ede519d297729ba75793e6e9e8c2fc1228" gracePeriod=600 Jun 10 12:08:20.173700 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.173564 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="thanos-sidecar" containerID="cri-o://07a889d06e180f1d1e6906e6619dcf056c9bcd9f2d58bf64ab83e1a8f01e6ef8" gracePeriod=600 Jun 10 12:08:20.173700 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.173576 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-web" containerID="cri-o://c557dc556f8f3b5791c1c10751786572332f094dbdfd29dc1c791ef7b1849edb" gracePeriod=600 Jun 10 12:08:20.173700 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.173516 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy" containerID="cri-o://37aefa5642cad3c5b5be1a8386c4a843510afc55647334266d2543f7123f82bd" gracePeriod=600 Jun 10 12:08:20.308598 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.308571 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-2wx2n" Jun 10 12:08:20.359140 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359114 2570 generic.go:356] "Generic (PLEG): container finished" podID="b293709b-e697-488e-8609-6bdc7f93e145" containerID="47fde0fc785496195db45381dddecf3e7525db34c0b3991a13dcc974138d9ad1" exitCode=0 Jun 10 12:08:20.359140 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359136 2570 generic.go:356] "Generic (PLEG): container finished" podID="b293709b-e697-488e-8609-6bdc7f93e145" containerID="37aefa5642cad3c5b5be1a8386c4a843510afc55647334266d2543f7123f82bd" exitCode=0 Jun 10 12:08:20.359140 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359144 2570 generic.go:356] "Generic (PLEG): container finished" podID="b293709b-e697-488e-8609-6bdc7f93e145" containerID="07a889d06e180f1d1e6906e6619dcf056c9bcd9f2d58bf64ab83e1a8f01e6ef8" exitCode=0 Jun 10 12:08:20.359427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359152 2570 generic.go:356] "Generic (PLEG): container finished" podID="b293709b-e697-488e-8609-6bdc7f93e145" containerID="7f05dfb66cc9b940f2bd794a356b01ede519d297729ba75793e6e9e8c2fc1228" exitCode=0 Jun 10 12:08:20.359427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359160 2570 generic.go:356] "Generic (PLEG): container finished" podID="b293709b-e697-488e-8609-6bdc7f93e145" containerID="f3c468f4ecf9b6820612c2c49812f64af30eaf21912182622f97710ac0840add" exitCode=0 Jun 10 12:08:20.359427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359202 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"47fde0fc785496195db45381dddecf3e7525db34c0b3991a13dcc974138d9ad1"} Jun 10 12:08:20.359427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359281 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"37aefa5642cad3c5b5be1a8386c4a843510afc55647334266d2543f7123f82bd"} Jun 10 12:08:20.359427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359311 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"07a889d06e180f1d1e6906e6619dcf056c9bcd9f2d58bf64ab83e1a8f01e6ef8"} Jun 10 12:08:20.359427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359335 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"7f05dfb66cc9b940f2bd794a356b01ede519d297729ba75793e6e9e8c2fc1228"} Jun 10 12:08:20.359427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:20.359365 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"f3c468f4ecf9b6820612c2c49812f64af30eaf21912182622f97710ac0840add"} Jun 10 12:08:21.373411 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.373380 2570 generic.go:356] "Generic (PLEG): container finished" podID="b293709b-e697-488e-8609-6bdc7f93e145" containerID="c557dc556f8f3b5791c1c10751786572332f094dbdfd29dc1c791ef7b1849edb" exitCode=0 Jun 10 12:08:21.373755 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.373448 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"c557dc556f8f3b5791c1c10751786572332f094dbdfd29dc1c791ef7b1849edb"} Jun 10 12:08:21.426569 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.426538 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:21.477957 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.477925 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkg7b\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-kube-api-access-mkg7b\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478122 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.477969 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-web-config\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478122 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.477998 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-kube-rbac-proxy\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478122 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478039 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-2\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478122 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478065 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-kubelet-serving-ca-bundle\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478122 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478090 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-tls\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478122 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478120 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-db\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478162 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-1\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478186 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-metrics-client-ca\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478213 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-0\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478237 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-serving-certs-ca-bundle\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478269 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478294 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-thanos-prometheus-http-client-file\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478331 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-trusted-ca-bundle\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478383 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-metrics-client-certs\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478425 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.478889 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478633 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:21.478947 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478892 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:21.479003 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478943 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-grpc-tls\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.479003 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478970 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:21.479003 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.478979 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-config\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.479209 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.479008 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-tls-assets\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.479209 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.479038 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-config-out\") pod \"b293709b-e697-488e-8609-6bdc7f93e145\" (UID: \"b293709b-e697-488e-8609-6bdc7f93e145\") " Jun 10 12:08:21.479324 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.479303 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.479631 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.479606 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.479733 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.479636 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-metrics-client-ca\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.479733 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.479688 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:21.480790 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.480748 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:08:21.481061 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.480877 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:21.481151 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.481130 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:21.481654 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.481616 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:08:21.482772 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.482744 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.484048 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.483934 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-config-out" (OuterVolumeSpecName: "config-out") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:08:21.484048 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.483978 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.484048 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.484021 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-kube-api-access-mkg7b" (OuterVolumeSpecName: "kube-api-access-mkg7b") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "kube-api-access-mkg7b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:21.484260 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.484184 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.484324 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.484269 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.484382 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.484322 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.484739 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.484714 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.485181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.485151 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:08:21.485474 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.485451 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-config" (OuterVolumeSpecName: "config") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.485640 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.485621 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.495162 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.495141 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-web-config" (OuterVolumeSpecName: "web-config") pod "b293709b-e697-488e-8609-6bdc7f93e145" (UID: "b293709b-e697-488e-8609-6bdc7f93e145"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:08:21.580706 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580670 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.580706 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580694 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-tls\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.580706 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580704 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-db\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.580706 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580712 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580722 2570 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580731 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580739 2570 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-thanos-prometheus-http-client-file\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580747 2570 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b293709b-e697-488e-8609-6bdc7f93e145-prometheus-trusted-ca-bundle\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580755 2570 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-metrics-client-certs\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580763 2570 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580772 2570 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-grpc-tls\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580780 2570 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-config\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580787 2570 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-tls-assets\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580808 2570 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/b293709b-e697-488e-8609-6bdc7f93e145-config-out\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580815 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkg7b\" (UniqueName: \"kubernetes.io/projected/b293709b-e697-488e-8609-6bdc7f93e145-kube-api-access-mkg7b\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580823 2570 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-web-config\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:21.581033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:21.580832 2570 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/b293709b-e697-488e-8609-6bdc7f93e145-secret-kube-rbac-proxy\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:08:22.380410 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.380367 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"b293709b-e697-488e-8609-6bdc7f93e145","Type":"ContainerDied","Data":"23bc1c5720759e0354557392c02d288778fd428549b47cabdefe1947f918172b"} Jun 10 12:08:22.380410 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.380392 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.380928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.380452 2570 scope.go:117] "RemoveContainer" containerID="47fde0fc785496195db45381dddecf3e7525db34c0b3991a13dcc974138d9ad1" Jun 10 12:08:22.388691 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.388670 2570 scope.go:117] "RemoveContainer" containerID="37aefa5642cad3c5b5be1a8386c4a843510afc55647334266d2543f7123f82bd" Jun 10 12:08:22.395991 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.395974 2570 scope.go:117] "RemoveContainer" containerID="c557dc556f8f3b5791c1c10751786572332f094dbdfd29dc1c791ef7b1849edb" Jun 10 12:08:22.404007 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.403989 2570 scope.go:117] "RemoveContainer" containerID="07a889d06e180f1d1e6906e6619dcf056c9bcd9f2d58bf64ab83e1a8f01e6ef8" Jun 10 12:08:22.404259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.404241 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:08:22.409501 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.409478 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:08:22.411652 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.411635 2570 scope.go:117] "RemoveContainer" containerID="7f05dfb66cc9b940f2bd794a356b01ede519d297729ba75793e6e9e8c2fc1228" Jun 10 12:08:22.418330 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.418314 2570 scope.go:117] "RemoveContainer" containerID="f3c468f4ecf9b6820612c2c49812f64af30eaf21912182622f97710ac0840add" Jun 10 12:08:22.425461 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.425440 2570 scope.go:117] "RemoveContainer" containerID="de75ded67e9c4d114f608cc62184dc77120796c604e42137f5442f8716ca7b1e" Jun 10 12:08:22.434666 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434647 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:08:22.434944 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434931 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="alertmanager" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434945 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="alertmanager" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434954 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-metric" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434960 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-metric" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434967 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="thanos-sidecar" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434972 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="thanos-sidecar" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434982 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="config-reloader" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434987 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="config-reloader" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434993 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="prom-label-proxy" Jun 10 12:08:22.434996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.434999 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="prom-label-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435006 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="config-reloader" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435013 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="config-reloader" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435021 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="init-config-reloader" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435026 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="init-config-reloader" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435036 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-web" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435044 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-web" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435055 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="init-config-reloader" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435063 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="init-config-reloader" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435074 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-web" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435082 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-web" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435091 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435098 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435107 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-thanos" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435115 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-thanos" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435133 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="prometheus" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435138 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="prometheus" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435146 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435151 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435205 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="prometheus" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435212 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435220 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="config-reloader" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435225 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="alertmanager" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435230 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435236 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-thanos" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435241 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="kube-rbac-proxy-web" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435246 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-metric" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435251 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="thanos-sidecar" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435257 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="prom-label-proxy" Jun 10 12:08:22.435248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435262 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b293709b-e697-488e-8609-6bdc7f93e145" containerName="config-reloader" Jun 10 12:08:22.436025 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.435267 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f2a1a36-4ffe-4e77-a186-094172b33d4f" containerName="kube-rbac-proxy-web" Jun 10 12:08:22.440068 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.440052 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.442851 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.442831 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 10 12:08:22.443009 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.442915 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-amr8mjf6msmlf\"" Jun 10 12:08:22.443009 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.442972 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 10 12:08:22.443009 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443027 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 10 12:08:22.443300 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443139 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 10 12:08:22.443300 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443244 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 10 12:08:22.443300 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443246 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 10 12:08:22.443439 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443319 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-hgxq8\"" Jun 10 12:08:22.443439 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443408 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 10 12:08:22.443439 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443419 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 10 12:08:22.443995 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.443972 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 10 12:08:22.444092 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.444070 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 10 12:08:22.444316 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.444296 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 10 12:08:22.444388 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.444307 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 10 12:08:22.446873 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.446853 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 10 12:08:22.449582 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.449564 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 10 12:08:22.454367 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.454349 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:08:22.486755 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486733 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.486877 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486772 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.486877 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486819 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.486877 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486854 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.486978 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486910 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.486978 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486930 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.486978 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486945 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.486978 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486963 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487120 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.486982 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487120 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487120 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487064 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487120 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487079 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487120 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487095 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487122 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487136 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487173 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-npssn\" (UniqueName: \"kubernetes.io/projected/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-kube-api-access-npssn\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487207 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487275 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487317 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-config\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.487356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.487349 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588557 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588496 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588557 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588528 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588557 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588548 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588746 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588571 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588746 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588597 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588746 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588730 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588999 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588788 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588999 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588871 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588999 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588921 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588999 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588949 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588999 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588966 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.588999 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.588975 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589030 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589089 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589131 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589178 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-npssn\" (UniqueName: \"kubernetes.io/projected/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-kube-api-access-npssn\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589288 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589262 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589293 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-config\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589307 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589356 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589860 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589829 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.589930 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.589861 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.590724 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.590693 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.591307 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.591040 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.593201 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.593164 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-config\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.593850 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.593779 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.593961 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.593862 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.594060 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.594035 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.594170 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.594113 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.594642 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.594462 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.594730 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.594646 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.594873 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.594833 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.594942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.594888 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.594986 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.594965 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-config-out\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.595174 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.595157 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.596267 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.596247 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-web-config\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.598923 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.598897 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-npssn\" (UniqueName: \"kubernetes.io/projected/5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b-kube-api-access-npssn\") pod \"prometheus-k8s-0\" (UID: \"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.750755 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.750721 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:22.894153 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:22.894124 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 10 12:08:22.896457 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:08:22.896433 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5d4794c5_dfd9_4b5f_bdfa_fc9f83a7049b.slice/crio-83ec9ce6b25273d2a69570bf09359651f83275e6c953416ce75f9e366ccffe87 WatchSource:0}: Error finding container 83ec9ce6b25273d2a69570bf09359651f83275e6c953416ce75f9e366ccffe87: Status 404 returned error can't find the container with id 83ec9ce6b25273d2a69570bf09359651f83275e6c953416ce75f9e366ccffe87 Jun 10 12:08:23.248438 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:23.248415 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:08:23.248678 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:23.248663 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:08:23.251549 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:23.251531 2570 kubelet.go:1648] "Image garbage collection succeeded" Jun 10 12:08:23.293833 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:23.293712 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b293709b-e697-488e-8609-6bdc7f93e145" path="/var/lib/kubelet/pods/b293709b-e697-488e-8609-6bdc7f93e145/volumes" Jun 10 12:08:23.385904 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:23.385870 2570 generic.go:356] "Generic (PLEG): container finished" podID="5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b" containerID="445dc3746024e9d1d05f319f3cb3c9b3802df9ed5ce1d2e4cde487d2a44ab655" exitCode=0 Jun 10 12:08:23.386230 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:23.385961 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerDied","Data":"445dc3746024e9d1d05f319f3cb3c9b3802df9ed5ce1d2e4cde487d2a44ab655"} Jun 10 12:08:23.386230 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:23.386019 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerStarted","Data":"83ec9ce6b25273d2a69570bf09359651f83275e6c953416ce75f9e366ccffe87"} Jun 10 12:08:24.068505 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.068429 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:24.169790 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.169757 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:24.271361 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.271332 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:24.393056 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.393029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerStarted","Data":"dc89217ead262b4e43edcfa14dd98ccf727de359baf12e94fcb37df475a5120e"} Jun 10 12:08:24.393449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.393098 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerStarted","Data":"b565922c90a051b1e12a79d6351a7a1a759396df6f2ddd454c70dffc93e870ab"} Jun 10 12:08:24.393449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.393150 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerStarted","Data":"c0a10891f64a9ad43923f4f3110778ceae465c76616b3bc350f4f77c89596f89"} Jun 10 12:08:24.393449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.393195 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerStarted","Data":"c9f50e437e05ac2dbab90e6f03923a51db8533234f343c13316fb61c70d00294"} Jun 10 12:08:24.393449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.393232 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerStarted","Data":"2297dae462df97e668ed828b389ec822a8299164c81d28adca690ab25da42eff"} Jun 10 12:08:24.393449 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.393302 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b","Type":"ContainerStarted","Data":"e9c526ea50125f263b7fc79aa6da31240fc1b76d6f4a950538798e879edb599d"} Jun 10 12:08:24.420958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:24.420917 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.398109149 podStartE2EDuration="2.420904426s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.795277ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:08:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:08:24.419534651 +0000 UTC m=+301.604656703" watchObservedRunningTime="2026-06-10 12:08:24.420904426 +0000 UTC m=+301.606026457" Jun 10 12:08:25.644007 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:25.643975 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:25.701481 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:25.701455 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:27.751337 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:27.751308 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:08:29.426990 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:29.426951 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:29.475522 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:29.475488 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:38.432306 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:38.432271 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:38.481023 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:38.480994 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:40.637142 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:40.637106 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:40.689495 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:40.689463 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:55.655217 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:55.655179 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:08:55.706106 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:08:55.706081 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:09:16.502255 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:09:16.502175 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:09:18.503205 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:09:18.503171 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:09:18.554813 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:09:18.554774 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:09:22.750925 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:09:22.750894 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:09:22.766710 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:09:22.766688 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:09:23.639740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:09:23.639713 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 10 12:11:49.187664 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:11:49.187633 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:11:49.242095 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:11:49.242066 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:11:51.314244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:11:51.314216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:11:51.415394 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:11:51.415362 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:11:59.010820 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:11:59.010760 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:12:10.668574 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:12:10.668542 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:12:10.755494 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:12:10.755406 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:12:10.809109 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:12:10.809082 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:08.355637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:08.355609 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:09.513757 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:09.513719 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:23.272938 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:23.272907 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:13:23.273655 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:23.273637 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:13:34.905114 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:34.905075 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:35.709993 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:35.709959 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:38.526514 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:38.526480 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:38.628097 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:38.628071 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:40.398164 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:40.398135 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:40.495023 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:40.494988 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:40.677070 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:40.676998 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:40.808683 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:40.808601 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:43.685418 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:43.685388 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:44.283370 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:44.283335 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:45.312859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:45.312779 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:45.370759 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:45.370732 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:52.084457 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:52.084424 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:56.936929 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:56.936896 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:57.032504 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:57.032476 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:57.296317 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:57.296236 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:13:57.347075 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:13:57.347046 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:03.024583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:03.024545 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:03.127574 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:03.127541 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:05.250831 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:05.250783 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:16.537861 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:16.537829 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:16.658285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:16.658256 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.143414 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.143382 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.302286 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.302250 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.418178 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.418093 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.490292 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.490263 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb"] Jun 10 12:14:17.494014 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.493992 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.499407 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.499386 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 10 12:14:17.499711 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.499685 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 10 12:14:17.499834 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.499685 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 10 12:14:17.499834 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.499750 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x7ndf\"" Jun 10 12:14:17.500025 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.500012 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 10 12:14:17.511584 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.511561 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb"] Jun 10 12:14:17.529676 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.529648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.529827 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.529700 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-tmp\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.529827 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.529738 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqcq4\" (UniqueName: \"kubernetes.io/projected/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-kube-api-access-wqcq4\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.529827 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.529773 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-manifests\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.529970 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.529872 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.604627 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.604602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.630847 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.630819 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.630943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.630866 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-tmp\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.630943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.630902 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqcq4\" (UniqueName: \"kubernetes.io/projected/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-kube-api-access-wqcq4\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.630943 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.630934 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-manifests\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.631105 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.630988 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.631356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.631328 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-manifests\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.633201 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.633181 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-tmp\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.633337 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.633315 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.633477 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.633462 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-webhook-cert\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.642880 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.642861 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqcq4\" (UniqueName: \"kubernetes.io/projected/211b17bb-0cdb-465c-9ace-7a2bbc27e1b6-kube-api-access-wqcq4\") pod \"opendatahub-operator-controller-manager-999b5c76b-nz6tb\" (UID: \"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6\") " pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.704870 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.704749 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.804092 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.804061 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:17.807428 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.807051 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.908169 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.908140 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:17.939140 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.939113 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb"] Jun 10 12:14:17.942843 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:14:17.942817 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod211b17bb_0cdb_465c_9ace_7a2bbc27e1b6.slice/crio-0292b0c25211054f65d889a6e581c00db557615a0f1b7aba466a397226de1c84 WatchSource:0}: Error finding container 0292b0c25211054f65d889a6e581c00db557615a0f1b7aba466a397226de1c84: Status 404 returned error can't find the container with id 0292b0c25211054f65d889a6e581c00db557615a0f1b7aba466a397226de1c84 Jun 10 12:14:17.944420 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:17.944403 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:14:18.012517 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:18.012465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:18.108238 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:18.108214 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:18.232169 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:18.232143 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:18.770960 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:18.770921 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" event={"ID":"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6","Type":"ContainerStarted","Data":"0292b0c25211054f65d889a6e581c00db557615a0f1b7aba466a397226de1c84"} Jun 10 12:14:21.787482 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:21.787445 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" event={"ID":"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6","Type":"ContainerStarted","Data":"0b3985f9ecb62187c8594731646d474d9aeacb0d1649974b0ac9c636667a2312"} Jun 10 12:14:22.793538 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:22.793504 2570 generic.go:356] "Generic (PLEG): container finished" podID="211b17bb-0cdb-465c-9ace-7a2bbc27e1b6" containerID="0b3985f9ecb62187c8594731646d474d9aeacb0d1649974b0ac9c636667a2312" exitCode=0 Jun 10 12:14:22.793946 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:22.793559 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" event={"ID":"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6","Type":"ContainerDied","Data":"0b3985f9ecb62187c8594731646d474d9aeacb0d1649974b0ac9c636667a2312"} Jun 10 12:14:23.799227 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:23.799190 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" event={"ID":"211b17bb-0cdb-465c-9ace-7a2bbc27e1b6","Type":"ContainerStarted","Data":"c72722f2658278a605870ac01047e6895ee3c2356e5d3927b9293350925049eb"} Jun 10 12:14:23.799702 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:23.799262 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:23.822868 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:23.822822 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" podStartSLOduration=2.313814796 podStartE2EDuration="6.82278871s" totalImagesPullingTime="3.599356585s" totalInitContainerRuntime="909.617329ms" isStatefulPod=false podCreationTimestamp="2026-06-10 12:14:17 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:14:23.820858099 +0000 UTC m=+661.005980131" watchObservedRunningTime="2026-06-10 12:14:23.82278871 +0000 UTC m=+661.007910741" Jun 10 12:14:34.805866 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:34.805833 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-999b5c76b-nz6tb" Jun 10 12:14:36.858159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:36.858123 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:37.015678 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.015653 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:37.137304 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.137235 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7"] Jun 10 12:14:37.147175 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.147148 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.151145 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.151119 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 10 12:14:37.151243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.151151 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 10 12:14:37.151243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.151156 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 10 12:14:37.151243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.151150 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-rhc64\"" Jun 10 12:14:37.151243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.151162 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 10 12:14:37.151243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.151224 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 10 12:14:37.157133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.157110 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:37.166074 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.166055 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7"] Jun 10 12:14:37.189118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.189091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bfc3868-173c-460e-850f-32a7d08493ff-metrics-cert\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.189220 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.189124 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bfc3868-173c-460e-850f-32a7d08493ff-cert\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.189220 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.189163 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7bfc3868-173c-460e-850f-32a7d08493ff-manager-config\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.189322 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.189231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zcn9s\" (UniqueName: \"kubernetes.io/projected/7bfc3868-173c-460e-850f-32a7d08493ff-kube-api-access-zcn9s\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.289653 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.289623 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zcn9s\" (UniqueName: \"kubernetes.io/projected/7bfc3868-173c-460e-850f-32a7d08493ff-kube-api-access-zcn9s\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.289841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.289708 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bfc3868-173c-460e-850f-32a7d08493ff-metrics-cert\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.289841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.289726 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bfc3868-173c-460e-850f-32a7d08493ff-cert\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.289841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.289751 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7bfc3868-173c-460e-850f-32a7d08493ff-manager-config\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.290362 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.290343 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7bfc3868-173c-460e-850f-32a7d08493ff-manager-config\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.292285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.292258 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7bfc3868-173c-460e-850f-32a7d08493ff-metrics-cert\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.292676 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.292660 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7bfc3868-173c-460e-850f-32a7d08493ff-cert\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.316442 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.316410 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:37.323066 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.323047 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zcn9s\" (UniqueName: \"kubernetes.io/projected/7bfc3868-173c-460e-850f-32a7d08493ff-kube-api-access-zcn9s\") pod \"lws-controller-manager-dcc5f6999-8qvv7\" (UID: \"7bfc3868-173c-460e-850f-32a7d08493ff\") " pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.456637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.456568 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:37.521416 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.521387 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:37.588424 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.588395 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr"] Jun 10 12:14:37.591069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.591017 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.593942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.593920 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 10 12:14:37.593942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.593937 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-g5bwt\"" Jun 10 12:14:37.594078 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.593937 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 10 12:14:37.601918 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.601896 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7"] Jun 10 12:14:37.604853 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:14:37.604830 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7bfc3868_173c_460e_850f_32a7d08493ff.slice/crio-d498d3e845449d5ace60cd74417c1507e95e67008534b3475d2a6c683182f67b WatchSource:0}: Error finding container d498d3e845449d5ace60cd74417c1507e95e67008534b3475d2a6c683182f67b: Status 404 returned error can't find the container with id d498d3e845449d5ace60cd74417c1507e95e67008534b3475d2a6c683182f67b Jun 10 12:14:37.626169 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.626143 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr"] Jun 10 12:14:37.692330 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.692303 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bd77963-03a0-459a-94a0-8f2a609dd0cf-tls-certs\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.692460 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.692352 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bzbh\" (UniqueName: \"kubernetes.io/projected/3bd77963-03a0-459a-94a0-8f2a609dd0cf-kube-api-access-6bzbh\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.692460 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.692383 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bd77963-03a0-459a-94a0-8f2a609dd0cf-tmp\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.793455 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.793378 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bd77963-03a0-459a-94a0-8f2a609dd0cf-tls-certs\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.793455 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.793427 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bzbh\" (UniqueName: \"kubernetes.io/projected/3bd77963-03a0-459a-94a0-8f2a609dd0cf-kube-api-access-6bzbh\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.793455 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.793448 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bd77963-03a0-459a-94a0-8f2a609dd0cf-tmp\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.795720 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.795688 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3bd77963-03a0-459a-94a0-8f2a609dd0cf-tmp\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.795848 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.795832 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3bd77963-03a0-459a-94a0-8f2a609dd0cf-tls-certs\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.804603 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.804581 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bzbh\" (UniqueName: \"kubernetes.io/projected/3bd77963-03a0-459a-94a0-8f2a609dd0cf-kube-api-access-6bzbh\") pod \"kube-auth-proxy-5c8bf6cd9c-pthgr\" (UID: \"3bd77963-03a0-459a-94a0-8f2a609dd0cf\") " pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.813305 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.813287 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:37.859301 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.859272 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" event={"ID":"7bfc3868-173c-460e-850f-32a7d08493ff","Type":"ContainerStarted","Data":"d498d3e845449d5ace60cd74417c1507e95e67008534b3475d2a6c683182f67b"} Jun 10 12:14:37.901675 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.901652 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" Jun 10 12:14:37.913164 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:37.913135 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:38.030014 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:38.029963 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:38.059185 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:38.059164 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr"] Jun 10 12:14:38.061211 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:14:38.061184 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd77963_03a0_459a_94a0_8f2a609dd0cf.slice/crio-aef7c49d784948d1551409d5408a77309bee14c0f582b72f792f1d0346dd3269 WatchSource:0}: Error finding container aef7c49d784948d1551409d5408a77309bee14c0f582b72f792f1d0346dd3269: Status 404 returned error can't find the container with id aef7c49d784948d1551409d5408a77309bee14c0f582b72f792f1d0346dd3269 Jun 10 12:14:38.219728 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:38.219693 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:38.311976 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:38.311909 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:38.763134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:38.763102 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:38.866117 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:38.866078 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" event={"ID":"3bd77963-03a0-459a-94a0-8f2a609dd0cf","Type":"ContainerStarted","Data":"aef7c49d784948d1551409d5408a77309bee14c0f582b72f792f1d0346dd3269"} Jun 10 12:14:39.229046 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:39.229014 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:40.012703 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:40.012673 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:40.065819 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:40.065764 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:42.888649 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:42.888610 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" event={"ID":"7bfc3868-173c-460e-850f-32a7d08493ff","Type":"ContainerStarted","Data":"0e1b7a3c595e28a6c10c6422e7f3847154c5b353815aefd580818fb762559a0e"} Jun 10 12:14:42.889067 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:42.888745 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:42.890170 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:42.890143 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" event={"ID":"3bd77963-03a0-459a-94a0-8f2a609dd0cf","Type":"ContainerStarted","Data":"e9d165b032905b5be78dd33c70829c4428aafc813786daf434f088dfacf67cc3"} Jun 10 12:14:42.906301 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:42.906262 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" podStartSLOduration=1.267197867 podStartE2EDuration="5.906251449s" totalImagesPullingTime="4.639053582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:14:42.906080635 +0000 UTC m=+680.091202690" watchObservedRunningTime="2026-06-10 12:14:42.906251449 +0000 UTC m=+680.091373479" Jun 10 12:14:42.923700 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:42.923658 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-5c8bf6cd9c-pthgr" podStartSLOduration=1.71322002 podStartE2EDuration="5.923645429s" totalImagesPullingTime="4.210425409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:14:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:14:42.921743207 +0000 UTC m=+680.106865257" watchObservedRunningTime="2026-06-10 12:14:42.923645429 +0000 UTC m=+680.108767491" Jun 10 12:14:47.385327 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:47.385292 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:47.472451 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:47.472420 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:47.537883 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:47.537845 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:47.700787 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:47.700706 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:48.652562 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:48.652537 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:48.753369 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:48.753339 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:50.246083 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:50.246049 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:50.309773 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:50.309736 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:50.735747 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:50.735714 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:50.887635 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:50.887604 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:52.326521 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:52.326494 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:52.445585 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:52.445555 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:52.582600 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:52.582512 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:53.169542 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:53.169512 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:53.257964 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:53.257937 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:14:53.896569 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:53.896539 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dcc5f6999-8qvv7" Jun 10 12:14:54.732562 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:14:54.732521 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:03.120535 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:03.120502 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:03.223073 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:03.223037 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:03.635123 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:03.635091 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:03.733030 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:03.732989 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:04.138430 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:04.138402 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:07.672996 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:07.672960 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:07.773810 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:07.773754 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:07.974667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:07.974591 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:08.261105 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:08.261030 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:08.385020 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:08.384990 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:08.672244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:08.672213 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:38.426743 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:38.426665 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:38.527348 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:38.527316 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:38.606931 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:38.606903 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:39.358841 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:39.358793 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:15:39.562853 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:15:39.562818 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:01.426183 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:01.426147 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:05.106281 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:05.106244 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:07.257098 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:07.257066 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:08.755647 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.755615 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb"] Jun 10 12:16:08.757769 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.757746 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" Jun 10 12:16:08.760320 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.760296 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 10 12:16:08.760434 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.760323 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 10 12:16:08.760434 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.760376 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 10 12:16:08.761407 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.761392 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jz5x5\"" Jun 10 12:16:08.769970 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.769949 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb"] Jun 10 12:16:08.778585 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.778563 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rqmzb\" (UniqueName: \"kubernetes.io/projected/840503ff-9407-4d62-83d3-6978458db083-kube-api-access-rqmzb\") pod \"dns-operator-controller-manager-864dd78c4c-qxltb\" (UID: \"840503ff-9407-4d62-83d3-6978458db083\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" Jun 10 12:16:08.879874 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.879849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rqmzb\" (UniqueName: \"kubernetes.io/projected/840503ff-9407-4d62-83d3-6978458db083-kube-api-access-rqmzb\") pod \"dns-operator-controller-manager-864dd78c4c-qxltb\" (UID: \"840503ff-9407-4d62-83d3-6978458db083\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" Jun 10 12:16:08.889581 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:08.889549 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rqmzb\" (UniqueName: \"kubernetes.io/projected/840503ff-9407-4d62-83d3-6978458db083-kube-api-access-rqmzb\") pod \"dns-operator-controller-manager-864dd78c4c-qxltb\" (UID: \"840503ff-9407-4d62-83d3-6978458db083\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" Jun 10 12:16:09.068594 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:09.068515 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" Jun 10 12:16:09.201014 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:09.200986 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb"] Jun 10 12:16:09.204359 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:16:09.204334 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840503ff_9407_4d62_83d3_6978458db083.slice/crio-4f415623d279bb09d95a41fe7ce0d9e130829cb4fe7c893242a6c2fe941fb4af WatchSource:0}: Error finding container 4f415623d279bb09d95a41fe7ce0d9e130829cb4fe7c893242a6c2fe941fb4af: Status 404 returned error can't find the container with id 4f415623d279bb09d95a41fe7ce0d9e130829cb4fe7c893242a6c2fe941fb4af Jun 10 12:16:09.264611 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:09.264582 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" event={"ID":"840503ff-9407-4d62-83d3-6978458db083","Type":"ContainerStarted","Data":"4f415623d279bb09d95a41fe7ce0d9e130829cb4fe7c893242a6c2fe941fb4af"} Jun 10 12:16:09.276775 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:09.276751 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:09.430058 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:09.430023 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:11.693116 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:11.693083 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:11.833484 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:11.833407 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:12.280711 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:12.280673 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" event={"ID":"840503ff-9407-4d62-83d3-6978458db083","Type":"ContainerStarted","Data":"78cddb44a2c619cff11b24aa5acba08e06b3cf4417e1d22b60cb1438761e7bf1"} Jun 10 12:16:12.280917 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:12.280753 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" Jun 10 12:16:12.303458 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:12.303406 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" podStartSLOduration=1.961604748 podStartE2EDuration="4.303390262s" totalImagesPullingTime="2.341785514s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:16:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:16:12.303031476 +0000 UTC m=+769.488153508" watchObservedRunningTime="2026-06-10 12:16:12.303390262 +0000 UTC m=+769.488512294" Jun 10 12:16:12.634649 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:12.634604 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:14.061514 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:14.061455 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:14.159343 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:14.159266 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:15.034582 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.034552 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5"] Jun 10 12:16:15.037846 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.037829 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" Jun 10 12:16:15.040988 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.040968 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-g9fnz\"" Jun 10 12:16:15.050547 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.050523 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5"] Jun 10 12:16:15.136977 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.136931 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgc2x\" (UniqueName: \"kubernetes.io/projected/acb35a88-d9d1-4f8a-9aa4-d449e72d97cc-kube-api-access-jgc2x\") pod \"authorino-operator-75cc8d5cb7-hw4f5\" (UID: \"acb35a88-d9d1-4f8a-9aa4-d449e72d97cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" Jun 10 12:16:15.238099 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.238051 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgc2x\" (UniqueName: \"kubernetes.io/projected/acb35a88-d9d1-4f8a-9aa4-d449e72d97cc-kube-api-access-jgc2x\") pod \"authorino-operator-75cc8d5cb7-hw4f5\" (UID: \"acb35a88-d9d1-4f8a-9aa4-d449e72d97cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" Jun 10 12:16:15.253684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.253660 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgc2x\" (UniqueName: \"kubernetes.io/projected/acb35a88-d9d1-4f8a-9aa4-d449e72d97cc-kube-api-access-jgc2x\") pod \"authorino-operator-75cc8d5cb7-hw4f5\" (UID: \"acb35a88-d9d1-4f8a-9aa4-d449e72d97cc\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" Jun 10 12:16:15.348196 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.348170 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" Jun 10 12:16:15.482391 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:15.482366 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5"] Jun 10 12:16:15.485088 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:16:15.485052 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacb35a88_d9d1_4f8a_9aa4_d449e72d97cc.slice/crio-90b3818c37984e202bc02d67a286b15aafeeefe54fa9ce905db8eeec03d14b9a WatchSource:0}: Error finding container 90b3818c37984e202bc02d67a286b15aafeeefe54fa9ce905db8eeec03d14b9a: Status 404 returned error can't find the container with id 90b3818c37984e202bc02d67a286b15aafeeefe54fa9ce905db8eeec03d14b9a Jun 10 12:16:16.299286 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:16.299245 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" event={"ID":"acb35a88-d9d1-4f8a-9aa4-d449e72d97cc","Type":"ContainerStarted","Data":"90b3818c37984e202bc02d67a286b15aafeeefe54fa9ce905db8eeec03d14b9a"} Jun 10 12:16:16.774058 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:16.774025 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:17.047198 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:17.047112 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:17.103542 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:17.103514 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:17.291265 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:17.291232 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:18.311134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:18.311097 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" event={"ID":"acb35a88-d9d1-4f8a-9aa4-d449e72d97cc","Type":"ContainerStarted","Data":"1afcdb073a7b808007d52b75087d161cb4fdd4bbe24e8886c22344750bff99ec"} Jun 10 12:16:18.311505 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:18.311162 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" Jun 10 12:16:18.328987 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:18.328940 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" podStartSLOduration=1.142113028 podStartE2EDuration="3.328925889s" totalImagesPullingTime="2.186812861s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:16:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:16:18.327590516 +0000 UTC m=+775.512712547" watchObservedRunningTime="2026-06-10 12:16:18.328925889 +0000 UTC m=+775.514047921" Jun 10 12:16:23.293128 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:23.293100 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qxltb" Jun 10 12:16:24.690909 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:24.690873 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:24.793732 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:24.793700 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:29.317667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:29.317637 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-hw4f5" Jun 10 12:16:29.456185 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:29.456150 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:29.566029 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:29.565999 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:34.261658 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:34.261627 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:34.359124 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:34.359099 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:38.253785 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:38.253744 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:38.386228 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:38.386187 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:46.291752 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:46.291714 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:46.388143 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:46.388108 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:50.459630 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:50.459602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:50.561979 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:50.561949 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:54.856688 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:54.856657 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:54.909489 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:54.909465 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:55.041814 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:55.041756 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:16:55.097313 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:16:55.097290 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:01.930373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:01.930341 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:02.030957 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:02.030925 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:05.667978 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:05.667939 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:06.004985 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.004909 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:06.117561 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.117532 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:06.173516 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.173490 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:06.313107 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.313038 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:17:06.316466 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.316450 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.319243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.319218 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 10 12:17:06.319731 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.319715 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-pdb74\"" Jun 10 12:17:06.333331 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.333305 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:17:06.367405 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.367375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c60f366d-cb72-4137-8cbc-c04d015cb3d9-config-file\") pod \"limitador-limitador-54d6d988d5-kpq54\" (UID: \"c60f366d-cb72-4137-8cbc-c04d015cb3d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.367531 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.367419 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcfmg\" (UniqueName: \"kubernetes.io/projected/c60f366d-cb72-4137-8cbc-c04d015cb3d9-kube-api-access-hcfmg\") pod \"limitador-limitador-54d6d988d5-kpq54\" (UID: \"c60f366d-cb72-4137-8cbc-c04d015cb3d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.388268 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.388246 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:17:06.468088 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.468059 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c60f366d-cb72-4137-8cbc-c04d015cb3d9-config-file\") pod \"limitador-limitador-54d6d988d5-kpq54\" (UID: \"c60f366d-cb72-4137-8cbc-c04d015cb3d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.468191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.468105 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcfmg\" (UniqueName: \"kubernetes.io/projected/c60f366d-cb72-4137-8cbc-c04d015cb3d9-kube-api-access-hcfmg\") pod \"limitador-limitador-54d6d988d5-kpq54\" (UID: \"c60f366d-cb72-4137-8cbc-c04d015cb3d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.468583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.468563 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/c60f366d-cb72-4137-8cbc-c04d015cb3d9-config-file\") pod \"limitador-limitador-54d6d988d5-kpq54\" (UID: \"c60f366d-cb72-4137-8cbc-c04d015cb3d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.477607 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.477585 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcfmg\" (UniqueName: \"kubernetes.io/projected/c60f366d-cb72-4137-8cbc-c04d015cb3d9-kube-api-access-hcfmg\") pod \"limitador-limitador-54d6d988d5-kpq54\" (UID: \"c60f366d-cb72-4137-8cbc-c04d015cb3d9\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.626514 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.626487 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:06.757465 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.757439 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:17:06.759948 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:17:06.759916 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60f366d_cb72_4137_8cbc_c04d015cb3d9.slice/crio-a23ac36d0ba7d43cfa8c7472516d6a579999f06efe9324c6f91a73837f694276 WatchSource:0}: Error finding container a23ac36d0ba7d43cfa8c7472516d6a579999f06efe9324c6f91a73837f694276: Status 404 returned error can't find the container with id a23ac36d0ba7d43cfa8c7472516d6a579999f06efe9324c6f91a73837f694276 Jun 10 12:17:06.861055 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.861025 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:06.937279 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.937216 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:06.942251 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.942222 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-9v7xh"] Jun 10 12:17:06.946520 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.946504 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9v7xh" Jun 10 12:17:06.948951 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.948934 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-bdmrj\"" Jun 10 12:17:06.952110 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:06.952088 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9v7xh"] Jun 10 12:17:07.072649 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:07.072620 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-99nq8\" (UniqueName: \"kubernetes.io/projected/26a0d74d-3c76-4f66-8b19-3609a5c65b84-kube-api-access-99nq8\") pod \"authorino-75d556bd77-9v7xh\" (UID: \"26a0d74d-3c76-4f66-8b19-3609a5c65b84\") " pod="kuadrant-system/authorino-75d556bd77-9v7xh" Jun 10 12:17:07.173060 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:07.173029 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-99nq8\" (UniqueName: \"kubernetes.io/projected/26a0d74d-3c76-4f66-8b19-3609a5c65b84-kube-api-access-99nq8\") pod \"authorino-75d556bd77-9v7xh\" (UID: \"26a0d74d-3c76-4f66-8b19-3609a5c65b84\") " pod="kuadrant-system/authorino-75d556bd77-9v7xh" Jun 10 12:17:07.180213 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:07.180188 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-99nq8\" (UniqueName: \"kubernetes.io/projected/26a0d74d-3c76-4f66-8b19-3609a5c65b84-kube-api-access-99nq8\") pod \"authorino-75d556bd77-9v7xh\" (UID: \"26a0d74d-3c76-4f66-8b19-3609a5c65b84\") " pod="kuadrant-system/authorino-75d556bd77-9v7xh" Jun 10 12:17:07.270927 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:07.270850 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9v7xh" Jun 10 12:17:07.433480 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:07.433429 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9v7xh"] Jun 10 12:17:07.436406 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:17:07.436377 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod26a0d74d_3c76_4f66_8b19_3609a5c65b84.slice/crio-ed54c3d04aa3698b63554b8f021b0dac8c64abd66fe8a7dc431527babd95b807 WatchSource:0}: Error finding container ed54c3d04aa3698b63554b8f021b0dac8c64abd66fe8a7dc431527babd95b807: Status 404 returned error can't find the container with id ed54c3d04aa3698b63554b8f021b0dac8c64abd66fe8a7dc431527babd95b807 Jun 10 12:17:07.536349 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:07.536177 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9v7xh" event={"ID":"26a0d74d-3c76-4f66-8b19-3609a5c65b84","Type":"ContainerStarted","Data":"ed54c3d04aa3698b63554b8f021b0dac8c64abd66fe8a7dc431527babd95b807"} Jun 10 12:17:07.538746 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:07.538679 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" event={"ID":"c60f366d-cb72-4137-8cbc-c04d015cb3d9","Type":"ContainerStarted","Data":"a23ac36d0ba7d43cfa8c7472516d6a579999f06efe9324c6f91a73837f694276"} Jun 10 12:17:10.635754 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:10.635718 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:10.716762 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:10.716689 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:11.562964 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:11.562875 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" event={"ID":"c60f366d-cb72-4137-8cbc-c04d015cb3d9","Type":"ContainerStarted","Data":"eb606133bf85037285e51ac92465db3389867b220a138c46662c059647ad2173"} Jun 10 12:17:11.563150 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:11.563061 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:11.564457 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:11.564431 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9v7xh" event={"ID":"26a0d74d-3c76-4f66-8b19-3609a5c65b84","Type":"ContainerStarted","Data":"65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6"} Jun 10 12:17:11.578376 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:11.578337 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" podStartSLOduration=1.155436556 podStartE2EDuration="5.578326174s" totalImagesPullingTime="4.422889618s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:17:11.577760831 +0000 UTC m=+828.762882861" watchObservedRunningTime="2026-06-10 12:17:11.578326174 +0000 UTC m=+828.763448231" Jun 10 12:17:11.592556 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:11.592518 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-9v7xh" podStartSLOduration=1.785952048 podStartE2EDuration="5.592509584s" totalImagesPullingTime="3.806557536s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:17:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:17:11.591650339 +0000 UTC m=+828.776772371" watchObservedRunningTime="2026-06-10 12:17:11.592509584 +0000 UTC m=+828.777631615" Jun 10 12:17:18.171378 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:18.171344 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:18.271485 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:18.271449 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:22.570104 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:22.570070 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-kpq54" Jun 10 12:17:27.571917 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:27.571885 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:38.013244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:38.013209 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:38.104554 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:38.104526 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:17:38.270711 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:17:38.270636 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:08.936578 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:08.936546 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:09.038038 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:09.038005 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:11.057637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:11.057602 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:12.196362 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:12.196333 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:22.174922 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:22.174882 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:23.301115 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:23.301080 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:18:23.303511 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:23.303491 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:18:40.552942 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.552905 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:40.826060 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.825976 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q94t5"] Jun 10 12:18:40.828285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.828270 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q94t5" Jun 10 12:18:40.840048 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.840024 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q94t5"] Jun 10 12:18:40.857300 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.857269 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:40.866985 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.866959 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdznp\" (UniqueName: \"kubernetes.io/projected/4bec0015-0f78-408f-8d72-1dafb80cc43b-kube-api-access-fdznp\") pod \"authorino-5d4b67c446-q94t5\" (UID: \"4bec0015-0f78-408f-8d72-1dafb80cc43b\") " pod="kuadrant-system/authorino-5d4b67c446-q94t5" Jun 10 12:18:40.967769 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.967733 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdznp\" (UniqueName: \"kubernetes.io/projected/4bec0015-0f78-408f-8d72-1dafb80cc43b-kube-api-access-fdznp\") pod \"authorino-5d4b67c446-q94t5\" (UID: \"4bec0015-0f78-408f-8d72-1dafb80cc43b\") " pod="kuadrant-system/authorino-5d4b67c446-q94t5" Jun 10 12:18:40.976380 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:40.976354 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdznp\" (UniqueName: \"kubernetes.io/projected/4bec0015-0f78-408f-8d72-1dafb80cc43b-kube-api-access-fdznp\") pod \"authorino-5d4b67c446-q94t5\" (UID: \"4bec0015-0f78-408f-8d72-1dafb80cc43b\") " pod="kuadrant-system/authorino-5d4b67c446-q94t5" Jun 10 12:18:41.028044 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.028003 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q94t5"] Jun 10 12:18:41.028283 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.028270 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q94t5" Jun 10 12:18:41.059000 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.058973 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-nhjvc"] Jun 10 12:18:41.062108 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.062088 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.064908 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.064887 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 10 12:18:41.072095 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.072069 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-nhjvc"] Jun 10 12:18:41.111234 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.111201 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-nhjvc"] Jun 10 12:18:41.111579 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:18:41.111554 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-z5xxj tls-cert], unattached volumes=[], failed to process volumes=[kube-api-access-z5xxj tls-cert]: context canceled" pod="kuadrant-system/authorino-76877994-nhjvc" podUID="f14306b8-3de3-424a-9e31-44dfb881fd1e" Jun 10 12:18:41.140853 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.140822 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6d9cf5f767-cp5vd"] Jun 10 12:18:41.143531 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.143482 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.156304 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.156276 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9cf5f767-cp5vd"] Jun 10 12:18:41.171746 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.171713 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f14306b8-3de3-424a-9e31-44dfb881fd1e-tls-cert\") pod \"authorino-76877994-nhjvc\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.171854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.171835 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5xxj\" (UniqueName: \"kubernetes.io/projected/f14306b8-3de3-424a-9e31-44dfb881fd1e-kube-api-access-z5xxj\") pod \"authorino-76877994-nhjvc\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.171920 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.171881 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fa81476-2761-4a8a-801b-f2528300b556-tls-cert\") pod \"authorino-6d9cf5f767-cp5vd\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.172064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.172039 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpfs2\" (UniqueName: \"kubernetes.io/projected/6fa81476-2761-4a8a-801b-f2528300b556-kube-api-access-tpfs2\") pod \"authorino-6d9cf5f767-cp5vd\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.172646 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.172626 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q94t5"] Jun 10 12:18:41.272865 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.272831 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f14306b8-3de3-424a-9e31-44dfb881fd1e-tls-cert\") pod \"authorino-76877994-nhjvc\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.273064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.272890 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5xxj\" (UniqueName: \"kubernetes.io/projected/f14306b8-3de3-424a-9e31-44dfb881fd1e-kube-api-access-z5xxj\") pod \"authorino-76877994-nhjvc\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.273064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.272921 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fa81476-2761-4a8a-801b-f2528300b556-tls-cert\") pod \"authorino-6d9cf5f767-cp5vd\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.273064 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.272950 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpfs2\" (UniqueName: \"kubernetes.io/projected/6fa81476-2761-4a8a-801b-f2528300b556-kube-api-access-tpfs2\") pod \"authorino-6d9cf5f767-cp5vd\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.275621 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.275595 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fa81476-2761-4a8a-801b-f2528300b556-tls-cert\") pod \"authorino-6d9cf5f767-cp5vd\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.275758 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.275595 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f14306b8-3de3-424a-9e31-44dfb881fd1e-tls-cert\") pod \"authorino-76877994-nhjvc\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.281432 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.281410 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5xxj\" (UniqueName: \"kubernetes.io/projected/f14306b8-3de3-424a-9e31-44dfb881fd1e-kube-api-access-z5xxj\") pod \"authorino-76877994-nhjvc\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.281570 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.281551 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpfs2\" (UniqueName: \"kubernetes.io/projected/6fa81476-2761-4a8a-801b-f2528300b556-kube-api-access-tpfs2\") pod \"authorino-6d9cf5f767-cp5vd\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.454451 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.454418 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:18:41.591895 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.591865 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6d9cf5f767-cp5vd"] Jun 10 12:18:41.593730 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:18:41.593700 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6fa81476_2761_4a8a_801b_f2528300b556.slice/crio-c9556abe9c3ab4d7528f7636481a25e64590c15f3faf8cbbf5a05d156d78ce0c WatchSource:0}: Error finding container c9556abe9c3ab4d7528f7636481a25e64590c15f3faf8cbbf5a05d156d78ce0c: Status 404 returned error can't find the container with id c9556abe9c3ab4d7528f7636481a25e64590c15f3faf8cbbf5a05d156d78ce0c Jun 10 12:18:41.981335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.981301 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" event={"ID":"6fa81476-2761-4a8a-801b-f2528300b556","Type":"ContainerStarted","Data":"dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3"} Jun 10 12:18:41.981515 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.981366 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" event={"ID":"6fa81476-2761-4a8a-801b-f2528300b556","Type":"ContainerStarted","Data":"c9556abe9c3ab4d7528f7636481a25e64590c15f3faf8cbbf5a05d156d78ce0c"} Jun 10 12:18:41.983180 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.983150 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q94t5" event={"ID":"4bec0015-0f78-408f-8d72-1dafb80cc43b","Type":"ContainerStarted","Data":"5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68"} Jun 10 12:18:41.983319 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.983195 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q94t5" event={"ID":"4bec0015-0f78-408f-8d72-1dafb80cc43b","Type":"ContainerStarted","Data":"8070fd695fad4e5d2ff33db659ff2b31ce2727751f9dd774eb886175c2b42864"} Jun 10 12:18:41.983319 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.983179 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-q94t5" podUID="4bec0015-0f78-408f-8d72-1dafb80cc43b" containerName="authorino" containerID="cri-o://5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68" gracePeriod=30 Jun 10 12:18:41.983319 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.983160 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:41.998431 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:41.998380 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" podStartSLOduration=0.718577549 podStartE2EDuration="998.364354ms" totalImagesPullingTime="279.786805ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:18:41.996452302 +0000 UTC m=+919.181574334" watchObservedRunningTime="2026-06-10 12:18:41.998364354 +0000 UTC m=+919.183486384" Jun 10 12:18:42.012549 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.012446 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-q94t5" podStartSLOduration=1.5587616789999998 podStartE2EDuration="2.012424012s" totalImagesPullingTime="453.662333ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:18:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:18:42.010992925 +0000 UTC m=+919.196114957" watchObservedRunningTime="2026-06-10 12:18:42.012424012 +0000 UTC m=+919.197546045" Jun 10 12:18:42.026054 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.026026 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9v7xh"] Jun 10 12:18:42.026225 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.026205 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-9v7xh" podUID="26a0d74d-3c76-4f66-8b19-3609a5c65b84" containerName="authorino" containerID="cri-o://65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6" gracePeriod=30 Jun 10 12:18:42.125378 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.125315 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:42.181199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.181153 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5xxj\" (UniqueName: \"kubernetes.io/projected/f14306b8-3de3-424a-9e31-44dfb881fd1e-kube-api-access-z5xxj\") pod \"f14306b8-3de3-424a-9e31-44dfb881fd1e\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " Jun 10 12:18:42.181356 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.181231 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f14306b8-3de3-424a-9e31-44dfb881fd1e-tls-cert\") pod \"f14306b8-3de3-424a-9e31-44dfb881fd1e\" (UID: \"f14306b8-3de3-424a-9e31-44dfb881fd1e\") " Jun 10 12:18:42.183518 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.183485 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f14306b8-3de3-424a-9e31-44dfb881fd1e-kube-api-access-z5xxj" (OuterVolumeSpecName: "kube-api-access-z5xxj") pod "f14306b8-3de3-424a-9e31-44dfb881fd1e" (UID: "f14306b8-3de3-424a-9e31-44dfb881fd1e"). InnerVolumeSpecName "kube-api-access-z5xxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:18:42.183859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.183832 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f14306b8-3de3-424a-9e31-44dfb881fd1e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "f14306b8-3de3-424a-9e31-44dfb881fd1e" (UID: "f14306b8-3de3-424a-9e31-44dfb881fd1e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:18:42.257767 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.257734 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q94t5" Jun 10 12:18:42.282087 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.282057 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5xxj\" (UniqueName: \"kubernetes.io/projected/f14306b8-3de3-424a-9e31-44dfb881fd1e-kube-api-access-z5xxj\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:18:42.282087 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.282082 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/f14306b8-3de3-424a-9e31-44dfb881fd1e-tls-cert\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:18:42.293934 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.293907 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9v7xh" Jun 10 12:18:42.383321 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.383244 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-99nq8\" (UniqueName: \"kubernetes.io/projected/26a0d74d-3c76-4f66-8b19-3609a5c65b84-kube-api-access-99nq8\") pod \"26a0d74d-3c76-4f66-8b19-3609a5c65b84\" (UID: \"26a0d74d-3c76-4f66-8b19-3609a5c65b84\") " Jun 10 12:18:42.383321 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.383300 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fdznp\" (UniqueName: \"kubernetes.io/projected/4bec0015-0f78-408f-8d72-1dafb80cc43b-kube-api-access-fdznp\") pod \"4bec0015-0f78-408f-8d72-1dafb80cc43b\" (UID: \"4bec0015-0f78-408f-8d72-1dafb80cc43b\") " Jun 10 12:18:42.385530 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.385494 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4bec0015-0f78-408f-8d72-1dafb80cc43b-kube-api-access-fdznp" (OuterVolumeSpecName: "kube-api-access-fdznp") pod "4bec0015-0f78-408f-8d72-1dafb80cc43b" (UID: "4bec0015-0f78-408f-8d72-1dafb80cc43b"). InnerVolumeSpecName "kube-api-access-fdznp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:18:42.385530 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.385520 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/26a0d74d-3c76-4f66-8b19-3609a5c65b84-kube-api-access-99nq8" (OuterVolumeSpecName: "kube-api-access-99nq8") pod "26a0d74d-3c76-4f66-8b19-3609a5c65b84" (UID: "26a0d74d-3c76-4f66-8b19-3609a5c65b84"). InnerVolumeSpecName "kube-api-access-99nq8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:18:42.484245 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.484208 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-99nq8\" (UniqueName: \"kubernetes.io/projected/26a0d74d-3c76-4f66-8b19-3609a5c65b84-kube-api-access-99nq8\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:18:42.484245 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.484234 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fdznp\" (UniqueName: \"kubernetes.io/projected/4bec0015-0f78-408f-8d72-1dafb80cc43b-kube-api-access-fdznp\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:18:42.989678 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.989648 2570 generic.go:356] "Generic (PLEG): container finished" podID="26a0d74d-3c76-4f66-8b19-3609a5c65b84" containerID="65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6" exitCode=0 Jun 10 12:18:42.990118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.989685 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-9v7xh" Jun 10 12:18:42.990118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.989778 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9v7xh" event={"ID":"26a0d74d-3c76-4f66-8b19-3609a5c65b84","Type":"ContainerDied","Data":"65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6"} Jun 10 12:18:42.990118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.989835 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-9v7xh" event={"ID":"26a0d74d-3c76-4f66-8b19-3609a5c65b84","Type":"ContainerDied","Data":"ed54c3d04aa3698b63554b8f021b0dac8c64abd66fe8a7dc431527babd95b807"} Jun 10 12:18:42.990118 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.989862 2570 scope.go:117] "RemoveContainer" containerID="65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6" Jun 10 12:18:42.991116 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.991095 2570 generic.go:356] "Generic (PLEG): container finished" podID="4bec0015-0f78-408f-8d72-1dafb80cc43b" containerID="5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68" exitCode=0 Jun 10 12:18:42.991198 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.991123 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-q94t5" Jun 10 12:18:42.991198 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.991156 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q94t5" event={"ID":"4bec0015-0f78-408f-8d72-1dafb80cc43b","Type":"ContainerDied","Data":"5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68"} Jun 10 12:18:42.991287 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.991203 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-q94t5" event={"ID":"4bec0015-0f78-408f-8d72-1dafb80cc43b","Type":"ContainerDied","Data":"8070fd695fad4e5d2ff33db659ff2b31ce2727751f9dd774eb886175c2b42864"} Jun 10 12:18:42.991524 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:42.991487 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-nhjvc" Jun 10 12:18:43.000073 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.000054 2570 scope.go:117] "RemoveContainer" containerID="65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6" Jun 10 12:18:43.000338 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:18:43.000321 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6\": container with ID starting with 65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6 not found: ID does not exist" containerID="65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6" Jun 10 12:18:43.000412 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.000350 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6"} err="failed to get container status \"65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6\": rpc error: code = NotFound desc = could not find container \"65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6\": container with ID starting with 65c6af31a6cb2e2c775ed7a04f0dac4cb6c016c9d0724f9797edf204309efda6 not found: ID does not exist" Jun 10 12:18:43.000412 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.000374 2570 scope.go:117] "RemoveContainer" containerID="5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68" Jun 10 12:18:43.008561 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.008545 2570 scope.go:117] "RemoveContainer" containerID="5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68" Jun 10 12:18:43.008823 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:18:43.008779 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68\": container with ID starting with 5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68 not found: ID does not exist" containerID="5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68" Jun 10 12:18:43.008913 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.008820 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68"} err="failed to get container status \"5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68\": rpc error: code = NotFound desc = could not find container \"5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68\": container with ID starting with 5fe76af0a484333662d7b47129f53d6cfe2786141966b968359e700b2af44c68 not found: ID does not exist" Jun 10 12:18:43.016760 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.016735 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q94t5"] Jun 10 12:18:43.023884 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.023862 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-q94t5"] Jun 10 12:18:43.037317 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.037297 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9v7xh"] Jun 10 12:18:43.041593 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.041573 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-9v7xh"] Jun 10 12:18:43.062904 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.062870 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-nhjvc"] Jun 10 12:18:43.065139 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.065118 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-nhjvc"] Jun 10 12:18:43.294240 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.294163 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="26a0d74d-3c76-4f66-8b19-3609a5c65b84" path="/var/lib/kubelet/pods/26a0d74d-3c76-4f66-8b19-3609a5c65b84/volumes" Jun 10 12:18:43.294499 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.294487 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4bec0015-0f78-408f-8d72-1dafb80cc43b" path="/var/lib/kubelet/pods/4bec0015-0f78-408f-8d72-1dafb80cc43b/volumes" Jun 10 12:18:43.294844 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:43.294831 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f14306b8-3de3-424a-9e31-44dfb881fd1e" path="/var/lib/kubelet/pods/f14306b8-3de3-424a-9e31-44dfb881fd1e/volumes" Jun 10 12:18:45.949839 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:45.949783 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:46.035974 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:46.035918 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:46.138873 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:46.138775 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:49.373639 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:49.373603 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:18:49.471993 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:18:49.471961 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:19:20.246623 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:19:20.246586 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:19:20.451110 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:19:20.451082 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:19:20.703694 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:19:20.703661 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:19:20.805260 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:19:20.805232 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:19:20.909282 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:19:20.909218 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:20:07.602281 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:07.602245 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:07.653689 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:07.653657 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:11.017994 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.017958 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76647d756c-skk2f"] Jun 10 12:20:11.018428 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.018357 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4bec0015-0f78-408f-8d72-1dafb80cc43b" containerName="authorino" Jun 10 12:20:11.018428 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.018374 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="4bec0015-0f78-408f-8d72-1dafb80cc43b" containerName="authorino" Jun 10 12:20:11.018428 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.018394 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="26a0d74d-3c76-4f66-8b19-3609a5c65b84" containerName="authorino" Jun 10 12:20:11.018428 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.018400 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="26a0d74d-3c76-4f66-8b19-3609a5c65b84" containerName="authorino" Jun 10 12:20:11.018640 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.018476 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="4bec0015-0f78-408f-8d72-1dafb80cc43b" containerName="authorino" Jun 10 12:20:11.018640 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.018490 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="26a0d74d-3c76-4f66-8b19-3609a5c65b84" containerName="authorino" Jun 10 12:20:11.020859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.020842 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.023300 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.023277 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 10 12:20:11.029149 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.029123 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76647d756c-skk2f"] Jun 10 12:20:11.120446 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.120411 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txtk9\" (UniqueName: \"kubernetes.io/projected/c80f6e00-da40-4600-a323-75aa9e43c36a-kube-api-access-txtk9\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.120623 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.120465 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c80f6e00-da40-4600-a323-75aa9e43c36a-tls-cert\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.120623 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.120543 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c80f6e00-da40-4600-a323-75aa9e43c36a-oidc-ca\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.221814 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.221770 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txtk9\" (UniqueName: \"kubernetes.io/projected/c80f6e00-da40-4600-a323-75aa9e43c36a-kube-api-access-txtk9\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.221989 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.221875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c80f6e00-da40-4600-a323-75aa9e43c36a-tls-cert\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.221989 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.221939 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c80f6e00-da40-4600-a323-75aa9e43c36a-oidc-ca\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.222605 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.222576 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c80f6e00-da40-4600-a323-75aa9e43c36a-oidc-ca\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.224374 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.224356 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c80f6e00-da40-4600-a323-75aa9e43c36a-tls-cert\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.229483 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.229459 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txtk9\" (UniqueName: \"kubernetes.io/projected/c80f6e00-da40-4600-a323-75aa9e43c36a-kube-api-access-txtk9\") pod \"authorino-76647d756c-skk2f\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.330908 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.330827 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:20:11.467027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.467004 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76647d756c-skk2f"] Jun 10 12:20:11.469092 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:20:11.469061 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc80f6e00_da40_4600_a323_75aa9e43c36a.slice/crio-346ae3ea282fd6bc8622e5bd50409332d4fc317df4a0f9d24b6fc83682bd3ea9 WatchSource:0}: Error finding container 346ae3ea282fd6bc8622e5bd50409332d4fc317df4a0f9d24b6fc83682bd3ea9: Status 404 returned error can't find the container with id 346ae3ea282fd6bc8622e5bd50409332d4fc317df4a0f9d24b6fc83682bd3ea9 Jun 10 12:20:11.470353 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:11.470328 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:20:12.412722 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.412687 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76647d756c-skk2f" event={"ID":"c80f6e00-da40-4600-a323-75aa9e43c36a","Type":"ContainerStarted","Data":"3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b"} Jun 10 12:20:12.413106 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.412731 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76647d756c-skk2f" event={"ID":"c80f6e00-da40-4600-a323-75aa9e43c36a","Type":"ContainerStarted","Data":"346ae3ea282fd6bc8622e5bd50409332d4fc317df4a0f9d24b6fc83682bd3ea9"} Jun 10 12:20:12.434443 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.434387 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-76647d756c-skk2f" podStartSLOduration=1.050790355 podStartE2EDuration="1.434372391s" totalImagesPullingTime="383.582036ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:20:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:20:12.432265866 +0000 UTC m=+1009.617387899" watchObservedRunningTime="2026-06-10 12:20:12.434372391 +0000 UTC m=+1009.619494478" Jun 10 12:20:12.470005 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.469967 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d9cf5f767-cp5vd"] Jun 10 12:20:12.470240 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.470192 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" podUID="6fa81476-2761-4a8a-801b-f2528300b556" containerName="authorino" containerID="cri-o://dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3" gracePeriod=30 Jun 10 12:20:12.505036 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.505005 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:12.732112 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.732083 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:20:12.838162 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.838132 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fa81476-2761-4a8a-801b-f2528300b556-tls-cert\") pod \"6fa81476-2761-4a8a-801b-f2528300b556\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " Jun 10 12:20:12.838327 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.838201 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpfs2\" (UniqueName: \"kubernetes.io/projected/6fa81476-2761-4a8a-801b-f2528300b556-kube-api-access-tpfs2\") pod \"6fa81476-2761-4a8a-801b-f2528300b556\" (UID: \"6fa81476-2761-4a8a-801b-f2528300b556\") " Jun 10 12:20:12.840285 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.840254 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6fa81476-2761-4a8a-801b-f2528300b556-kube-api-access-tpfs2" (OuterVolumeSpecName: "kube-api-access-tpfs2") pod "6fa81476-2761-4a8a-801b-f2528300b556" (UID: "6fa81476-2761-4a8a-801b-f2528300b556"). InnerVolumeSpecName "kube-api-access-tpfs2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:20:12.848203 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.848175 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6fa81476-2761-4a8a-801b-f2528300b556-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6fa81476-2761-4a8a-801b-f2528300b556" (UID: "6fa81476-2761-4a8a-801b-f2528300b556"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:20:12.917322 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.917289 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:12.939296 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.939266 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6fa81476-2761-4a8a-801b-f2528300b556-tls-cert\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:20:12.939296 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:12.939288 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpfs2\" (UniqueName: \"kubernetes.io/projected/6fa81476-2761-4a8a-801b-f2528300b556-kube-api-access-tpfs2\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:20:13.020232 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.020148 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:13.418651 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.418621 2570 generic.go:356] "Generic (PLEG): container finished" podID="6fa81476-2761-4a8a-801b-f2528300b556" containerID="dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3" exitCode=0 Jun 10 12:20:13.419146 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.418667 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" Jun 10 12:20:13.419146 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.418705 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" event={"ID":"6fa81476-2761-4a8a-801b-f2528300b556","Type":"ContainerDied","Data":"dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3"} Jun 10 12:20:13.419146 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.418751 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6d9cf5f767-cp5vd" event={"ID":"6fa81476-2761-4a8a-801b-f2528300b556","Type":"ContainerDied","Data":"c9556abe9c3ab4d7528f7636481a25e64590c15f3faf8cbbf5a05d156d78ce0c"} Jun 10 12:20:13.419146 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.418775 2570 scope.go:117] "RemoveContainer" containerID="dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3" Jun 10 12:20:13.427634 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.427616 2570 scope.go:117] "RemoveContainer" containerID="dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3" Jun 10 12:20:13.427923 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:20:13.427897 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3\": container with ID starting with dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3 not found: ID does not exist" containerID="dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3" Jun 10 12:20:13.428005 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.427931 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3"} err="failed to get container status \"dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3\": rpc error: code = NotFound desc = could not find container \"dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3\": container with ID starting with dc299abf379b55c27f9b5637de27c356cd82b0b8080882a9d61a1454c0bee5f3 not found: ID does not exist" Jun 10 12:20:13.435246 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.435224 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6d9cf5f767-cp5vd"] Jun 10 12:20:13.438873 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:13.438856 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6d9cf5f767-cp5vd"] Jun 10 12:20:15.294307 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:15.294274 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6fa81476-2761-4a8a-801b-f2528300b556" path="/var/lib/kubelet/pods/6fa81476-2761-4a8a-801b-f2528300b556/volumes" Jun 10 12:20:21.562060 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:21.562026 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:21.618847 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:21.618792 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:23.232170 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:23.232141 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:23.534427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:23.534335 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:20:34.132313 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:34.132281 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:34.530573 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:34.530488 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:20:45.372890 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:45.372856 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:20:45.837916 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:20:45.837831 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:21:04.748298 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:04.748263 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:21:05.237477 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:05.237437 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:21:13.154975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:13.154885 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:21:13.745637 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:13.745600 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:21:19.026701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:19.026655 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:21:19.843444 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:19.843399 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:21:24.894114 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:24.894074 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:21:26.048751 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:21:26.048715 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:22:21.121268 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.121228 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-68bdf5bcd-ffz8t"] Jun 10 12:22:21.121761 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.121598 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fa81476-2761-4a8a-801b-f2528300b556" containerName="authorino" Jun 10 12:22:21.121761 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.121610 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fa81476-2761-4a8a-801b-f2528300b556" containerName="authorino" Jun 10 12:22:21.121761 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.121668 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fa81476-2761-4a8a-801b-f2528300b556" containerName="authorino" Jun 10 12:22:21.124186 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.124169 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.132314 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.132285 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bdf5bcd-ffz8t"] Jun 10 12:22:21.200688 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.200647 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/33073c53-486e-4bb4-bf58-26ab103cb556-oidc-ca\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.200899 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.200737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33073c53-486e-4bb4-bf58-26ab103cb556-tls-cert\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.200899 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.200783 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gvr7\" (UniqueName: \"kubernetes.io/projected/33073c53-486e-4bb4-bf58-26ab103cb556-kube-api-access-6gvr7\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.301715 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.301666 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/33073c53-486e-4bb4-bf58-26ab103cb556-oidc-ca\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.301927 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.301754 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33073c53-486e-4bb4-bf58-26ab103cb556-tls-cert\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.301927 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.301832 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gvr7\" (UniqueName: \"kubernetes.io/projected/33073c53-486e-4bb4-bf58-26ab103cb556-kube-api-access-6gvr7\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.302330 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.302310 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/33073c53-486e-4bb4-bf58-26ab103cb556-oidc-ca\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.304386 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.304363 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/33073c53-486e-4bb4-bf58-26ab103cb556-tls-cert\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.309598 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.309577 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gvr7\" (UniqueName: \"kubernetes.io/projected/33073c53-486e-4bb4-bf58-26ab103cb556-kube-api-access-6gvr7\") pod \"authorino-68bdf5bcd-ffz8t\" (UID: \"33073c53-486e-4bb4-bf58-26ab103cb556\") " pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.433678 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.433567 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" Jun 10 12:22:21.571870 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:21.571764 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-68bdf5bcd-ffz8t"] Jun 10 12:22:21.574854 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:22:21.574825 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod33073c53_486e_4bb4_bf58_26ab103cb556.slice/crio-e41282403b81d40cf7f0bba9a33b76df878b79d34ef752467d1848aec3148310 WatchSource:0}: Error finding container e41282403b81d40cf7f0bba9a33b76df878b79d34ef752467d1848aec3148310: Status 404 returned error can't find the container with id e41282403b81d40cf7f0bba9a33b76df878b79d34ef752467d1848aec3148310 Jun 10 12:22:22.034684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:22.034653 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" event={"ID":"33073c53-486e-4bb4-bf58-26ab103cb556","Type":"ContainerStarted","Data":"e41282403b81d40cf7f0bba9a33b76df878b79d34ef752467d1848aec3148310"} Jun 10 12:22:23.040665 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.040625 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" event={"ID":"33073c53-486e-4bb4-bf58-26ab103cb556","Type":"ContainerStarted","Data":"3d834dad66d108e505a52d8519126206f59c6a18f33fab367fd95a55a683a6ba"} Jun 10 12:22:23.056704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.056648 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-68bdf5bcd-ffz8t" podStartSLOduration=1.569481228 podStartE2EDuration="2.056630089s" totalImagesPullingTime="487.148861ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:22:23.054877782 +0000 UTC m=+1140.239999814" watchObservedRunningTime="2026-06-10 12:22:23.056630089 +0000 UTC m=+1140.241752121" Jun 10 12:22:23.082444 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.082407 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76647d756c-skk2f"] Jun 10 12:22:23.082641 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.082594 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-76647d756c-skk2f" podUID="c80f6e00-da40-4600-a323-75aa9e43c36a" containerName="authorino" containerID="cri-o://3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b" gracePeriod=30 Jun 10 12:22:23.347843 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.347813 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:22:23.422793 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.422734 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c80f6e00-da40-4600-a323-75aa9e43c36a-tls-cert\") pod \"c80f6e00-da40-4600-a323-75aa9e43c36a\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " Jun 10 12:22:23.422793 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.422793 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c80f6e00-da40-4600-a323-75aa9e43c36a-oidc-ca\") pod \"c80f6e00-da40-4600-a323-75aa9e43c36a\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " Jun 10 12:22:23.423046 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.422863 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txtk9\" (UniqueName: \"kubernetes.io/projected/c80f6e00-da40-4600-a323-75aa9e43c36a-kube-api-access-txtk9\") pod \"c80f6e00-da40-4600-a323-75aa9e43c36a\" (UID: \"c80f6e00-da40-4600-a323-75aa9e43c36a\") " Jun 10 12:22:23.425084 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.425045 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c80f6e00-da40-4600-a323-75aa9e43c36a-kube-api-access-txtk9" (OuterVolumeSpecName: "kube-api-access-txtk9") pod "c80f6e00-da40-4600-a323-75aa9e43c36a" (UID: "c80f6e00-da40-4600-a323-75aa9e43c36a"). InnerVolumeSpecName "kube-api-access-txtk9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:22:23.427863 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.427826 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c80f6e00-da40-4600-a323-75aa9e43c36a-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "c80f6e00-da40-4600-a323-75aa9e43c36a" (UID: "c80f6e00-da40-4600-a323-75aa9e43c36a"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:22:23.433767 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.433736 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c80f6e00-da40-4600-a323-75aa9e43c36a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "c80f6e00-da40-4600-a323-75aa9e43c36a" (UID: "c80f6e00-da40-4600-a323-75aa9e43c36a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 10 12:22:23.524311 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.524274 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/c80f6e00-da40-4600-a323-75aa9e43c36a-tls-cert\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:22:23.524311 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.524305 2570 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/c80f6e00-da40-4600-a323-75aa9e43c36a-oidc-ca\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:22:23.524311 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.524315 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txtk9\" (UniqueName: \"kubernetes.io/projected/c80f6e00-da40-4600-a323-75aa9e43c36a-kube-api-access-txtk9\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:22:23.703719 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.703682 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:22:23.803035 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:23.803004 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:22:24.046719 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.046633 2570 generic.go:356] "Generic (PLEG): container finished" podID="c80f6e00-da40-4600-a323-75aa9e43c36a" containerID="3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b" exitCode=0 Jun 10 12:22:24.046719 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.046691 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76647d756c-skk2f" Jun 10 12:22:24.047181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.046720 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76647d756c-skk2f" event={"ID":"c80f6e00-da40-4600-a323-75aa9e43c36a","Type":"ContainerDied","Data":"3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b"} Jun 10 12:22:24.047181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.046762 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-76647d756c-skk2f" event={"ID":"c80f6e00-da40-4600-a323-75aa9e43c36a","Type":"ContainerDied","Data":"346ae3ea282fd6bc8622e5bd50409332d4fc317df4a0f9d24b6fc83682bd3ea9"} Jun 10 12:22:24.047181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.046780 2570 scope.go:117] "RemoveContainer" containerID="3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b" Jun 10 12:22:24.056156 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.056136 2570 scope.go:117] "RemoveContainer" containerID="3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b" Jun 10 12:22:24.056494 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:22:24.056473 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b\": container with ID starting with 3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b not found: ID does not exist" containerID="3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b" Jun 10 12:22:24.056544 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.056503 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b"} err="failed to get container status \"3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b\": rpc error: code = NotFound desc = could not find container \"3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b\": container with ID starting with 3e1a4b823ed58a46fffae04dd0f7358943bbf241312cb2041b6462ef41a55c6b not found: ID does not exist" Jun 10 12:22:24.067475 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.067446 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76647d756c-skk2f"] Jun 10 12:22:24.084863 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.084832 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76647d756c-skk2f"] Jun 10 12:22:24.839412 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.839377 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:22:24.936560 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:24.936524 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:22:25.294876 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:25.294840 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c80f6e00-da40-4600-a323-75aa9e43c36a" path="/var/lib/kubelet/pods/c80f6e00-da40-4600-a323-75aa9e43c36a/volumes" Jun 10 12:22:50.386646 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:50.386607 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:22:54.641181 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:22:54.641147 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:23:03.940407 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:03.940371 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:23:13.236696 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:13.236653 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:23:23.328497 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:23.328469 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:23:23.331620 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:23.331596 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:23:23.737114 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:23.737078 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:23:33.230079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:33.230044 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:23:43.333293 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:43.333258 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:23:51.048104 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:51.048071 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:23:52.836603 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.836571 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:23:52.961764 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.961729 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-s4dzd"] Jun 10 12:23:52.962113 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.962101 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c80f6e00-da40-4600-a323-75aa9e43c36a" containerName="authorino" Jun 10 12:23:52.962156 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.962115 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c80f6e00-da40-4600-a323-75aa9e43c36a" containerName="authorino" Jun 10 12:23:52.962191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.962175 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c80f6e00-da40-4600-a323-75aa9e43c36a" containerName="authorino" Jun 10 12:23:52.965221 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.965206 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:52.969242 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.969222 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 10 12:23:52.969450 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.969223 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-krqrk\"" Jun 10 12:23:52.969450 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.969254 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 10 12:23:52.975519 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:52.975498 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-s4dzd"] Jun 10 12:23:53.085141 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.085098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5spm\" (UniqueName: \"kubernetes.io/projected/329f5f09-47e7-496d-b6db-5a9d651f4626-kube-api-access-r5spm\") pod \"maas-controller-c96c4f8d7-s4dzd\" (UID: \"329f5f09-47e7-496d-b6db-5a9d651f4626\") " pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:53.085340 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.085168 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329f5f09-47e7-496d-b6db-5a9d651f4626-webhook-cert\") pod \"maas-controller-c96c4f8d7-s4dzd\" (UID: \"329f5f09-47e7-496d-b6db-5a9d651f4626\") " pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:53.186069 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.186029 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5spm\" (UniqueName: \"kubernetes.io/projected/329f5f09-47e7-496d-b6db-5a9d651f4626-kube-api-access-r5spm\") pod \"maas-controller-c96c4f8d7-s4dzd\" (UID: \"329f5f09-47e7-496d-b6db-5a9d651f4626\") " pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:53.186270 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.186093 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329f5f09-47e7-496d-b6db-5a9d651f4626-webhook-cert\") pod \"maas-controller-c96c4f8d7-s4dzd\" (UID: \"329f5f09-47e7-496d-b6db-5a9d651f4626\") " pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:53.188597 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.188577 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/329f5f09-47e7-496d-b6db-5a9d651f4626-webhook-cert\") pod \"maas-controller-c96c4f8d7-s4dzd\" (UID: \"329f5f09-47e7-496d-b6db-5a9d651f4626\") " pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:53.196520 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.196497 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5spm\" (UniqueName: \"kubernetes.io/projected/329f5f09-47e7-496d-b6db-5a9d651f4626-kube-api-access-r5spm\") pod \"maas-controller-c96c4f8d7-s4dzd\" (UID: \"329f5f09-47e7-496d-b6db-5a9d651f4626\") " pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:53.276137 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.276096 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:53.418423 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.418387 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-c96c4f8d7-s4dzd"] Jun 10 12:23:53.422239 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:23:53.422212 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod329f5f09_47e7_496d_b6db_5a9d651f4626.slice/crio-7d008e3ffe1855fbed0c1e4a63b4c2dd31681868d86e605bd79df83c57c300b7 WatchSource:0}: Error finding container 7d008e3ffe1855fbed0c1e4a63b4c2dd31681868d86e605bd79df83c57c300b7: Status 404 returned error can't find the container with id 7d008e3ffe1855fbed0c1e4a63b4c2dd31681868d86e605bd79df83c57c300b7 Jun 10 12:23:53.489776 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:53.489682 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" event={"ID":"329f5f09-47e7-496d-b6db-5a9d651f4626","Type":"ContainerStarted","Data":"7d008e3ffe1855fbed0c1e4a63b4c2dd31681868d86e605bd79df83c57c300b7"} Jun 10 12:23:56.508327 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:56.508289 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" event={"ID":"329f5f09-47e7-496d-b6db-5a9d651f4626","Type":"ContainerStarted","Data":"ba1abb6059f1fe0f3b78759023d825daa31cce3129cbad3657b6c37a2bd9fb68"} Jun 10 12:23:56.508754 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:56.508431 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:23:56.525046 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:23:56.524997 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" podStartSLOduration=2.050270391 podStartE2EDuration="4.524978992s" totalImagesPullingTime="2.474708601s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:23:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:23:56.524862815 +0000 UTC m=+1233.709984847" watchObservedRunningTime="2026-06-10 12:23:56.524978992 +0000 UTC m=+1233.710101022" Jun 10 12:24:07.518089 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:07.518059 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-c96c4f8d7-s4dzd" Jun 10 12:24:17.638771 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:17.638687 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:24:21.834838 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:21.834776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:24:35.082710 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:35.082675 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:24:35.172019 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:35.171990 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:24:43.600992 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:43.600962 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:24:50.389879 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:50.389849 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:24:50.495485 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:50.495454 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:24:59.235592 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:24:59.235555 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:25:15.535144 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:15.535109 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:25:22.535430 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:22.535395 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:22.634016 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:22.633982 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:29.383894 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:29.383859 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:46.548713 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:46.548634 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:52.753070 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:52.753034 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:52.851882 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:52.851850 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:52.945410 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:52.945376 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:53.094651 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:53.094619 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:53.227852 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:53.227819 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:25:54.038869 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:25:54.038841 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:26:06.086719 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:06.086678 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:09.650765 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:09.650731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:09.777950 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:09.777920 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:09.881077 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:09.881047 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:11.439863 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:11.439823 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:26:15.497748 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:15.497700 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:15.550854 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:15.550825 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:23.647345 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:23.647314 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:23.744303 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:23.744261 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:23.844757 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:23.844725 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:23.945594 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:23.945490 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:25.035130 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:25.035095 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:26:40.402834 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:40.402769 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:40.510148 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:40.510108 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:40.620368 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:40.620337 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:41.337882 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:41.337847 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:26:46.407169 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:46.407134 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:26:46.471421 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:26:46.471396 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:06.941580 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:06.941549 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:07.044969 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:07.044931 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:07.159475 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:07.159434 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:12.895063 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:12.894983 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:12.962821 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:12.962764 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:13.062019 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:13.061977 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:13.200870 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:13.200731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:13.291867 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:13.291763 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:19.030359 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:19.030319 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:19.088627 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:19.088560 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:27:20.038977 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:20.038942 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:27:23.230723 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:23.230684 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:27:45.039733 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:45.039689 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:27:54.436970 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:27:54.436936 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:28:10.835540 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:28:10.835508 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:28:19.828884 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:28:19.828847 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:28:23.363320 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:28:23.363288 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:28:23.367033 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:28:23.367012 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:28:36.639062 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:28:36.639024 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:28:45.128475 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:28:45.128439 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:29:17.730962 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:29:17.730924 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:29:26.337762 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:29:26.337724 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:29:34.440381 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:29:34.440348 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:29:42.928485 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:29:42.928447 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:29:51.336148 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:29:51.336105 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:29:59.529150 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:29:59.529112 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:30:00.133997 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.133957 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684910-h4n5w"] Jun 10 12:30:00.137544 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.137526 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" Jun 10 12:30:00.140003 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.139980 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6tz78\"" Jun 10 12:30:00.149250 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.149229 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684910-h4n5w"] Jun 10 12:30:00.231719 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.231684 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mt5k\" (UniqueName: \"kubernetes.io/projected/294960ba-0158-48d1-98a2-b0c58ed7a12e-kube-api-access-6mt5k\") pod \"maas-api-key-cleanup-29684910-h4n5w\" (UID: \"294960ba-0158-48d1-98a2-b0c58ed7a12e\") " pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" Jun 10 12:30:00.332729 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.332691 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mt5k\" (UniqueName: \"kubernetes.io/projected/294960ba-0158-48d1-98a2-b0c58ed7a12e-kube-api-access-6mt5k\") pod \"maas-api-key-cleanup-29684910-h4n5w\" (UID: \"294960ba-0158-48d1-98a2-b0c58ed7a12e\") " pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" Jun 10 12:30:00.340861 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.340839 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mt5k\" (UniqueName: \"kubernetes.io/projected/294960ba-0158-48d1-98a2-b0c58ed7a12e-kube-api-access-6mt5k\") pod \"maas-api-key-cleanup-29684910-h4n5w\" (UID: \"294960ba-0158-48d1-98a2-b0c58ed7a12e\") " pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" Jun 10 12:30:00.448687 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.448601 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" Jun 10 12:30:00.581689 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.581664 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684910-h4n5w"] Jun 10 12:30:00.584342 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:30:00.584318 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod294960ba_0158_48d1_98a2_b0c58ed7a12e.slice/crio-bb68e9d38bec0eaf7c4f480e78bf6e8438fadd3428aa615df135477e97d45df9 WatchSource:0}: Error finding container bb68e9d38bec0eaf7c4f480e78bf6e8438fadd3428aa615df135477e97d45df9: Status 404 returned error can't find the container with id bb68e9d38bec0eaf7c4f480e78bf6e8438fadd3428aa615df135477e97d45df9 Jun 10 12:30:00.586664 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:00.586648 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:30:01.226135 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:01.226102 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" event={"ID":"294960ba-0158-48d1-98a2-b0c58ed7a12e","Type":"ContainerStarted","Data":"bb68e9d38bec0eaf7c4f480e78bf6e8438fadd3428aa615df135477e97d45df9"} Jun 10 12:30:02.235347 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:02.235308 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:30:05.248421 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:05.248386 2570 generic.go:356] "Generic (PLEG): container finished" podID="294960ba-0158-48d1-98a2-b0c58ed7a12e" containerID="010fcdb2c14b82f59fafedf27fa303a6a9f7d4aeab7c589b3bdd295822aaabff" exitCode=0 Jun 10 12:30:05.248860 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:05.248478 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" event={"ID":"294960ba-0158-48d1-98a2-b0c58ed7a12e","Type":"ContainerDied","Data":"010fcdb2c14b82f59fafedf27fa303a6a9f7d4aeab7c589b3bdd295822aaabff"} Jun 10 12:30:06.381590 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:06.381566 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" Jun 10 12:30:06.486360 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:06.486322 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mt5k\" (UniqueName: \"kubernetes.io/projected/294960ba-0158-48d1-98a2-b0c58ed7a12e-kube-api-access-6mt5k\") pod \"294960ba-0158-48d1-98a2-b0c58ed7a12e\" (UID: \"294960ba-0158-48d1-98a2-b0c58ed7a12e\") " Jun 10 12:30:06.488758 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:06.488727 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/294960ba-0158-48d1-98a2-b0c58ed7a12e-kube-api-access-6mt5k" (OuterVolumeSpecName: "kube-api-access-6mt5k") pod "294960ba-0158-48d1-98a2-b0c58ed7a12e" (UID: "294960ba-0158-48d1-98a2-b0c58ed7a12e"). InnerVolumeSpecName "kube-api-access-6mt5k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:30:06.588075 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:06.587989 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mt5k\" (UniqueName: \"kubernetes.io/projected/294960ba-0158-48d1-98a2-b0c58ed7a12e-kube-api-access-6mt5k\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:30:07.259304 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:07.259275 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" Jun 10 12:30:07.259304 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:07.259300 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684910-h4n5w" event={"ID":"294960ba-0158-48d1-98a2-b0c58ed7a12e","Type":"ContainerDied","Data":"bb68e9d38bec0eaf7c4f480e78bf6e8438fadd3428aa615df135477e97d45df9"} Jun 10 12:30:07.259573 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:07.259344 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bb68e9d38bec0eaf7c4f480e78bf6e8438fadd3428aa615df135477e97d45df9" Jun 10 12:30:08.441701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:08.441668 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:30:20.036084 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:20.036001 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:30:57.132091 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:57.132055 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:30:59.233168 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:30:59.233116 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:06.837750 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:06.837713 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:09.837334 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:09.837292 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:13.188491 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:13.188452 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:31:19.031603 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:19.031570 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:26.641217 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:26.641181 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:36.635339 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:36.635300 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:44.544219 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:44.544133 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:52.840219 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:52.840179 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:31:55.833723 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:31:55.833690 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:32:02.251916 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:32:02.251876 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:32:11.930487 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:32:11.930433 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:32:19.827963 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:32:19.827923 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:32:29.736966 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:32:29.736928 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:32:37.434569 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:32:37.434533 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:32:46.940113 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:32:46.940077 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:32:55.133712 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:32:55.133651 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:33:04.236722 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:33:04.236679 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:33:12.130721 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:33:12.130617 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:33:21.934938 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:33:21.934898 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:33:23.391336 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:33:23.391308 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:33:23.397241 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:33:23.397218 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:33:29.533699 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:33:29.533662 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:34:46.614106 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:34:46.614024 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:34:46.704662 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:34:46.704631 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:35:47.571081 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:35:47.571048 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:35:48.140981 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:35:48.140945 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:35:52.939158 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:35:52.939115 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:36:17.643015 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:36:17.642925 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:36:22.933035 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:36:22.932991 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:36:32.438405 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:36:32.438369 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:36:42.743448 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:36:42.743409 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:36:51.032723 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:36:51.032678 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:37:01.827701 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:37:01.827663 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:37:10.534875 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:37:10.534835 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:37:21.428334 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:37:21.428297 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:37:30.130476 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:37:30.130431 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:37:40.432003 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:37:40.431970 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:37:49.833915 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:37:49.833864 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:37:53.730132 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:37:53.730096 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:38:20.920307 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:38:20.920268 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:38:21.947922 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:38:21.947886 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:38:22.742815 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:38:22.742776 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:38:23.421191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:38:23.421163 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:38:23.427558 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:38:23.427541 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:39:05.331975 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:39:05.331938 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:39:13.331662 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:39:13.331584 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:39:23.732911 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:39:23.732876 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:39:27.579977 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:39:27.579939 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:39:31.426618 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:39:31.426577 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:39:40.906862 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:39:40.906826 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:39:50.629150 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:39:50.629112 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:40:00.737811 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:00.737761 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:40:05.456818 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:05.456761 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:40:05.507517 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:05.507484 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:40:06.529820 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:06.529773 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:40:09.628509 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:09.628471 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:40:17.031324 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:17.031292 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:40:24.539965 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:24.539928 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:40:32.640928 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:32.640885 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:40:43.133493 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:40:43.133414 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:41:00.933916 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:41:00.933880 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:41:10.229480 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:41:10.229437 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:41:18.234521 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:41:18.234485 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:41:26.633148 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:41:26.633107 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:41:44.537705 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:41:44.537677 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:41:52.532823 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:41:52.531497 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:42:00.745882 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:00.745845 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:42:09.735389 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:09.735353 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:42:18.139014 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:18.138929 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:42:26.523856 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:26.523821 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:42:27.534667 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:27.534631 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:42:36.332723 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:36.332685 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:42:47.133371 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:47.133336 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:42:56.042879 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:42:56.042836 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:43:06.630964 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:06.630934 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:43:09.843004 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:09.842970 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:43:16.642245 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:16.642212 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:43:22.933913 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:22.933874 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:43:23.451887 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:23.451862 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:43:23.458094 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:23.458072 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:43:31.231869 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:31.231830 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:43:36.942385 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:36.942351 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:43:53.038409 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:43:53.038329 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:44:01.825427 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:01.825390 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-kpq54"] Jun 10 12:44:10.880358 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.880326 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7"] Jun 10 12:44:10.880869 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.880688 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="294960ba-0158-48d1-98a2-b0c58ed7a12e" containerName="cleanup" Jun 10 12:44:10.880869 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.880699 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="294960ba-0158-48d1-98a2-b0c58ed7a12e" containerName="cleanup" Jun 10 12:44:10.880869 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.880759 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="294960ba-0158-48d1-98a2-b0c58ed7a12e" containerName="cleanup" Jun 10 12:44:10.883955 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.883936 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.886728 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.886704 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-4c0eb0cc-openshift-default-dockercfg-n8lkk\"" Jun 10 12:44:10.887833 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.887813 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 10 12:44:10.903131 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.903109 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7"] Jun 10 12:44:10.938645 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.938614 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:10.948784 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.948741 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-podinfo\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.948924 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.948790 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e61655c-de66-401c-8c27-cd4f0fac0acd-istiod-ca-cert\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.948924 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.948912 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-token\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.949020 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.948941 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz6hn\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-kube-api-access-mz6hn\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.949020 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.948964 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-socket\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.949020 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.948991 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-data\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.949133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.949025 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-credential-socket\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.949133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.949078 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-envoy\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:10.949133 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:10.949118 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-certs\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050158 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050125 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-certs\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050352 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050173 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-podinfo\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050352 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050302 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e61655c-de66-401c-8c27-cd4f0fac0acd-istiod-ca-cert\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050477 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050385 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-token\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050477 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050413 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz6hn\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-kube-api-access-mz6hn\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050477 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050447 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-socket\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050489 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-data\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050506 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-certs\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050550 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-credential-socket\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.050684 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050600 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-envoy\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.051078 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.050951 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-credential-socket\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.051194 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.051168 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e61655c-de66-401c-8c27-cd4f0fac0acd-istiod-ca-cert\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.051364 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.051338 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-data\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.051457 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.051373 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-socket\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.053163 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.053140 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-envoy\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.053243 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.053145 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-podinfo\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.063777 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.063753 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz6hn\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-kube-api-access-mz6hn\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.063983 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.063961 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-token\") pod \"e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.194755 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.194672 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:11.336180 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.336152 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7"] Jun 10 12:44:11.337960 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:44:11.337933 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e61655c_de66_401c_8c27_cd4f0fac0acd.slice/crio-e59e2b2738d0680acb833eb1166f1c6358c681d8fec0630f1d135a711b00dc8e WatchSource:0}: Error finding container e59e2b2738d0680acb833eb1166f1c6358c681d8fec0630f1d135a711b00dc8e: Status 404 returned error can't find the container with id e59e2b2738d0680acb833eb1166f1c6358c681d8fec0630f1d135a711b00dc8e Jun 10 12:44:11.339861 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:11.339842 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 10 12:44:12.035892 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:12.035855 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:12.198433 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:12.198392 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" event={"ID":"2e61655c-de66-401c-8c27-cd4f0fac0acd","Type":"ContainerStarted","Data":"e59e2b2738d0680acb833eb1166f1c6358c681d8fec0630f1d135a711b00dc8e"} Jun 10 12:44:14.638147 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:14.638102 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:15.086893 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:15.086855 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 12:44:15.086969 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:15.086931 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 12:44:15.086969 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:15.086965 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 12:44:15.217096 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:15.217057 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" event={"ID":"2e61655c-de66-401c-8c27-cd4f0fac0acd","Type":"ContainerStarted","Data":"819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c"} Jun 10 12:44:15.241191 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:15.241127 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" podStartSLOduration=1.494584661 podStartE2EDuration="5.241105457s" totalImagesPullingTime="3.746520796s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:44:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:44:15.23757826 +0000 UTC m=+2452.422700303" watchObservedRunningTime="2026-06-10 12:44:15.241105457 +0000 UTC m=+2452.426227489" Jun 10 12:44:16.195013 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:16.194969 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:16.199830 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:16.199788 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:16.222822 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:16.222769 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:16.223860 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:16.223838 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:17.176961 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:17.176925 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:17.338264 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:17.338212 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7"] Jun 10 12:44:17.356934 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:17.356907 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:17.458674 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:17.458576 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:18.231486 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:18.231454 2570 kubelet_pods.go:1082] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" secret="" err="secret \"e2e-ait-4c0eb0cc-openshift-default-dockercfg-n8lkk\" not found" Jun 10 12:44:19.079456 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:19.079423 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:19.236607 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:19.236559 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" podUID="2e61655c-de66-401c-8c27-cd4f0fac0acd" containerName="istio-proxy" containerID="cri-o://819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c" gracePeriod=30 Jun 10 12:44:23.225773 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.225729 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:23.281074 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.281040 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:23.396248 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.396201 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd"] Jun 10 12:44:23.401271 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.401243 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.404212 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.404185 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e048b781-openshift-default-dockercfg-tb9tj\"" Jun 10 12:44:23.407671 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.407645 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd"] Jun 10 12:44:23.426338 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.426301 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:23.473919 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.473867 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-credential-socket\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.473919 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.473915 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-envoy\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.473919 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.473939 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-socket\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.474195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.474014 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-token\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.474195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.474083 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-certs\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.474195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.474127 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-data\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.474195 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.474148 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-podinfo\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.474357 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.474244 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istiod-ca-cert\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.474357 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.474283 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rcrx\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-kube-api-access-6rcrx\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.528844 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.528731 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:23.575010 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.574972 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-data\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575205 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575018 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-podinfo\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575205 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575098 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istiod-ca-cert\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575205 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575132 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rcrx\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-kube-api-access-6rcrx\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575205 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575158 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-credential-socket\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575205 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575179 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-envoy\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575488 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575212 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-socket\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575488 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575249 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-token\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575488 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575316 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-certs\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575669 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575630 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-credential-socket\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575669 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575642 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-socket\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.575824 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.575754 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-data\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.576110 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.576084 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istiod-ca-cert\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.576210 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.576119 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-certs\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.577621 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.577588 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-envoy\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.577922 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.577900 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-podinfo\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.588382 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.588355 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rcrx\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-kube-api-access-6rcrx\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.591657 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.591633 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-token\") pod \"e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.633643 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.633598 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:23.713889 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.713853 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:23.732404 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.732365 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:23.864672 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.864640 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd"] Jun 10 12:44:23.866706 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:44:23.866679 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b9e775_718c_4f7a_abd5_6b171a4ee02a.slice/crio-24666c73a759e4535293f9fc07806c1cdd653dab01e90549498d607871ac612a WatchSource:0}: Error finding container 24666c73a759e4535293f9fc07806c1cdd653dab01e90549498d607871ac612a: Status 404 returned error can't find the container with id 24666c73a759e4535293f9fc07806c1cdd653dab01e90549498d607871ac612a Jun 10 12:44:23.868759 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.868732 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 12:44:23.868859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.868814 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 12:44:23.868859 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:23.868845 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892164Ki","pods":"250"} Jun 10 12:44:24.262545 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.262500 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" event={"ID":"40b9e775-718c-4f7a-abd5-6b171a4ee02a","Type":"ContainerStarted","Data":"586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465"} Jun 10 12:44:24.262938 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.262566 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" event={"ID":"40b9e775-718c-4f7a-abd5-6b171a4ee02a","Type":"ContainerStarted","Data":"24666c73a759e4535293f9fc07806c1cdd653dab01e90549498d607871ac612a"} Jun 10 12:44:24.284020 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.283969 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" podStartSLOduration=1.283951282 podStartE2EDuration="1.283951282s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:44:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:44:24.282749284 +0000 UTC m=+2461.467871376" watchObservedRunningTime="2026-06-10 12:44:24.283951282 +0000 UTC m=+2461.469073313" Jun 10 12:44:24.484011 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.483987 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:24.585720 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.585685 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-certs\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.585904 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.585755 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-socket\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.585904 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.585811 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mz6hn\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-kube-api-access-mz6hn\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.585904 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.585842 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-podinfo\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.586335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586066 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:24.586335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586094 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e61655c-de66-401c-8c27-cd4f0fac0acd-istiod-ca-cert\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.586335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586137 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-data\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.586335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586166 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-credential-socket\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.586335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586210 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-envoy\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.586335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586214 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:24.586335 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586248 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-token\") pod \"2e61655c-de66-401c-8c27-cd4f0fac0acd\" (UID: \"2e61655c-de66-401c-8c27-cd4f0fac0acd\") " Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586436 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586457 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-data" (OuterVolumeSpecName: "istio-data") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586486 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2e61655c-de66-401c-8c27-cd4f0fac0acd-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586600 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2e61655c-de66-401c-8c27-cd4f0fac0acd-istiod-ca-cert\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586617 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-data\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586631 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-credential-socket\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586644 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-certs\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.586740 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.586657 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-workload-socket\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.588846 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.588822 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-kube-api-access-mz6hn" (OuterVolumeSpecName: "kube-api-access-mz6hn") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "kube-api-access-mz6hn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:44:24.589095 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.589066 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:24.589245 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.589226 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-token" (OuterVolumeSpecName: "istio-token") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:44:24.589245 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.589220 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2e61655c-de66-401c-8c27-cd4f0fac0acd" (UID: "2e61655c-de66-401c-8c27-cd4f0fac0acd"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 12:44:24.688134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.688093 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-envoy\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.688134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.688124 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-token\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.688134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.688134 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mz6hn\" (UniqueName: \"kubernetes.io/projected/2e61655c-de66-401c-8c27-cd4f0fac0acd-kube-api-access-mz6hn\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.688134 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.688143 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2e61655c-de66-401c-8c27-cd4f0fac0acd-istio-podinfo\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:24.714301 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.714263 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:24.719350 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:24.719324 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:25.269022 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.268985 2570 generic.go:356] "Generic (PLEG): container finished" podID="2e61655c-de66-401c-8c27-cd4f0fac0acd" containerID="819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c" exitCode=0 Jun 10 12:44:25.269583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.269034 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" Jun 10 12:44:25.269583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.269069 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" event={"ID":"2e61655c-de66-401c-8c27-cd4f0fac0acd","Type":"ContainerDied","Data":"819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c"} Jun 10 12:44:25.269583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.269126 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7" event={"ID":"2e61655c-de66-401c-8c27-cd4f0fac0acd","Type":"ContainerDied","Data":"e59e2b2738d0680acb833eb1166f1c6358c681d8fec0630f1d135a711b00dc8e"} Jun 10 12:44:25.269583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.269150 2570 scope.go:117] "RemoveContainer" containerID="819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c" Jun 10 12:44:25.269583 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.269405 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:25.270606 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.270383 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:25.279324 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.279303 2570 scope.go:117] "RemoveContainer" containerID="819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c" Jun 10 12:44:25.279634 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:44:25.279615 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c\": container with ID starting with 819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c not found: ID does not exist" containerID="819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c" Jun 10 12:44:25.279702 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.279644 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c"} err="failed to get container status \"819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c\": rpc error: code = NotFound desc = could not find container \"819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c\": container with ID starting with 819b1a0238cfa61f86751b4a0ef12e0c5af6417e839a8db75ddaa944d6394b8c not found: ID does not exist" Jun 10 12:44:25.308792 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.308755 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7"] Jun 10 12:44:25.311910 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:25.311882 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-4c0eb0cc-openshift-default-558d75cc78-sksk7"] Jun 10 12:44:26.775430 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:26.775394 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:27.293665 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:27.293632 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e61655c-de66-401c-8c27-cd4f0fac0acd" path="/var/lib/kubelet/pods/2e61655c-de66-401c-8c27-cd4f0fac0acd/volumes" Jun 10 12:44:29.686638 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:29.686608 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:30.887494 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:30.887462 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd"] Jun 10 12:44:30.887932 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:30.887637 2570 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" podUID="40b9e775-718c-4f7a-abd5-6b171a4ee02a" containerName="istio-proxy" containerID="cri-o://586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465" gracePeriod=30 Jun 10 12:44:30.911445 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:30.911408 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:31.016164 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:31.016133 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:33.772906 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:33.772859 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:36.138515 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.138491 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:36.292336 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292231 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-socket\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292336 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292284 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-data\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292336 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292307 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-certs\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292336 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292331 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-envoy\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292352 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6rcrx\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-kube-api-access-6rcrx\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292380 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-podinfo\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292457 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istiod-ca-cert\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292505 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-token\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292528 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-credential-socket\") pod \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\" (UID: \"40b9e775-718c-4f7a-abd5-6b171a4ee02a\") " Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292543 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292663 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-data" (OuterVolumeSpecName: "istio-data") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:36.292692 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292668 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:36.293079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292907 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-socket\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.293079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292929 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-data\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.293079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292944 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-workload-certs\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.293079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292957 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:36.293079 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.292967 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 10 12:44:36.294750 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.294715 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 10 12:44:36.294882 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.294855 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jun 10 12:44:36.295308 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.295284 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-token" (OuterVolumeSpecName: "istio-token") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:44:36.295409 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.295316 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-kube-api-access-6rcrx" (OuterVolumeSpecName: "kube-api-access-6rcrx") pod "40b9e775-718c-4f7a-abd5-6b171a4ee02a" (UID: "40b9e775-718c-4f7a-abd5-6b171a4ee02a"). InnerVolumeSpecName "kube-api-access-6rcrx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:44:36.323484 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.323442 2570 generic.go:356] "Generic (PLEG): container finished" podID="40b9e775-718c-4f7a-abd5-6b171a4ee02a" containerID="586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465" exitCode=0 Jun 10 12:44:36.323663 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.323506 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" Jun 10 12:44:36.323663 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.323491 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" event={"ID":"40b9e775-718c-4f7a-abd5-6b171a4ee02a","Type":"ContainerDied","Data":"586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465"} Jun 10 12:44:36.323663 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.323641 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd" event={"ID":"40b9e775-718c-4f7a-abd5-6b171a4ee02a","Type":"ContainerDied","Data":"24666c73a759e4535293f9fc07806c1cdd653dab01e90549498d607871ac612a"} Jun 10 12:44:36.323787 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.323665 2570 scope.go:117] "RemoveContainer" containerID="586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465" Jun 10 12:44:36.333380 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.333359 2570 scope.go:117] "RemoveContainer" containerID="586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465" Jun 10 12:44:36.333676 ip-10-0-130-187 kubenswrapper[2570]: E0610 12:44:36.333656 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465\": container with ID starting with 586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465 not found: ID does not exist" containerID="586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465" Jun 10 12:44:36.333726 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.333684 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465"} err="failed to get container status \"586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465\": rpc error: code = NotFound desc = could not find container \"586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465\": container with ID starting with 586e170e109c934914e44f2adab210c1929d1e54e0f98ed93090ac04ee999465 not found: ID does not exist" Jun 10 12:44:36.345250 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.345221 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd"] Jun 10 12:44:36.349374 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.349351 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e048b781-openshift-default-658bf8cdcb-mmdpd"] Jun 10 12:44:36.394125 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.394087 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-envoy\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.394125 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.394113 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6rcrx\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-kube-api-access-6rcrx\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.394125 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.394125 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-podinfo\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.394125 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.394136 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istiod-ca-cert\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.394408 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.394145 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/40b9e775-718c-4f7a-abd5-6b171a4ee02a-istio-token\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:36.394408 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:36.394153 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/40b9e775-718c-4f7a-abd5-6b171a4ee02a-credential-socket\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:44:37.008728 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:37.008694 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:37.108822 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:37.108759 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:37.294159 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:37.294081 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="40b9e775-718c-4f7a-abd5-6b171a4ee02a" path="/var/lib/kubelet/pods/40b9e775-718c-4f7a-abd5-6b171a4ee02a/volumes" Jun 10 12:44:43.368721 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:43.368685 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bdf5bcd-ffz8t_33073c53-486e-4bb4-bf58-26ab103cb556/authorino/0.log" Jun 10 12:44:48.490729 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:48.490695 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684910-h4n5w_294960ba-0158-48d1-98a2-b0c58ed7a12e/cleanup/0.log" Jun 10 12:44:48.618193 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:48.618145 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c96c4f8d7-s4dzd_329f5f09-47e7-496d-b6db-5a9d651f4626/manager/0.log" Jun 10 12:44:49.106762 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:49.106735 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-nz6tb_211b17bb-0cdb-465c-9ace-7a2bbc27e1b6/copy-manifests/0.log" Jun 10 12:44:49.112977 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:49.112947 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-nz6tb_211b17bb-0cdb-465c-9ace-7a2bbc27e1b6/manager/0.log" Jun 10 12:44:50.614562 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:50.614529 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bdf5bcd-ffz8t_33073c53-486e-4bb4-bf58-26ab103cb556/authorino/0.log" Jun 10 12:44:50.748494 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:50.748460 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hw4f5_acb35a88-d9d1-4f8a-9aa4-d449e72d97cc/manager/0.log" Jun 10 12:44:50.866063 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:50.865978 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qxltb_840503ff-9407-4d62-83d3-6978458db083/manager/0.log" Jun 10 12:44:51.366030 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:51.365999 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kpq54_c60f366d-cb72-4137-8cbc-c04d015cb3d9/limitador/0.log" Jun 10 12:44:52.066194 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:52.066164 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8bf6cd9c-pthgr_3bd77963-03a0-459a-94a0-8f2a609dd0cf/kube-auth-proxy/0.log" Jun 10 12:44:52.643575 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:52.643543 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f4f846567-6kjch_5c61422f-6027-41db-bf1a-5f8ff40d946e/router/0.log" Jun 10 12:44:57.584972 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.584929 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4t8h/must-gather-245px"] Jun 10 12:44:57.585523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.585290 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e61655c-de66-401c-8c27-cd4f0fac0acd" containerName="istio-proxy" Jun 10 12:44:57.585523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.585302 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e61655c-de66-401c-8c27-cd4f0fac0acd" containerName="istio-proxy" Jun 10 12:44:57.585523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.585318 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40b9e775-718c-4f7a-abd5-6b171a4ee02a" containerName="istio-proxy" Jun 10 12:44:57.585523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.585323 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="40b9e775-718c-4f7a-abd5-6b171a4ee02a" containerName="istio-proxy" Jun 10 12:44:57.585523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.585388 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e61655c-de66-401c-8c27-cd4f0fac0acd" containerName="istio-proxy" Jun 10 12:44:57.585523 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.585400 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="40b9e775-718c-4f7a-abd5-6b171a4ee02a" containerName="istio-proxy" Jun 10 12:44:57.588459 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.588437 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:57.590967 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.590924 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4t8h\"/\"openshift-service-ca.crt\"" Jun 10 12:44:57.590967 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.590924 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-x4t8h\"/\"default-dockercfg-zmzdp\"" Jun 10 12:44:57.592029 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.592013 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-x4t8h\"/\"kube-root-ca.crt\"" Jun 10 12:44:57.596110 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.596089 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:57.596977 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.596954 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4t8h/must-gather-245px"] Jun 10 12:44:57.685067 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.685032 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl8n7\" (UniqueName: \"kubernetes.io/projected/d09edf2e-0697-4ef0-a491-abc60d371afb-kube-api-access-zl8n7\") pod \"must-gather-245px\" (UID: \"d09edf2e-0697-4ef0-a491-abc60d371afb\") " pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:57.685259 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.685089 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d09edf2e-0697-4ef0-a491-abc60d371afb-must-gather-output\") pod \"must-gather-245px\" (UID: \"d09edf2e-0697-4ef0-a491-abc60d371afb\") " pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:57.690506 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.690478 2570 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" limit=1024 Jun 10 12:44:57.786122 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.786091 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl8n7\" (UniqueName: \"kubernetes.io/projected/d09edf2e-0697-4ef0-a491-abc60d371afb-kube-api-access-zl8n7\") pod \"must-gather-245px\" (UID: \"d09edf2e-0697-4ef0-a491-abc60d371afb\") " pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:57.786300 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.786153 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d09edf2e-0697-4ef0-a491-abc60d371afb-must-gather-output\") pod \"must-gather-245px\" (UID: \"d09edf2e-0697-4ef0-a491-abc60d371afb\") " pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:57.786510 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.786490 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/d09edf2e-0697-4ef0-a491-abc60d371afb-must-gather-output\") pod \"must-gather-245px\" (UID: \"d09edf2e-0697-4ef0-a491-abc60d371afb\") " pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:57.795188 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.795157 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl8n7\" (UniqueName: \"kubernetes.io/projected/d09edf2e-0697-4ef0-a491-abc60d371afb-kube-api-access-zl8n7\") pod \"must-gather-245px\" (UID: \"d09edf2e-0697-4ef0-a491-abc60d371afb\") " pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:57.898220 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:57.898187 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4t8h/must-gather-245px" Jun 10 12:44:58.061125 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:58.061101 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4t8h/must-gather-245px"] Jun 10 12:44:58.062600 ip-10-0-130-187 kubenswrapper[2570]: W0610 12:44:58.062573 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd09edf2e_0697_4ef0_a491_abc60d371afb.slice/crio-0d092e7620acc84adf0a88b2e409911169f634975b9dfaf56ae9467cda462747 WatchSource:0}: Error finding container 0d092e7620acc84adf0a88b2e409911169f634975b9dfaf56ae9467cda462747: Status 404 returned error can't find the container with id 0d092e7620acc84adf0a88b2e409911169f634975b9dfaf56ae9467cda462747 Jun 10 12:44:58.433984 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:58.433951 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4t8h/must-gather-245px" event={"ID":"d09edf2e-0697-4ef0-a491-abc60d371afb","Type":"ContainerStarted","Data":"0d092e7620acc84adf0a88b2e409911169f634975b9dfaf56ae9467cda462747"} Jun 10 12:44:59.441958 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:59.441908 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4t8h/must-gather-245px" event={"ID":"d09edf2e-0697-4ef0-a491-abc60d371afb","Type":"ContainerStarted","Data":"6fa4ea10f8de37b8237455959487efbe67f695232967840985ebe024baf126eb"} Jun 10 12:44:59.442452 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:59.441974 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4t8h/must-gather-245px" event={"ID":"d09edf2e-0697-4ef0-a491-abc60d371afb","Type":"ContainerStarted","Data":"f4501b61480ad476eb9585ffee2f749440e18410e5351489be4e6d339f6b8f29"} Jun 10 12:44:59.458610 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:44:59.458544 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x4t8h/must-gather-245px" podStartSLOduration=1.584004968 podStartE2EDuration="2.458522846s" totalImagesPullingTime="874.517878ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:44:59.456969794 +0000 UTC m=+2496.642091826" watchObservedRunningTime="2026-06-10 12:44:59.458522846 +0000 UTC m=+2496.643644878" Jun 10 12:45:00.141217 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.141179 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29684925-9wgh7"] Jun 10 12:45:00.147336 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.147296 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" Jun 10 12:45:00.150435 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.150403 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6tz78\"" Jun 10 12:45:00.151681 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.151626 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684925-9wgh7"] Jun 10 12:45:00.210369 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.210321 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtrg4\" (UniqueName: \"kubernetes.io/projected/86c684a7-98c5-47a1-85c6-44b075e22b4a-kube-api-access-mtrg4\") pod \"maas-api-key-cleanup-29684925-9wgh7\" (UID: \"86c684a7-98c5-47a1-85c6-44b075e22b4a\") " pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" Jun 10 12:45:00.311470 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.311414 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtrg4\" (UniqueName: \"kubernetes.io/projected/86c684a7-98c5-47a1-85c6-44b075e22b4a-kube-api-access-mtrg4\") pod \"maas-api-key-cleanup-29684925-9wgh7\" (UID: \"86c684a7-98c5-47a1-85c6-44b075e22b4a\") " pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" Jun 10 12:45:00.323009 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.322979 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtrg4\" (UniqueName: \"kubernetes.io/projected/86c684a7-98c5-47a1-85c6-44b075e22b4a-kube-api-access-mtrg4\") pod \"maas-api-key-cleanup-29684925-9wgh7\" (UID: \"86c684a7-98c5-47a1-85c6-44b075e22b4a\") " pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" Jun 10 12:45:00.462458 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.462363 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" Jun 10 12:45:00.650042 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.649331 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29684925-9wgh7"] Jun 10 12:45:00.810558 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.810482 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wrm7q_1ae17e37-e449-4ebe-b49a-fb6cfa53dcaa/global-pull-secret-syncer/0.log" Jun 10 12:45:00.864056 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.863969 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ft8pz_95e58e6b-53ef-4b91-b4a3-1724e9cf4f62/konnectivity-agent/0.log" Jun 10 12:45:00.936862 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:00.936829 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-187.ec2.internal_c260edd97696a65a12fb99bc6379a012/haproxy/0.log" Jun 10 12:45:01.457509 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:01.457470 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" event={"ID":"86c684a7-98c5-47a1-85c6-44b075e22b4a","Type":"ContainerStarted","Data":"8948b1f0d17c9897ae64f293a56f4659a9ef2a78aa8b7532c4b6a19f68f20350"} Jun 10 12:45:01.457708 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:01.457537 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" event={"ID":"86c684a7-98c5-47a1-85c6-44b075e22b4a","Type":"ContainerStarted","Data":"13a943e97c97c1b015b9db9563b4fbf7a252e3e01da3fa0cb170b87a58e2d1b6"} Jun 10 12:45:01.474012 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:01.473948 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" podStartSLOduration=1.473929092 podStartE2EDuration="1.473929092s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 12:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:45:01.473176424 +0000 UTC m=+2498.658298455" watchObservedRunningTime="2026-06-10 12:45:01.473929092 +0000 UTC m=+2498.659051127" Jun 10 12:45:02.466669 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:02.466627 2570 generic.go:356] "Generic (PLEG): container finished" podID="86c684a7-98c5-47a1-85c6-44b075e22b4a" containerID="8948b1f0d17c9897ae64f293a56f4659a9ef2a78aa8b7532c4b6a19f68f20350" exitCode=0 Jun 10 12:45:02.467704 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:02.467670 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" event={"ID":"86c684a7-98c5-47a1-85c6-44b075e22b4a","Type":"ContainerDied","Data":"8948b1f0d17c9897ae64f293a56f4659a9ef2a78aa8b7532c4b6a19f68f20350"} Jun 10 12:45:03.823653 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:03.823575 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" Jun 10 12:45:03.948822 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:03.948760 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mtrg4\" (UniqueName: \"kubernetes.io/projected/86c684a7-98c5-47a1-85c6-44b075e22b4a-kube-api-access-mtrg4\") pod \"86c684a7-98c5-47a1-85c6-44b075e22b4a\" (UID: \"86c684a7-98c5-47a1-85c6-44b075e22b4a\") " Jun 10 12:45:03.960821 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:03.955077 2570 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86c684a7-98c5-47a1-85c6-44b075e22b4a-kube-api-access-mtrg4" (OuterVolumeSpecName: "kube-api-access-mtrg4") pod "86c684a7-98c5-47a1-85c6-44b075e22b4a" (UID: "86c684a7-98c5-47a1-85c6-44b075e22b4a"). InnerVolumeSpecName "kube-api-access-mtrg4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 10 12:45:04.051346 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:04.051250 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mtrg4\" (UniqueName: \"kubernetes.io/projected/86c684a7-98c5-47a1-85c6-44b075e22b4a-kube-api-access-mtrg4\") on node \"ip-10-0-130-187.ec2.internal\" DevicePath \"\"" Jun 10 12:45:04.482510 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:04.482466 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" event={"ID":"86c684a7-98c5-47a1-85c6-44b075e22b4a","Type":"ContainerDied","Data":"13a943e97c97c1b015b9db9563b4fbf7a252e3e01da3fa0cb170b87a58e2d1b6"} Jun 10 12:45:04.482921 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:04.482532 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="13a943e97c97c1b015b9db9563b4fbf7a252e3e01da3fa0cb170b87a58e2d1b6" Jun 10 12:45:04.482921 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:04.482594 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29684925-9wgh7" Jun 10 12:45:05.641949 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:05.641901 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-68bdf5bcd-ffz8t_33073c53-486e-4bb4-bf58-26ab103cb556/authorino/0.log" Jun 10 12:45:05.705742 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:05.705697 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-hw4f5_acb35a88-d9d1-4f8a-9aa4-d449e72d97cc/manager/0.log" Jun 10 12:45:05.780829 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:05.780782 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qxltb_840503ff-9407-4d62-83d3-6978458db083/manager/0.log" Jun 10 12:45:05.926729 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:05.926639 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-kpq54_c60f366d-cb72-4137-8cbc-c04d015cb3d9/limitador/0.log" Jun 10 12:45:07.945940 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:07.945853 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-576dbbfd99-sjzf4_08669458-8a33-42e7-9376-d9a44fd17d6e/metrics-server/0.log" Jun 10 12:45:07.970027 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:07.969991 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-zqxkc_fe5c2316-2f48-4d0f-acad-c39afabd9921/monitoring-plugin/0.log" Jun 10 12:45:08.076378 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.076346 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94jr9_51792456-a057-4104-9600-469998d3c8e1/node-exporter/0.log" Jun 10 12:45:08.096664 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.096634 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94jr9_51792456-a057-4104-9600-469998d3c8e1/kube-rbac-proxy/0.log" Jun 10 12:45:08.118354 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.118329 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-94jr9_51792456-a057-4104-9600-469998d3c8e1/init-textfile/0.log" Jun 10 12:45:08.212268 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.212189 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mlkth_c44e9da2-1bba-4245-8813-9f4da5abee38/kube-rbac-proxy-main/0.log" Jun 10 12:45:08.234728 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.234702 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mlkth_c44e9da2-1bba-4245-8813-9f4da5abee38/kube-rbac-proxy-self/0.log" Jun 10 12:45:08.263759 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.263726 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-mlkth_c44e9da2-1bba-4245-8813-9f4da5abee38/openshift-state-metrics/0.log" Jun 10 12:45:08.310716 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.310690 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b/prometheus/0.log" Jun 10 12:45:08.330868 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.330843 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b/config-reloader/0.log" Jun 10 12:45:08.348932 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.348898 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b/thanos-sidecar/0.log" Jun 10 12:45:08.368413 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.368323 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b/kube-rbac-proxy-web/0.log" Jun 10 12:45:08.389081 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.389009 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b/kube-rbac-proxy/0.log" Jun 10 12:45:08.407041 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.407005 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b/kube-rbac-proxy-thanos/0.log" Jun 10 12:45:08.424090 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.424065 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5d4794c5-dfd9-4b5f-bdfa-fc9f83a7049b/init-config-reloader/0.log" Jun 10 12:45:08.486862 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.486737 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-5b6b8f594-2r2dm_b5515201-6dc7-439c-aa69-e94ff6294bff/prometheus-operator-admission-webhook/0.log" Jun 10 12:45:08.587426 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.587396 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/thanos-query/0.log" Jun 10 12:45:08.607373 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.607341 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy-web/0.log" Jun 10 12:45:08.629715 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.629664 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy/0.log" Jun 10 12:45:08.651991 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.651963 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/prom-label-proxy/0.log" Jun 10 12:45:08.667607 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.667579 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy-rules/0.log" Jun 10 12:45:08.689963 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:08.689937 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7f996959f9-5bqr9_68fb034e-616f-4879-a50c-65dfafd92703/kube-rbac-proxy-metrics/0.log" Jun 10 12:45:10.554139 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:10.554105 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-c72g9_a4d0b892-d331-48b5-8a1d-126f81f4aba0/networking-console-plugin/0.log" Jun 10 12:45:13.617451 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.617420 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65"] Jun 10 12:45:13.618661 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.618636 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86c684a7-98c5-47a1-85c6-44b075e22b4a" containerName="cleanup" Jun 10 12:45:13.618831 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.618818 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="86c684a7-98c5-47a1-85c6-44b075e22b4a" containerName="cleanup" Jun 10 12:45:13.619032 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.619019 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="86c684a7-98c5-47a1-85c6-44b075e22b4a" containerName="cleanup" Jun 10 12:45:13.629177 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.629152 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.630963 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.630923 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65"] Jun 10 12:45:13.704875 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.704839 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wx2n_28f58d87-88fb-41e4-9ef4-31bab030a6b8/dns/0.log" Jun 10 12:45:13.723474 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.723415 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-2wx2n_28f58d87-88fb-41e4-9ef4-31bab030a6b8/kube-rbac-proxy/0.log" Jun 10 12:45:13.765080 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.765045 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-lib-modules\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.765232 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.765104 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-sys\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.765232 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.765131 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-proc\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.765232 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.765158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x26c2\" (UniqueName: \"kubernetes.io/projected/5d3430cd-9752-49fc-af5d-ec4380b739d6-kube-api-access-x26c2\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.765232 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.765188 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-podres\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.842709 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.842677 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-5mjvb_7e496a51-4b3f-4df5-8001-ff39c586db50/dns-node-resolver/0.log" Jun 10 12:45:13.866049 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866017 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-lib-modules\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866073 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-sys\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866096 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-proc\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866118 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x26c2\" (UniqueName: \"kubernetes.io/projected/5d3430cd-9752-49fc-af5d-ec4380b739d6-kube-api-access-x26c2\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866144 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-podres\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866168 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-sys\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866244 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866215 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-lib-modules\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866477 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866271 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-podres\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.866540 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.866518 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5d3430cd-9752-49fc-af5d-ec4380b739d6-proc\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.874196 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.874075 2570 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x26c2\" (UniqueName: \"kubernetes.io/projected/5d3430cd-9752-49fc-af5d-ec4380b739d6-kube-api-access-x26c2\") pod \"perf-node-gather-daemonset-s5v65\" (UID: \"5d3430cd-9752-49fc-af5d-ec4380b739d6\") " pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:13.943721 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:13.943690 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:14.113607 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:14.113576 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65"] Jun 10 12:45:14.435100 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:14.434998 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wmrbk_4fe40800-cc65-44ed-9482-c8f9b9f7aeb5/node-ca/0.log" Jun 10 12:45:14.558999 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:14.558957 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" event={"ID":"5d3430cd-9752-49fc-af5d-ec4380b739d6","Type":"ContainerStarted","Data":"88061253208a13564448a8f5f86f57926cec9e874a71c9caed4b4b3ef1ce3d7d"} Jun 10 12:45:14.559199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:14.559018 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" event={"ID":"5d3430cd-9752-49fc-af5d-ec4380b739d6","Type":"ContainerStarted","Data":"fcac412d6cda3be37147960c9ac398c5a11f9c36c979d3ac19909a99d449a5e4"} Jun 10 12:45:14.559199 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:14.559098 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:14.575980 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:14.575926 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" podStartSLOduration=1.575909204 podStartE2EDuration="1.575909204s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 12:45:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 12:45:14.574209884 +0000 UTC m=+2511.759331916" watchObservedRunningTime="2026-06-10 12:45:14.575909204 +0000 UTC m=+2511.761031236" Jun 10 12:45:15.416532 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:15.416501 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8bf6cd9c-pthgr_3bd77963-03a0-459a-94a0-8f2a609dd0cf/kube-auth-proxy/0.log" Jun 10 12:45:15.590096 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:15.590059 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f4f846567-6kjch_5c61422f-6027-41db-bf1a-5f8ff40d946e/router/0.log" Jun 10 12:45:16.188652 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:16.188613 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6fkp9_853bb5c4-9b76-46e2-b48e-925fbb772f20/serve-healthcheck-canary/0.log" Jun 10 12:45:16.828586 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:16.828554 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n5ctw_2d6c4da2-930c-4017-99cf-82613151a539/kube-rbac-proxy/0.log" Jun 10 12:45:16.843935 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:16.843907 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n5ctw_2d6c4da2-930c-4017-99cf-82613151a539/exporter/0.log" Jun 10 12:45:16.862425 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:16.862395 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-n5ctw_2d6c4da2-930c-4017-99cf-82613151a539/extractor/0.log" Jun 10 12:45:19.206302 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:19.206266 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684910-h4n5w_294960ba-0158-48d1-98a2-b0c58ed7a12e/cleanup/0.log" Jun 10 12:45:19.227196 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:19.227163 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29684925-9wgh7_86c684a7-98c5-47a1-85c6-44b075e22b4a/cleanup/0.log" Jun 10 12:45:19.346077 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:19.346037 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-c96c4f8d7-s4dzd_329f5f09-47e7-496d-b6db-5a9d651f4626/manager/0.log" Jun 10 12:45:19.542272 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:19.542166 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-nz6tb_211b17bb-0cdb-465c-9ace-7a2bbc27e1b6/manager/0.log" Jun 10 12:45:19.557090 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:19.557061 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-999b5c76b-nz6tb_211b17bb-0cdb-465c-9ace-7a2bbc27e1b6/copy-manifests/0.log" Jun 10 12:45:20.578102 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:20.578074 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-x4t8h/perf-node-gather-daemonset-s5v65" Jun 10 12:45:21.070587 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:21.070556 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dcc5f6999-8qvv7_7bfc3868-173c-460e-850f-32a7d08493ff/manager/0.log" Jun 10 12:45:26.438675 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:26.438643 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-t5z6h_ef24ac79-a0d8-4a67-884f-4f4e425032c9/migrator/0.log" Jun 10 12:45:26.454268 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:26.454238 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-t5z6h_ef24ac79-a0d8-4a67-884f-4f4e425032c9/graceful-termination/0.log" Jun 10 12:45:26.499311 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:26.499278 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8bf6cd9c-pthgr_3bd77963-03a0-459a-94a0-8f2a609dd0cf/kube-auth-proxy/0.log" Jun 10 12:45:26.646371 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:26.646336 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f4f846567-6kjch_5c61422f-6027-41db-bf1a-5f8ff40d946e/router/0.log" Jun 10 12:45:26.888539 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:26.888507 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mnfbm_69d9b5fb-8853-48c2-b06d-213ec935c98d/kube-storage-version-migrator-operator/1.log" Jun 10 12:45:26.890413 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:26.890383 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-mnfbm_69d9b5fb-8853-48c2-b06d-213ec935c98d/kube-storage-version-migrator-operator/0.log" Jun 10 12:45:27.841298 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:27.841269 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8bf6cd9c-pthgr_3bd77963-03a0-459a-94a0-8f2a609dd0cf/kube-auth-proxy/0.log" Jun 10 12:45:27.999902 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:27.999867 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f4f846567-6kjch_5c61422f-6027-41db-bf1a-5f8ff40d946e/router/0.log" Jun 10 12:45:28.442041 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.442014 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdf85_ed88afa3-143b-4f7e-928c-5734df568c17/kube-multus-additional-cni-plugins/0.log" Jun 10 12:45:28.459403 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.459375 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdf85_ed88afa3-143b-4f7e-928c-5734df568c17/egress-router-binary-copy/0.log" Jun 10 12:45:28.480844 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.480818 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdf85_ed88afa3-143b-4f7e-928c-5734df568c17/cni-plugins/0.log" Jun 10 12:45:28.497129 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.497100 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdf85_ed88afa3-143b-4f7e-928c-5734df568c17/bond-cni-plugin/0.log" Jun 10 12:45:28.514419 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.514392 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdf85_ed88afa3-143b-4f7e-928c-5734df568c17/routeoverride-cni/0.log" Jun 10 12:45:28.530731 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.530705 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdf85_ed88afa3-143b-4f7e-928c-5734df568c17/whereabouts-cni-bincopy/0.log" Jun 10 12:45:28.547443 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.547367 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-wdf85_ed88afa3-143b-4f7e-928c-5734df568c17/whereabouts-cni/0.log" Jun 10 12:45:28.609497 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.609470 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-qpb9m_0ede99d5-75f9-403c-a97c-d8a2032a2006/kube-multus/0.log" Jun 10 12:45:28.691528 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.691501 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ftjkg_bcc7c99d-f825-448b-be78-6cc93f5c93df/network-metrics-daemon/0.log" Jun 10 12:45:28.705552 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:28.705484 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ftjkg_bcc7c99d-f825-448b-be78-6cc93f5c93df/kube-rbac-proxy/0.log" Jun 10 12:45:29.673916 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.673886 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-5c8bf6cd9c-pthgr_3bd77963-03a0-459a-94a0-8f2a609dd0cf/kube-auth-proxy/0.log" Jun 10 12:45:29.823944 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.823918 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-controller/0.log" Jun 10 12:45:29.829628 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.829595 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6f4f846567-6kjch_5c61422f-6027-41db-bf1a-5f8ff40d946e/router/0.log" Jun 10 12:45:29.836747 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.836724 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/1.log" Jun 10 12:45:29.836966 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.836728 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovn-acl-logging/0.log" Jun 10 12:45:29.856675 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.856640 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/kube-rbac-proxy-node/0.log" Jun 10 12:45:29.879755 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.879721 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/kube-rbac-proxy-ovn-metrics/0.log" Jun 10 12:45:29.897834 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.897777 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/northd/0.log" Jun 10 12:45:29.918042 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.918011 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/nbdb/0.log" Jun 10 12:45:29.935354 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.935268 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/sbdb/0.log" Jun 10 12:45:29.999719 ip-10-0-130-187 kubenswrapper[2570]: I0610 12:45:29.999687 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-hptlr_2f865afd-f97c-4c75-8ae0-5866b7df2e53/ovnkube-controller/0.log"