Jun 15 07:46:12.058106 ip-10-0-143-10 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 15 07:46:12.058118 ip-10-0-143-10 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 15 07:46:12.058125 ip-10-0-143-10 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 15 07:46:12.058350 ip-10-0-143-10 systemd[1]: Failed to start Kubernetes Kubelet. Jun 15 07:46:22.280600 ip-10-0-143-10 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 15 07:46:22.280622 ip-10-0-143-10 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 74d2a7dcfaa8422c94602abc9e44565c -- Jun 15 07:48:48.359839 ip-10-0-143-10 systemd[1]: Starting Kubernetes Kubelet... Jun 15 07:48:48.774505 ip-10-0-143-10 kubenswrapper[2569]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 07:48:48.774505 ip-10-0-143-10 kubenswrapper[2569]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 15 07:48:48.774505 ip-10-0-143-10 kubenswrapper[2569]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 07:48:48.774505 ip-10-0-143-10 kubenswrapper[2569]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 15 07:48:48.774505 ip-10-0-143-10 kubenswrapper[2569]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 15 07:48:48.775139 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.774520 2569 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 15 07:48:48.779910 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779892 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 07:48:48.779910 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779908 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 07:48:48.779910 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779912 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779915 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779919 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779923 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779926 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779932 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779935 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779938 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779941 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779943 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779946 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779949 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779951 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779954 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779956 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779959 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779961 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779964 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779967 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779969 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 07:48:48.780006 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779972 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779974 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779976 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779979 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779982 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779986 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779991 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779994 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779997 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.779999 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780002 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780005 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780007 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780010 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780013 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780017 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780020 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780023 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780026 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780029 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 15 07:48:48.780531 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780031 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780034 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780037 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780039 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780042 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780044 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780047 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780049 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780052 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780054 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780057 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780060 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780062 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780065 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780068 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780071 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780074 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780076 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780079 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 07:48:48.781041 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780082 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780085 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780087 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780089 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780092 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780095 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780097 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780100 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780102 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780105 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780108 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780112 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780116 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780120 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780123 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780126 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780128 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780131 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780133 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 07:48:48.781512 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780136 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780138 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780141 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780143 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780146 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780148 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780151 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780153 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780157 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780159 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780162 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780165 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780167 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780170 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780173 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780176 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780178 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780181 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780183 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780877 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 07:48:48.781985 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780884 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780887 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780889 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780892 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780895 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780898 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780902 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780904 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780907 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780911 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780914 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780917 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780920 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780923 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780925 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780928 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780931 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780933 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780936 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 07:48:48.782519 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780940 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780943 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780946 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780949 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780951 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780954 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780957 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780959 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780962 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780965 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780967 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780970 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780973 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780975 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780978 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780981 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780983 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780986 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780989 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 07:48:48.783021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780991 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780994 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.780997 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781000 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781002 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781005 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781007 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781010 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781013 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781015 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781018 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781020 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781023 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781026 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781028 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781031 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781033 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781036 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781039 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781042 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 07:48:48.783507 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781045 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781047 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781050 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781053 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781058 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781062 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781065 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781067 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781070 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781073 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781076 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781078 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781080 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781083 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781091 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781094 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781096 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781099 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781102 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 07:48:48.784008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781105 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781107 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781110 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781113 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781115 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781117 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781120 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781123 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781125 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781128 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781130 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781133 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781135 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781140 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781143 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781146 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781149 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781152 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781154 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781157 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 07:48:48.784491 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781160 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781518 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781524 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781527 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781530 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781533 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781536 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781540 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781543 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781546 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781549 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781552 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781555 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781558 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781560 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781563 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781566 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781568 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781571 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781574 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 07:48:48.784996 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781576 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781579 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781581 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781584 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781586 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781589 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781592 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781594 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781596 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781599 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781601 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781603 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781607 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781611 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781615 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781618 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781621 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781624 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781627 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781629 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 07:48:48.785493 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781633 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781635 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781638 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781640 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781643 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781645 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781648 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781650 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781653 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781655 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781658 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781660 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781662 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781665 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781667 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781670 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781672 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781675 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781677 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781680 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 07:48:48.786021 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781682 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781685 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781690 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781692 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781695 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781698 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781703 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781705 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781708 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781710 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781713 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781716 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781718 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781721 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781724 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781726 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781729 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781731 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781734 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781736 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 07:48:48.786535 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781739 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781742 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781744 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781746 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781749 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781751 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781755 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781758 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781761 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781764 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781766 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781769 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781772 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781774 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781778 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781781 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781783 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781786 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781788 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 07:48:48.787008 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.781794 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781860 2569 flags.go:64] FLAG: --address="0.0.0.0" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781866 2569 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781875 2569 flags.go:64] FLAG: --anonymous-auth="true" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781880 2569 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781883 2569 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781887 2569 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781892 2569 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781896 2569 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781899 2569 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781901 2569 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781905 2569 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781908 2569 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781911 2569 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781914 2569 flags.go:64] FLAG: --cgroup-root="" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781917 2569 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781919 2569 flags.go:64] FLAG: --client-ca-file="" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781922 2569 flags.go:64] FLAG: --cloud-provider="external" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781925 2569 flags.go:64] FLAG: --cluster-dns="[]" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781929 2569 flags.go:64] FLAG: --cluster-domain="" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781932 2569 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781935 2569 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781938 2569 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781941 2569 flags.go:64] FLAG: --container-log-max-files="5" Jun 15 07:48:48.787483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781945 2569 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781948 2569 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781951 2569 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781958 2569 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781961 2569 flags.go:64] FLAG: --contention-profiling="false" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781964 2569 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781967 2569 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781970 2569 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781974 2569 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781978 2569 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781981 2569 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781984 2569 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781987 2569 flags.go:64] FLAG: --enable-load-reader="false" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781990 2569 flags.go:64] FLAG: --enable-server="true" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781993 2569 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.781998 2569 flags.go:64] FLAG: --event-burst="100" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782002 2569 flags.go:64] FLAG: --event-qps="50" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782005 2569 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782008 2569 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782012 2569 flags.go:64] FLAG: --eviction-hard="" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782015 2569 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782018 2569 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782021 2569 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782024 2569 flags.go:64] FLAG: --eviction-soft="" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782026 2569 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 15 07:48:48.788133 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782029 2569 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782032 2569 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782035 2569 flags.go:64] FLAG: --experimental-mounter-path="" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782037 2569 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782040 2569 flags.go:64] FLAG: --fail-swap-on="true" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782043 2569 flags.go:64] FLAG: --feature-gates="" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782047 2569 flags.go:64] FLAG: --file-check-frequency="20s" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782050 2569 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782052 2569 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782055 2569 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782060 2569 flags.go:64] FLAG: --healthz-port="10248" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782063 2569 flags.go:64] FLAG: --help="false" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782066 2569 flags.go:64] FLAG: --hostname-override="ip-10-0-143-10.ec2.internal" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782069 2569 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782072 2569 flags.go:64] FLAG: --http-check-frequency="20s" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782075 2569 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782078 2569 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782081 2569 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782084 2569 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782087 2569 flags.go:64] FLAG: --image-service-endpoint="" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782089 2569 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782092 2569 flags.go:64] FLAG: --kube-api-burst="100" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782095 2569 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782098 2569 flags.go:64] FLAG: --kube-api-qps="50" Jun 15 07:48:48.788798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782101 2569 flags.go:64] FLAG: --kube-reserved="" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782104 2569 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782107 2569 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782110 2569 flags.go:64] FLAG: --kubelet-cgroups="" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782113 2569 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782116 2569 flags.go:64] FLAG: --lock-file="" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782118 2569 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782121 2569 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782124 2569 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782129 2569 flags.go:64] FLAG: --log-json-split-stream="false" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782132 2569 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782134 2569 flags.go:64] FLAG: --log-text-split-stream="false" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782137 2569 flags.go:64] FLAG: --logging-format="text" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782140 2569 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782143 2569 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782145 2569 flags.go:64] FLAG: --manifest-url="" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782148 2569 flags.go:64] FLAG: --manifest-url-header="" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782152 2569 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782156 2569 flags.go:64] FLAG: --max-open-files="1000000" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782160 2569 flags.go:64] FLAG: --max-pods="110" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782163 2569 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782166 2569 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782169 2569 flags.go:64] FLAG: --memory-manager-policy="None" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782172 2569 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782175 2569 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 15 07:48:48.789721 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782178 2569 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782181 2569 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782188 2569 flags.go:64] FLAG: --node-status-max-images="50" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782191 2569 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782194 2569 flags.go:64] FLAG: --oom-score-adj="-999" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782197 2569 flags.go:64] FLAG: --pod-cidr="" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782199 2569 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782205 2569 flags.go:64] FLAG: --pod-manifest-path="" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782208 2569 flags.go:64] FLAG: --pod-max-pids="-1" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782211 2569 flags.go:64] FLAG: --pods-per-core="0" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782214 2569 flags.go:64] FLAG: --port="10250" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782217 2569 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782220 2569 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-061e785683c6c84a7" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782223 2569 flags.go:64] FLAG: --qos-reserved="" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782226 2569 flags.go:64] FLAG: --read-only-port="10255" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782229 2569 flags.go:64] FLAG: --register-node="true" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782231 2569 flags.go:64] FLAG: --register-with-taints="" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782235 2569 flags.go:64] FLAG: --registry-burst="10" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782238 2569 flags.go:64] FLAG: --registry-qps="5" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782241 2569 flags.go:64] FLAG: --reserved-cpus="" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782243 2569 flags.go:64] FLAG: --reserved-memory="" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782247 2569 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782250 2569 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782253 2569 flags.go:64] FLAG: --rotate-certificates="false" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782256 2569 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 15 07:48:48.790570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782260 2569 flags.go:64] FLAG: --runonce="false" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782262 2569 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782265 2569 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782268 2569 flags.go:64] FLAG: --seccomp-default="false" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782271 2569 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782274 2569 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782277 2569 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782280 2569 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782283 2569 flags.go:64] FLAG: --storage-driver-password="root" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782286 2569 flags.go:64] FLAG: --storage-driver-secure="false" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782289 2569 flags.go:64] FLAG: --storage-driver-table="stats" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782292 2569 flags.go:64] FLAG: --storage-driver-user="root" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782294 2569 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782297 2569 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782300 2569 flags.go:64] FLAG: --system-cgroups="" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782303 2569 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782322 2569 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782326 2569 flags.go:64] FLAG: --tls-cert-file="" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782329 2569 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782334 2569 flags.go:64] FLAG: --tls-min-version="" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782336 2569 flags.go:64] FLAG: --tls-private-key-file="" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782339 2569 flags.go:64] FLAG: --topology-manager-policy="none" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782342 2569 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782345 2569 flags.go:64] FLAG: --topology-manager-scope="container" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782347 2569 flags.go:64] FLAG: --v="2" Jun 15 07:48:48.791189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782357 2569 flags.go:64] FLAG: --version="false" Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782361 2569 flags.go:64] FLAG: --vmodule="" Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782365 2569 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.782369 2569 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782492 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782496 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782499 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782503 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782507 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782511 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782515 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782518 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782520 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782524 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782526 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782529 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782532 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782535 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782537 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782540 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 07:48:48.791819 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782542 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782545 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782547 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782550 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782553 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782555 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782558 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782560 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782563 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782565 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782567 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782570 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782572 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782575 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782577 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782580 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782582 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782584 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782587 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782590 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 07:48:48.792328 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782592 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782595 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782597 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782600 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782602 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782606 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782608 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782612 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782616 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782618 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782621 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782624 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782626 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782629 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782631 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782634 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782636 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782640 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782642 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 07:48:48.792868 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782644 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782647 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782649 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782652 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782655 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782657 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782660 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782662 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782665 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782667 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782670 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782673 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782676 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782678 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782681 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782683 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782686 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782688 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782693 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 07:48:48.793339 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782695 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782698 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782701 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782703 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782706 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782708 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782713 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782716 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782719 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782722 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782725 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782728 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782731 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782733 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782736 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782738 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782741 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782743 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782746 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782748 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 07:48:48.793806 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782751 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782753 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782756 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782758 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.782761 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.783190 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.790594 2569 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.790611 2569 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.791484 2569 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.791493 2569 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791549 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791555 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791558 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791561 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791564 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 07:48:48.794296 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791567 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791570 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791574 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791576 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791579 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791582 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791585 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791587 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791590 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791593 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791595 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791598 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791601 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791604 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791607 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791610 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791612 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791615 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791618 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791620 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 07:48:48.794692 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791623 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791625 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791628 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791631 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791634 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791637 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791640 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791643 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791645 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791648 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791650 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791654 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791658 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791661 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791664 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791666 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791669 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791672 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791674 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 07:48:48.795191 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791678 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791680 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791684 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791687 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791689 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791692 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791695 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791697 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791700 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791703 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791705 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791708 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791710 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791713 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791715 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791718 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791720 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791723 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791726 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791729 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 07:48:48.795758 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791732 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791734 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791736 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791739 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791742 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791744 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791746 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791750 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791753 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791756 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791758 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791761 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791764 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791767 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791769 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791772 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791775 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791778 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791780 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 07:48:48.796277 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791783 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791785 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791788 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791790 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791792 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791796 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791799 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791803 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791805 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791808 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791812 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791815 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791818 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791821 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791824 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 07:48:48.796748 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791827 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.791833 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791951 2569 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791957 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791960 2569 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791963 2569 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791965 2569 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791968 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791972 2569 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791976 2569 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791979 2569 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791981 2569 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791984 2569 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791986 2569 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 15 07:48:48.797138 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791990 2569 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791992 2569 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791995 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.791997 2569 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792001 2569 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792004 2569 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792007 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792010 2569 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792013 2569 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792016 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792019 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792022 2569 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792024 2569 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792027 2569 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792030 2569 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792033 2569 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792035 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792038 2569 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792040 2569 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 15 07:48:48.797500 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792043 2569 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792045 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792048 2569 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792050 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792053 2569 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792055 2569 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792058 2569 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792060 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792063 2569 feature_gate.go:328] unrecognized feature gate: Example Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792066 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792068 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792071 2569 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792073 2569 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792076 2569 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792079 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792082 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792084 2569 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792087 2569 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792089 2569 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792092 2569 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 15 07:48:48.797958 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792095 2569 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792097 2569 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792100 2569 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792102 2569 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792105 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792107 2569 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792110 2569 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792112 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792115 2569 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792117 2569 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792120 2569 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792123 2569 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792125 2569 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792128 2569 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792130 2569 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792133 2569 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792135 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792138 2569 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792140 2569 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792142 2569 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 15 07:48:48.798440 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792145 2569 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792148 2569 feature_gate.go:328] unrecognized feature gate: Example2 Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792150 2569 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792153 2569 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792155 2569 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792158 2569 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792161 2569 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792166 2569 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792169 2569 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792172 2569 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792175 2569 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792177 2569 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792180 2569 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792183 2569 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792185 2569 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792188 2569 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792190 2569 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792193 2569 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792195 2569 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792197 2569 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 15 07:48:48.798947 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792200 2569 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792202 2569 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792205 2569 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792207 2569 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792210 2569 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792212 2569 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792215 2569 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:48.792217 2569 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.792222 2569 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.792330 2569 server.go:962] "Client rotation is on, will bootstrap in background" Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.795489 2569 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.796704 2569 server.go:1019] "Starting client certificate rotation" Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.796798 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 07:48:48.799562 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.796832 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 15 07:48:48.799906 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.799439 2569 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 07:48:48.800766 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.800748 2569 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 15 07:48:48.807514 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.807497 2569 log.go:25] "Validated CRI v1 runtime API" Jun 15 07:48:48.812032 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.812018 2569 log.go:25] "Validated CRI v1 image API" Jun 15 07:48:48.814090 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.814074 2569 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 15 07:48:48.816587 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.816570 2569 fs.go:135] Filesystem UUIDs: map[03963c4d-a546-474f-8565-08d1d962f99c:/dev/nvme0n1p3 4daa7ef5-2e1c-4046-9894-ad4a8628b16f:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jun 15 07:48:48.816647 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.816589 2569 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 15 07:48:48.821938 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.821831 2569 manager.go:216] Machine: {Timestamp:2026-06-15 07:48:48.821343688 +0000 UTC m=+0.342832005 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101047 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ccbf3bccf78691d97ac3b06459ab SystemUUID:ec28ccbf-3bcc-f786-91d9-7ac3b06459ab BootID:74d2a7dc-faa8-422c-9460-2abc9e44565c Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:62:a4:e0:e7:e9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:62:a4:e0:e7:e9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:92:48:a7:d9:6b:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 15 07:48:48.821938 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.821930 2569 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 15 07:48:48.822066 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.822026 2569 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 15 07:48:48.824334 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.824312 2569 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 15 07:48:48.824510 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.824338 2569 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-143-10.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 15 07:48:48.825559 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.825548 2569 topology_manager.go:138] "Creating topology manager with none policy" Jun 15 07:48:48.825596 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.825563 2569 container_manager_linux.go:309] "Creating device plugin manager" Jun 15 07:48:48.825596 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.825575 2569 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 07:48:48.826181 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.826172 2569 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 15 07:48:48.827411 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.827399 2569 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 15 07:48:48.827610 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.827595 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 07:48:48.830522 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.830452 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 15 07:48:48.830700 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.830688 2569 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 15 07:48:48.830869 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.830859 2569 kubelet.go:486] "Attempting to sync node with API server" Jun 15 07:48:48.830926 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.830876 2569 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 15 07:48:48.830926 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.830924 2569 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 15 07:48:48.831006 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.830939 2569 kubelet.go:398] "Adding apiserver pod source" Jun 15 07:48:48.831006 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.830951 2569 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 15 07:48:48.831430 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.831402 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 07:48:48.831622 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.831604 2569 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 15 07:48:48.833961 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.833931 2569 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 15 07:48:48.835333 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835320 2569 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 15 07:48:48.835380 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835350 2569 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 15 07:48:48.835554 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835540 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 15 07:48:48.835587 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835564 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 15 07:48:48.835587 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835574 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 15 07:48:48.835587 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835583 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 15 07:48:48.835665 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835594 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 15 07:48:48.835665 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.835602 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 15 07:48:48.836048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836038 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 15 07:48:48.836078 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836048 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 15 07:48:48.836078 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836056 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 15 07:48:48.836078 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836061 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 15 07:48:48.836078 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836069 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 15 07:48:48.836078 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836077 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 15 07:48:48.836801 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836792 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 15 07:48:48.836833 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.836802 2569 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 15 07:48:48.840370 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.840201 2569 server.go:1268] "Started kubelet" Jun 15 07:48:48.840446 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.840278 2569 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 15 07:48:48.840524 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.840486 2569 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 15 07:48:48.840953 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.840921 2569 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 15 07:48:48.841214 ip-10-0-143-10 systemd[1]: Started Kubernetes Kubelet. Jun 15 07:48:48.842576 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.842560 2569 server.go:310] "Adding debug handlers to kubelet server" Jun 15 07:48:48.843337 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.843300 2569 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-143-10.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 15 07:48:48.843435 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.843329 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-143-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 15 07:48:48.843435 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.843388 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 15 07:48:48.845884 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.845012 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18b931a8d76bd01f default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:ip-10-0-143-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-06-15 07:48:48.840175647 +0000 UTC m=+0.361663963,LastTimestamp:2026-06-15 07:48:48.840175647 +0000 UTC m=+0.361663963,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Jun 15 07:48:48.846291 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.846278 2569 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 15 07:48:48.846759 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.846741 2569 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 15 07:48:48.849705 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.849683 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ph9b9" Jun 15 07:48:48.849705 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.849693 2569 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 15 07:48:48.849834 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.849769 2569 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 15 07:48:48.849883 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.849835 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:48.850355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850334 2569 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 15 07:48:48.850355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850356 2569 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 15 07:48:48.850523 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850337 2569 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 15 07:48:48.850575 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850559 2569 reconstruct.go:97] "Volume reconstruction finished" Jun 15 07:48:48.850575 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850569 2569 reconciler.go:29] "Reconciler: start to sync state" Jun 15 07:48:48.850653 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850576 2569 factory.go:55] Registering systemd factory Jun 15 07:48:48.850653 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850593 2569 factory.go:223] Registration of the systemd container factory successfully Jun 15 07:48:48.850942 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850917 2569 factory.go:153] Registering CRI-O factory Jun 15 07:48:48.850942 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850932 2569 factory.go:223] Registration of the crio container factory successfully Jun 15 07:48:48.851065 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.850980 2569 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 15 07:48:48.851065 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.851004 2569 factory.go:103] Registering Raw factory Jun 15 07:48:48.851065 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.851018 2569 manager.go:1196] Started watching for new ooms in manager Jun 15 07:48:48.851468 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.851411 2569 manager.go:349] Starting recovery of all containers Jun 15 07:48:48.855965 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.855941 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-ph9b9" Jun 15 07:48:48.856985 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.856943 2569 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-143-10.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 15 07:48:48.857151 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.857129 2569 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 15 07:48:48.863705 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.863690 2569 manager.go:354] Recovery completed Jun 15 07:48:48.867441 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.867430 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 07:48:48.869172 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.869156 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Jun 15 07:48:48.869232 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.869186 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 07:48:48.869232 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.869198 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Jun 15 07:48:48.869659 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.869646 2569 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 15 07:48:48.869659 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.869658 2569 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 15 07:48:48.869734 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.869671 2569 state_mem.go:36] "Initialized new in-memory state store" Jun 15 07:48:48.869734 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.869709 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 07:48:48.870356 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.870341 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Jun 15 07:48:48.870419 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.870365 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 07:48:48.870419 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.870377 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Jun 15 07:48:48.870676 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.870664 2569 policy_none.go:49] "None policy: Start" Jun 15 07:48:48.870710 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.870679 2569 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 15 07:48:48.870710 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.870689 2569 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 15 07:48:48.871160 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.871089 2569 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-143-10.ec2.internal.18b931a8d92642ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-143-10.ec2.internal,UID:ip-10-0-143-10.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-143-10.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-143-10.ec2.internal,},FirstTimestamp:2026-06-15 07:48:48.869171967 +0000 UTC m=+0.390660287,LastTimestamp:2026-06-15 07:48:48.869171967 +0000 UTC m=+0.390660287,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-143-10.ec2.internal,}" Jun 15 07:48:48.871639 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.871626 2569 policy_none.go:47] "Start" Jun 15 07:48:48.904147 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.904133 2569 manager.go:337] "Starting Device Plugin manager" Jun 15 07:48:48.904247 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.904206 2569 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 15 07:48:48.904247 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.904219 2569 server.go:87] "Starting device plugin registration server" Jun 15 07:48:48.904779 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.904474 2569 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 15 07:48:48.904779 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.904487 2569 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 15 07:48:48.904779 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.904579 2569 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 15 07:48:48.904779 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.904654 2569 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 15 07:48:48.904779 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.904668 2569 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 15 07:48:48.905177 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.905136 2569 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 15 07:48:48.905228 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.905186 2569 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:48.916312 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.916287 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 15 07:48:48.917374 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.917361 2569 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 15 07:48:48.917426 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.917396 2569 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 15 07:48:48.917426 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.917417 2569 kubelet.go:2448] "Starting kubelet main sync loop" Jun 15 07:48:48.917523 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:48.917470 2569 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 15 07:48:48.918963 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:48.918946 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 07:48:49.005366 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.005342 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 07:48:49.007381 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.007364 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Jun 15 07:48:49.007484 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.007397 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 07:48:49.007484 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.007412 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Jun 15 07:48:49.007484 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.007448 2569 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.014938 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.014921 2569 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.015026 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.014942 2569 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-143-10.ec2.internal\": node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.017543 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.017526 2569 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal"] Jun 15 07:48:49.017618 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.017590 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 07:48:49.019291 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.019277 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Jun 15 07:48:49.019355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.019302 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 07:48:49.019355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.019311 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Jun 15 07:48:49.020368 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.020357 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 07:48:49.020501 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.020489 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.020536 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.020530 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 07:48:49.021199 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.021186 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Jun 15 07:48:49.021262 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.021207 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 07:48:49.021262 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.021226 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Jun 15 07:48:49.021262 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.021255 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Jun 15 07:48:49.021376 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.021280 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 07:48:49.021376 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.021294 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Jun 15 07:48:49.022286 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.022271 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.022337 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.022293 2569 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 15 07:48:49.022952 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.022937 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientMemory" Jun 15 07:48:49.023008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.022962 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasNoDiskPressure" Jun 15 07:48:49.023008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.022972 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeHasSufficientPID" Jun 15 07:48:49.027869 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.027854 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.050042 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.050028 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-10.ec2.internal\" not found" node="ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.051813 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.051796 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39de84c6bdac381194cf5e1a2256d8be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"39de84c6bdac381194cf5e1a2256d8be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.051910 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.051822 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39de84c6bdac381194cf5e1a2256d8be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"39de84c6bdac381194cf5e1a2256d8be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.051910 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.051862 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80ffb4914acf337a942adb1245474e33-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"80ffb4914acf337a942adb1245474e33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.054266 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.054250 2569 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-143-10.ec2.internal\" not found" node="ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.127957 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.127941 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.152451 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.152432 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39de84c6bdac381194cf5e1a2256d8be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"39de84c6bdac381194cf5e1a2256d8be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.152507 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.152467 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39de84c6bdac381194cf5e1a2256d8be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"39de84c6bdac381194cf5e1a2256d8be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.152507 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.152485 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80ffb4914acf337a942adb1245474e33-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"80ffb4914acf337a942adb1245474e33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.152579 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.152512 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/80ffb4914acf337a942adb1245474e33-config\") pod \"kube-apiserver-proxy-ip-10-0-143-10.ec2.internal\" (UID: \"80ffb4914acf337a942adb1245474e33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.152579 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.152517 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/39de84c6bdac381194cf5e1a2256d8be-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"39de84c6bdac381194cf5e1a2256d8be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.152579 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.152529 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/39de84c6bdac381194cf5e1a2256d8be-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal\" (UID: \"39de84c6bdac381194cf5e1a2256d8be\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.228991 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.228964 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.329635 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.329583 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.351993 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.351976 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.357964 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.357949 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Jun 15 07:48:49.430296 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.430258 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.530753 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.530724 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.631229 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.631162 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.731730 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.731703 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.796235 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.796199 2569 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 15 07:48:49.796943 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.796348 2569 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 15 07:48:49.831869 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.831846 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.832317 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:49.832296 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80ffb4914acf337a942adb1245474e33.slice/crio-0028c631e5c567cff44b7dd180c1f48a0838e0bb33c84f3a89c80e2eaec1e2ac WatchSource:0}: Error finding container 0028c631e5c567cff44b7dd180c1f48a0838e0bb33c84f3a89c80e2eaec1e2ac: Status 404 returned error can't find the container with id 0028c631e5c567cff44b7dd180c1f48a0838e0bb33c84f3a89c80e2eaec1e2ac Jun 15 07:48:49.832614 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:49.832594 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39de84c6bdac381194cf5e1a2256d8be.slice/crio-666aa65066924d92d928217566b67606bd0c6ad818344e676ef1321c3baa67b8 WatchSource:0}: Error finding container 666aa65066924d92d928217566b67606bd0c6ad818344e676ef1321c3baa67b8: Status 404 returned error can't find the container with id 666aa65066924d92d928217566b67606bd0c6ad818344e676ef1321c3baa67b8 Jun 15 07:48:49.839282 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.839268 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 07:48:49.860169 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.860130 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-14 07:43:48 +0000 UTC" deadline="2028-02-05 03:30:20.934081724 +0000 UTC" Jun 15 07:48:49.860169 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.860170 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14395h41m31.073916257s" Jun 15 07:48:49.920833 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.920787 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"39de84c6bdac381194cf5e1a2256d8be","Type":"ContainerStarted","Data":"666aa65066924d92d928217566b67606bd0c6ad818344e676ef1321c3baa67b8"} Jun 15 07:48:49.923127 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.922663 2569 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 07:48:49.923544 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.923521 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" event={"ID":"80ffb4914acf337a942adb1245474e33","Type":"ContainerStarted","Data":"0028c631e5c567cff44b7dd180c1f48a0838e0bb33c84f3a89c80e2eaec1e2ac"} Jun 15 07:48:49.932826 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:49.932810 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:49.953213 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:49.953192 2569 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 07:48:50.033276 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.033256 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:50.133765 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.133736 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:50.234329 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.234250 2569 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-143-10.ec2.internal\" not found" Jun 15 07:48:50.312563 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.311821 2569 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 07:48:50.350172 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.350143 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" Jun 15 07:48:50.362999 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.362853 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 07:48:50.363958 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.363931 2569 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" Jun 15 07:48:50.373169 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.373145 2569 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 15 07:48:50.616757 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.616636 2569 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 15 07:48:50.832098 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.832061 2569 apiserver.go:52] "Watching apiserver" Jun 15 07:48:50.842812 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.842783 2569 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 15 07:48:50.843893 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.843864 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-jcwlb","kube-system/global-pull-secret-syncer-wkn8j","kube-system/konnectivity-agent-nqbjb","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp","openshift-dns/node-resolver-zn2b9","openshift-image-registry/node-ca-vndmk","openshift-multus/multus-4hpfc","openshift-ovn-kubernetes/ovnkube-node-zcc9c","kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal","openshift-cluster-node-tuning-operator/tuned-5dcxj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal","openshift-multus/multus-additional-cni-plugins-dsk8s","openshift-multus/network-metrics-daemon-gl5lq","openshift-network-diagnostics/network-check-target-s97zs"] Jun 15 07:48:50.845197 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.845178 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.846206 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.846186 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:50.846304 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.846266 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:48:50.847256 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.847232 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:50.848243 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.848171 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 15 07:48:50.848243 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.848203 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 15 07:48:50.848391 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.848257 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 15 07:48:50.848391 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.848284 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 15 07:48:50.848391 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.848326 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-5kpqb\"" Jun 15 07:48:50.848615 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.848596 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.849950 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.849862 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.849950 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.849890 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 15 07:48:50.849950 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.849937 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 15 07:48:50.850135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.849865 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-pvflw\"" Jun 15 07:48:50.850725 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.850707 2569 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 15 07:48:50.851018 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.851000 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 15 07:48:50.851145 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.851124 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 15 07:48:50.851276 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.851262 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 15 07:48:50.852182 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.852161 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-khmp8\"" Jun 15 07:48:50.852594 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.852513 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.853729 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.853544 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 15 07:48:50.853729 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.853578 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-6zfsp\"" Jun 15 07:48:50.853843 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.853750 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 15 07:48:50.854418 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.854399 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:50.854532 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.854511 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:48:50.856069 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.856049 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:50.856954 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.856933 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 15 07:48:50.857041 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.856984 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 15 07:48:50.857116 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.857089 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-z7jzx\"" Jun 15 07:48:50.857212 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.857175 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 15 07:48:50.857361 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.857343 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:50.857472 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.857413 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:48:50.858619 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.858420 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-q67zc\"" Jun 15 07:48:50.858619 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.858445 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 15 07:48:50.858745 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.858651 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.858898 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.858863 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 15 07:48:50.859008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.858980 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 15 07:48:50.860002 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.859983 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.860951 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.860918 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fbkd\" (UniqueName: \"kubernetes.io/projected/ef25b266-91ad-4e31-96d5-b655f06e5ccd-kube-api-access-6fbkd\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861042 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.860948 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rtzzv\" (UniqueName: \"kubernetes.io/projected/02ffc07a-6d44-47df-90ea-c657938899b3-kube-api-access-rtzzv\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:50.861042 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.860975 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-socket-dir-parent\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861042 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.860999 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-k8s-cni-cncf-io\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861042 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861021 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec666f4a-a0a2-4825-a5b8-185bf1e17bad-agent-certs\") pod \"konnectivity-agent-nqbjb\" (UID: \"ec666f4a-a0a2-4825-a5b8-185bf1e17bad\") " pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:50.861042 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861037 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkktx\" (UniqueName: \"kubernetes.io/projected/4f1afe11-7085-438a-96f8-180023bad754-kube-api-access-xkktx\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.861298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861051 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-system-cni-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861068 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-multus-certs\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861083 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:50.861298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861097 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-registration-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.861298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-device-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.861298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861148 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-5s4lt\"" Jun 15 07:48:50.861298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861295 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861356 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861152 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cca22368-c7d6-44cd-b459-e09750ca54f0-hosts-file\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861421 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-serviceca\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861448 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k6r86\" (UniqueName: \"kubernetes.io/projected/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-kube-api-access-k6r86\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861506 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-cni-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861531 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-netns\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-etc-kubernetes\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861575 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-kubelet\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861359 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861599 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-conf-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.861644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-daemon-config\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861650 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861673 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-socket-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861697 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-etc-selinux\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861721 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca22368-c7d6-44cd-b459-e09750ca54f0-tmp-dir\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861745 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jt8f2\" (UniqueName: \"kubernetes.io/projected/cca22368-c7d6-44cd-b459-e09750ca54f0-kube-api-access-jt8f2\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861774 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-host\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861811 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef25b266-91ad-4e31-96d5-b655f06e5ccd-cni-binary-copy\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861835 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-sys-fs\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-cni-bin\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861875 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-hostroot\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861908 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec666f4a-a0a2-4825-a5b8-185bf1e17bad-konnectivity-ca\") pod \"konnectivity-agent-nqbjb\" (UID: \"ec666f4a-a0a2-4825-a5b8-185bf1e17bad\") " pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861932 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-os-release\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861953 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-cni-multus\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.862146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.861973 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-cnibin\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.863922 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.863902 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 15 07:48:50.863922 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.863916 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-rx74m\"" Jun 15 07:48:50.864061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.863959 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 15 07:48:50.864193 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.864179 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 15 07:48:50.864245 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.864186 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 15 07:48:50.864245 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.864228 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 15 07:48:50.864343 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.864243 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 15 07:48:50.864343 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.864261 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 15 07:48:50.864343 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.864271 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 15 07:48:50.864499 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.864401 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-mr445\"" Jun 15 07:48:50.866241 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.866222 2569 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 15 07:48:50.884061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.884039 2569 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7jlhl" Jun 15 07:48:50.892673 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.892625 2569 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7jlhl" Jun 15 07:48:50.951771 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.951737 2569 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 15 07:48:50.962858 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.962830 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-cni-bin\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963000 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.962871 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec666f4a-a0a2-4825-a5b8-185bf1e17bad-konnectivity-ca\") pod \"konnectivity-agent-nqbjb\" (UID: \"ec666f4a-a0a2-4825-a5b8-185bf1e17bad\") " pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:50.963000 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.962899 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysctl-d\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.963000 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.962921 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-lib-modules\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.963000 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.962928 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-cni-bin\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963000 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.962943 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-cni-netd\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.963000 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.962965 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-cnibin\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963064 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-kubernetes\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963087 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-systemd\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963114 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963140 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgxrb\" (UniqueName: \"kubernetes.io/projected/2af84169-400a-4278-9c5d-bc3c83460473-kube-api-access-kgxrb\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963167 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-cnibin\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963215 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fbkd\" (UniqueName: \"kubernetes.io/projected/ef25b266-91ad-4e31-96d5-b655f06e5ccd-kube-api-access-6fbkd\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963234 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-cnibin\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963269 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9g6q\" (UniqueName: \"kubernetes.io/projected/8630922f-ef6d-4d23-89ad-01d6b9c34698-kube-api-access-j9g6q\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:50.963299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963295 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysconfig\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963315 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-sys\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963338 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-systemd\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963446 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-kubelet-config\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963490 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-socket-dir-parent\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963556 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-socket-dir-parent\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963570 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec666f4a-a0a2-4825-a5b8-185bf1e17bad-agent-certs\") pod \"konnectivity-agent-nqbjb\" (UID: \"ec666f4a-a0a2-4825-a5b8-185bf1e17bad\") " pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-etc-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963622 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27755659-ebe8-4960-b423-0963fb3cee94-ovn-node-metrics-cert\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963627 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/ec666f4a-a0a2-4825-a5b8-185bf1e17bad-konnectivity-ca\") pod \"konnectivity-agent-nqbjb\" (UID: \"ec666f4a-a0a2-4825-a5b8-185bf1e17bad\") " pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963638 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-os-release\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963715 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-multus-certs\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.963750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963741 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-registration-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963773 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-device-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963799 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-multus-certs\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963799 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cca22368-c7d6-44cd-b459-e09750ca54f0-hosts-file\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963828 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-systemd-units\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963851 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-cni-bin\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963856 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-registration-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963865 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-device-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963854 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/cca22368-c7d6-44cd-b459-e09750ca54f0-hosts-file\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963879 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k6r86\" (UniqueName: \"kubernetes.io/projected/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-kube-api-access-k6r86\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963916 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-cni-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963941 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-netns\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963955 2569 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963970 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-ovnkube-script-lib\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.963995 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-conf-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964010 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-cni-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964017 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-daemon-config\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-etc-selinux\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.964369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964065 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca22368-c7d6-44cd-b459-e09750ca54f0-tmp-dir\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964069 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-netns\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964079 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-conf-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964090 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jt8f2\" (UniqueName: \"kubernetes.io/projected/cca22368-c7d6-44cd-b459-e09750ca54f0-kube-api-access-jt8f2\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964114 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b054194-76c5-401b-9a3e-10130af865a7-etc-tuned\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964118 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-etc-selinux\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964141 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef25b266-91ad-4e31-96d5-b655f06e5ccd-cni-binary-copy\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964166 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-kubelet\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964189 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964211 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964256 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964287 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hshhb\" (UniqueName: \"kubernetes.io/projected/27755659-ebe8-4960-b423-0963fb3cee94-kube-api-access-hshhb\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964312 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-dbus\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964342 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-hostroot\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964369 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-var-lib-kubelet\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964391 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-host\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964368 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cca22368-c7d6-44cd-b459-e09750ca54f0-tmp-dir\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.965093 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964416 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-var-lib-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964405 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-hostroot\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964469 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-os-release\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964518 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-cni-multus\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964544 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ntfx\" (UniqueName: \"kubernetes.io/projected/1b054194-76c5-401b-9a3e-10130af865a7-kube-api-access-4ntfx\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-slash\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964576 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-os-release\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964585 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/ef25b266-91ad-4e31-96d5-b655f06e5ccd-multus-daemon-config\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964595 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-env-overrides\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964618 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964626 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-cni-multus\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964636 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rtzzv\" (UniqueName: \"kubernetes.io/projected/02ffc07a-6d44-47df-90ea-c657938899b3-kube-api-access-rtzzv\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964651 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysctl-conf\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964668 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-k8s-cni-cncf-io\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964690 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkktx\" (UniqueName: \"kubernetes.io/projected/4f1afe11-7085-438a-96f8-180023bad754-kube-api-access-xkktx\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964707 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8630922f-ef6d-4d23-89ad-01d6b9c34698-host-slash\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:50.965876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964720 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-ovnkube-config\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964728 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-run-k8s-cni-cncf-io\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964734 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964741 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ef25b266-91ad-4e31-96d5-b655f06e5ccd-cni-binary-copy\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964757 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-system-cni-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964938 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964969 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-node-log\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964992 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-system-cni-dir\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.964994 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965025 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-serviceca\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965048 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-etc-kubernetes\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.965053 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965073 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-modprobe-d\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965095 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-run\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965123 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-etc-kubernetes\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:50.965141 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs podName:02ffc07a-6d44-47df-90ea-c657938899b3 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:51.46509903 +0000 UTC m=+2.986587362 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs") pod "network-metrics-daemon-gl5lq" (UID: "02ffc07a-6d44-47df-90ea-c657938899b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965182 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b054194-76c5-401b-9a3e-10130af865a7-tmp\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:50.966476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965207 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-log-socket\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965230 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-system-cni-dir\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965258 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-kubelet\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965291 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965331 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-socket-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965342 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965363 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8630922f-ef6d-4d23-89ad-01d6b9c34698-iptables-alerter-script\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965387 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-ovn\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965394 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ef25b266-91ad-4e31-96d5-b655f06e5ccd-host-var-lib-kubelet\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965414 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-host\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965443 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-socket-dir\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965451 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-sys-fs\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965498 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-run-netns\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965515 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-host\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965521 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-serviceca\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.967074 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.965574 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/4f1afe11-7085-438a-96f8-180023bad754-sys-fs\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:50.967580 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.967483 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/ec666f4a-a0a2-4825-a5b8-185bf1e17bad-agent-certs\") pod \"konnectivity-agent-nqbjb\" (UID: \"ec666f4a-a0a2-4825-a5b8-185bf1e17bad\") " pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:50.971778 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.971754 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fbkd\" (UniqueName: \"kubernetes.io/projected/ef25b266-91ad-4e31-96d5-b655f06e5ccd-kube-api-access-6fbkd\") pod \"multus-4hpfc\" (UID: \"ef25b266-91ad-4e31-96d5-b655f06e5ccd\") " pod="openshift-multus/multus-4hpfc" Jun 15 07:48:50.971920 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.971888 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k6r86\" (UniqueName: \"kubernetes.io/projected/55fa6a13-40dd-4e8e-9535-95e8afadd6ad-kube-api-access-k6r86\") pod \"node-ca-vndmk\" (UID: \"55fa6a13-40dd-4e8e-9535-95e8afadd6ad\") " pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:50.975270 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.975251 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jt8f2\" (UniqueName: \"kubernetes.io/projected/cca22368-c7d6-44cd-b459-e09750ca54f0-kube-api-access-jt8f2\") pod \"node-resolver-zn2b9\" (UID: \"cca22368-c7d6-44cd-b459-e09750ca54f0\") " pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:50.978388 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.978365 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rtzzv\" (UniqueName: \"kubernetes.io/projected/02ffc07a-6d44-47df-90ea-c657938899b3-kube-api-access-rtzzv\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:50.978859 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:50.978839 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkktx\" (UniqueName: \"kubernetes.io/projected/4f1afe11-7085-438a-96f8-180023bad754-kube-api-access-xkktx\") pod \"aws-ebs-csi-driver-node-kc7mp\" (UID: \"4f1afe11-7085-438a-96f8-180023bad754\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:51.066355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066328 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-var-lib-kubelet\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.066355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066360 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-host\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066387 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-var-lib-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066411 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066447 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ntfx\" (UniqueName: \"kubernetes.io/projected/1b054194-76c5-401b-9a3e-10130af865a7-kube-api-access-4ntfx\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066484 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-slash\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066502 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-env-overrides\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066502 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-var-lib-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066518 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066532 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-host\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066554 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-slash\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.066563 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066584 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysctl-conf\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.066612 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.066618 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret podName:61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e nodeName:}" failed. No retries permitted until 2026-06-15 07:48:51.566599413 +0000 UTC m=+3.088087716 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret") pod "global-pull-secret-syncer-wkn8j" (UID: "61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e") : object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066633 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8630922f-ef6d-4d23-89ad-01d6b9c34698-host-slash\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066655 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-ovnkube-config\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066678 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066709 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-node-log\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066718 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysctl-conf\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066735 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066761 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-modprobe-d\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066786 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-run\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066809 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b054194-76c5-401b-9a3e-10130af865a7-tmp\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066831 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-log-socket\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066879 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-system-cni-dir\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066908 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8630922f-ef6d-4d23-89ad-01d6b9c34698-iptables-alerter-script\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066923 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8630922f-ef6d-4d23-89ad-01d6b9c34698-host-slash\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066939 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-ovn\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066480 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-var-lib-kubelet\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066965 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-run-netns\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067186 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066992 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysctl-d\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066998 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-run\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067020 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-lib-modules\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.066965 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067129 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-ovn\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067132 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-node-log\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067162 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-run-netns\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067204 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-log-socket\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067239 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-system-cni-dir\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067282 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-ovnkube-config\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067301 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-modprobe-d\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-cni-netd\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067597 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-cnibin\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067620 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-cni-binary-copy\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067355 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-cni-netd\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067354 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysctl-d\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067433 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-lib-modules\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.067975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067625 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067684 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-cnibin\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067347 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-env-overrides\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067708 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-kubernetes\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067721 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8630922f-ef6d-4d23-89ad-01d6b9c34698-iptables-alerter-script\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067741 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-systemd\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067765 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-kubernetes\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067768 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067777 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067800 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-systemd\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067813 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgxrb\" (UniqueName: \"kubernetes.io/projected/2af84169-400a-4278-9c5d-bc3c83460473-kube-api-access-kgxrb\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067851 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9g6q\" (UniqueName: \"kubernetes.io/projected/8630922f-ef6d-4d23-89ad-01d6b9c34698-kube-api-access-j9g6q\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067875 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysconfig\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067898 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-sys\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067921 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-systemd\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067946 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-kubelet-config\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067972 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-etc-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.068758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067997 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-sys\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.067998 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27755659-ebe8-4960-b423-0963fb3cee94-ovn-node-metrics-cert\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068095 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2af84169-400a-4278-9c5d-bc3c83460473-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068140 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-kubelet-config\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068160 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/1b054194-76c5-401b-9a3e-10130af865a7-etc-sysconfig\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068168 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-systemd\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068189 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-os-release\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068190 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-etc-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-systemd-units\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068225 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-cni-bin\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068244 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2af84169-400a-4278-9c5d-bc3c83460473-os-release\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068250 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-ovnkube-script-lib\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068267 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-systemd-units\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068272 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b054194-76c5-401b-9a3e-10130af865a7-etc-tuned\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068290 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-kubelet\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068307 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068321 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.069530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068291 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-cni-bin\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068357 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-run-ovn-kubernetes\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068358 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-kubelet\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068399 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068490 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-run-openvswitch\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068493 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hshhb\" (UniqueName: \"kubernetes.io/projected/27755659-ebe8-4960-b423-0963fb3cee94-kube-api-access-hshhb\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068535 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/27755659-ebe8-4960-b423-0963fb3cee94-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-dbus\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068806 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/27755659-ebe8-4960-b423-0963fb3cee94-ovnkube-script-lib\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.068823 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-dbus\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:51.070061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.069832 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1b054194-76c5-401b-9a3e-10130af865a7-tmp\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.070509 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.070416 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/27755659-ebe8-4960-b423-0963fb3cee94-ovn-node-metrics-cert\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.070806 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.070785 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/1b054194-76c5-401b-9a3e-10130af865a7-etc-tuned\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.075850 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.075831 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 07:48:51.075850 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.075853 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 07:48:51.076027 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.075866 2569 projected.go:196] Error preparing data for projected volume kube-api-access-85nfp for pod openshift-network-diagnostics/network-check-target-s97zs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:51.076027 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.075916 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp podName:381d224d-21be-41fc-96f7-8477a8e25573 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:51.575900883 +0000 UTC m=+3.097389207 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-85nfp" (UniqueName: "kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp") pod "network-check-target-s97zs" (UID: "381d224d-21be-41fc-96f7-8477a8e25573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:51.076839 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.076796 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ntfx\" (UniqueName: \"kubernetes.io/projected/1b054194-76c5-401b-9a3e-10130af865a7-kube-api-access-4ntfx\") pod \"tuned-5dcxj\" (UID: \"1b054194-76c5-401b-9a3e-10130af865a7\") " pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.077944 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.077924 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgxrb\" (UniqueName: \"kubernetes.io/projected/2af84169-400a-4278-9c5d-bc3c83460473-kube-api-access-kgxrb\") pod \"multus-additional-cni-plugins-dsk8s\" (UID: \"2af84169-400a-4278-9c5d-bc3c83460473\") " pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.078274 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.078252 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hshhb\" (UniqueName: \"kubernetes.io/projected/27755659-ebe8-4960-b423-0963fb3cee94-kube-api-access-hshhb\") pod \"ovnkube-node-zcc9c\" (UID: \"27755659-ebe8-4960-b423-0963fb3cee94\") " pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.078387 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.078371 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9g6q\" (UniqueName: \"kubernetes.io/projected/8630922f-ef6d-4d23-89ad-01d6b9c34698-kube-api-access-j9g6q\") pod \"iptables-alerter-jcwlb\" (UID: \"8630922f-ef6d-4d23-89ad-01d6b9c34698\") " pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:51.157285 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.157263 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4hpfc" Jun 15 07:48:51.165907 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.165878 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:48:51.173881 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.173862 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" Jun 15 07:48:51.180466 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.180437 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" Jun 15 07:48:51.185967 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.185951 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zn2b9" Jun 15 07:48:51.192381 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.192366 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-vndmk" Jun 15 07:48:51.199866 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.199850 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-jcwlb" Jun 15 07:48:51.207611 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.207592 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:48:51.211450 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.211423 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" Jun 15 07:48:51.470854 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.470779 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:51.471001 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.470904 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:51.471001 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.470961 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs podName:02ffc07a-6d44-47df-90ea-c657938899b3 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:52.47094665 +0000 UTC m=+3.992434965 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs") pod "network-metrics-daemon-gl5lq" (UID: "02ffc07a-6d44-47df-90ea-c657938899b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:51.571424 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.571390 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:51.571599 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.571515 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:51.571599 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.571573 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret podName:61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e nodeName:}" failed. No retries permitted until 2026-06-15 07:48:52.571556231 +0000 UTC m=+4.093044541 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret") pod "global-pull-secret-syncer-wkn8j" (UID: "61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e") : object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:51.625164 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.625134 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1afe11_7085_438a_96f8_180023bad754.slice/crio-57e8fb2124f97fa1d8dd8c866511530d99e6a3973bedda3d85724a76f9aa6717 WatchSource:0}: Error finding container 57e8fb2124f97fa1d8dd8c866511530d99e6a3973bedda3d85724a76f9aa6717: Status 404 returned error can't find the container with id 57e8fb2124f97fa1d8dd8c866511530d99e6a3973bedda3d85724a76f9aa6717 Jun 15 07:48:51.626831 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.626805 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8630922f_ef6d_4d23_89ad_01d6b9c34698.slice/crio-7899bff6b74c25c73e939126a37cc464c023fb4c1bc8d002c94470cf6114ccfd WatchSource:0}: Error finding container 7899bff6b74c25c73e939126a37cc464c023fb4c1bc8d002c94470cf6114ccfd: Status 404 returned error can't find the container with id 7899bff6b74c25c73e939126a37cc464c023fb4c1bc8d002c94470cf6114ccfd Jun 15 07:48:51.627783 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.627740 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef25b266_91ad_4e31_96d5_b655f06e5ccd.slice/crio-7ac51473395b0c879bad2f03ca99780b13066eb58f982bc6f3104ae02ceaf1e5 WatchSource:0}: Error finding container 7ac51473395b0c879bad2f03ca99780b13066eb58f982bc6f3104ae02ceaf1e5: Status 404 returned error can't find the container with id 7ac51473395b0c879bad2f03ca99780b13066eb58f982bc6f3104ae02ceaf1e5 Jun 15 07:48:51.631778 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.631753 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b054194_76c5_401b_9a3e_10130af865a7.slice/crio-101b1f289f65480bf60801e04a7e7f1cd13276170e9ae705cc64c9092f384772 WatchSource:0}: Error finding container 101b1f289f65480bf60801e04a7e7f1cd13276170e9ae705cc64c9092f384772: Status 404 returned error can't find the container with id 101b1f289f65480bf60801e04a7e7f1cd13276170e9ae705cc64c9092f384772 Jun 15 07:48:51.632896 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.632871 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55fa6a13_40dd_4e8e_9535_95e8afadd6ad.slice/crio-ae500bf3b2e699537d612019436f2d4f665e2ae47f3d77252d565b7ce19da00d WatchSource:0}: Error finding container ae500bf3b2e699537d612019436f2d4f665e2ae47f3d77252d565b7ce19da00d: Status 404 returned error can't find the container with id ae500bf3b2e699537d612019436f2d4f665e2ae47f3d77252d565b7ce19da00d Jun 15 07:48:51.633999 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.633441 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcca22368_c7d6_44cd_b459_e09750ca54f0.slice/crio-f5229bca27e2d4a94712aeff7e6eca863a066fa45581d514b9605dced3590752 WatchSource:0}: Error finding container f5229bca27e2d4a94712aeff7e6eca863a066fa45581d514b9605dced3590752: Status 404 returned error can't find the container with id f5229bca27e2d4a94712aeff7e6eca863a066fa45581d514b9605dced3590752 Jun 15 07:48:51.634299 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.634249 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27755659_ebe8_4960_b423_0963fb3cee94.slice/crio-2d60520d09b86ef39482e49cea6bb638f9d87d7abcbd41fa7d18a7d5aba167ba WatchSource:0}: Error finding container 2d60520d09b86ef39482e49cea6bb638f9d87d7abcbd41fa7d18a7d5aba167ba: Status 404 returned error can't find the container with id 2d60520d09b86ef39482e49cea6bb638f9d87d7abcbd41fa7d18a7d5aba167ba Jun 15 07:48:51.636143 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.636000 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec666f4a_a0a2_4825_a5b8_185bf1e17bad.slice/crio-bfbeb0d68529176dd3dc4a82923dff9a89184ad213af8913c7f9412ba7c08a8b WatchSource:0}: Error finding container bfbeb0d68529176dd3dc4a82923dff9a89184ad213af8913c7f9412ba7c08a8b: Status 404 returned error can't find the container with id bfbeb0d68529176dd3dc4a82923dff9a89184ad213af8913c7f9412ba7c08a8b Jun 15 07:48:51.636983 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:48:51.636962 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2af84169_400a_4278_9c5d_bc3c83460473.slice/crio-b42a6f5e6b3a398a4e9d7d5003a285168cc98c0d0b6ba9fd949e04b33642ebf3 WatchSource:0}: Error finding container b42a6f5e6b3a398a4e9d7d5003a285168cc98c0d0b6ba9fd949e04b33642ebf3: Status 404 returned error can't find the container with id b42a6f5e6b3a398a4e9d7d5003a285168cc98c0d0b6ba9fd949e04b33642ebf3 Jun 15 07:48:51.671923 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.671894 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:51.672035 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.672021 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 07:48:51.672095 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.672038 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 07:48:51.672095 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.672047 2569 projected.go:196] Error preparing data for projected volume kube-api-access-85nfp for pod openshift-network-diagnostics/network-check-target-s97zs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:51.672095 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.672088 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp podName:381d224d-21be-41fc-96f7-8477a8e25573 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:52.672072608 +0000 UTC m=+4.193560914 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-85nfp" (UniqueName: "kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp") pod "network-check-target-s97zs" (UID: "381d224d-21be-41fc-96f7-8477a8e25573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:51.894502 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.894446 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 07:43:50 +0000 UTC" deadline="2027-11-17 18:24:45.03136668 +0000 UTC" Jun 15 07:48:51.894502 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.894500 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12490h35m53.136869483s" Jun 15 07:48:51.917842 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.917821 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:51.917939 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:51.917921 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:48:51.927094 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.927069 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerStarted","Data":"b42a6f5e6b3a398a4e9d7d5003a285168cc98c0d0b6ba9fd949e04b33642ebf3"} Jun 15 07:48:51.928209 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.928188 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jcwlb" event={"ID":"8630922f-ef6d-4d23-89ad-01d6b9c34698","Type":"ContainerStarted","Data":"7899bff6b74c25c73e939126a37cc464c023fb4c1bc8d002c94470cf6114ccfd"} Jun 15 07:48:51.929197 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.929178 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" event={"ID":"4f1afe11-7085-438a-96f8-180023bad754","Type":"ContainerStarted","Data":"57e8fb2124f97fa1d8dd8c866511530d99e6a3973bedda3d85724a76f9aa6717"} Jun 15 07:48:51.930958 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.930939 2569 generic.go:356] "Generic (PLEG): container finished" podID="39de84c6bdac381194cf5e1a2256d8be" containerID="4f602612370b94535a5b3bdca2a9e1ba5de680c08160bf50c8b792d8f9cac188" exitCode=0 Jun 15 07:48:51.931038 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.931000 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"39de84c6bdac381194cf5e1a2256d8be","Type":"ContainerDied","Data":"4f602612370b94535a5b3bdca2a9e1ba5de680c08160bf50c8b792d8f9cac188"} Jun 15 07:48:51.932470 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.932440 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" event={"ID":"80ffb4914acf337a942adb1245474e33","Type":"ContainerStarted","Data":"4c5088c9e94837b06c86c665f09c52189d5c37855ee4c0f88c0d23f9cd2a2278"} Jun 15 07:48:51.933485 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.933450 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqbjb" event={"ID":"ec666f4a-a0a2-4825-a5b8-185bf1e17bad","Type":"ContainerStarted","Data":"bfbeb0d68529176dd3dc4a82923dff9a89184ad213af8913c7f9412ba7c08a8b"} Jun 15 07:48:51.934505 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.934486 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zn2b9" event={"ID":"cca22368-c7d6-44cd-b459-e09750ca54f0","Type":"ContainerStarted","Data":"f5229bca27e2d4a94712aeff7e6eca863a066fa45581d514b9605dced3590752"} Jun 15 07:48:51.935672 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.935644 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"2d60520d09b86ef39482e49cea6bb638f9d87d7abcbd41fa7d18a7d5aba167ba"} Jun 15 07:48:51.936943 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.936912 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" event={"ID":"1b054194-76c5-401b-9a3e-10130af865a7","Type":"ContainerStarted","Data":"101b1f289f65480bf60801e04a7e7f1cd13276170e9ae705cc64c9092f384772"} Jun 15 07:48:51.938020 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.938002 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vndmk" event={"ID":"55fa6a13-40dd-4e8e-9535-95e8afadd6ad","Type":"ContainerStarted","Data":"ae500bf3b2e699537d612019436f2d4f665e2ae47f3d77252d565b7ce19da00d"} Jun 15 07:48:51.938980 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.938960 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4hpfc" event={"ID":"ef25b266-91ad-4e31-96d5-b655f06e5ccd","Type":"ContainerStarted","Data":"7ac51473395b0c879bad2f03ca99780b13066eb58f982bc6f3104ae02ceaf1e5"} Jun 15 07:48:51.961984 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:51.961932 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-143-10.ec2.internal" podStartSLOduration=1.961914726 podStartE2EDuration="1.961914726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:48:51.961332861 +0000 UTC m=+3.482821186" watchObservedRunningTime="2026-06-15 07:48:51.961914726 +0000 UTC m=+3.483403054" Jun 15 07:48:52.477469 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.477424 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:52.477644 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.477617 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:52.477723 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.477690 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs podName:02ffc07a-6d44-47df-90ea-c657938899b3 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:54.477660327 +0000 UTC m=+5.999148651 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs") pod "network-metrics-daemon-gl5lq" (UID: "02ffc07a-6d44-47df-90ea-c657938899b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:52.578748 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.578442 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:52.578748 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.578735 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:52.578980 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.578803 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret podName:61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e nodeName:}" failed. No retries permitted until 2026-06-15 07:48:54.578784426 +0000 UTC m=+6.100272734 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret") pod "global-pull-secret-syncer-wkn8j" (UID: "61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e") : object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:52.679285 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.679249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:52.679547 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.679444 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 07:48:52.679617 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.679561 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 07:48:52.679617 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.679577 2569 projected.go:196] Error preparing data for projected volume kube-api-access-85nfp for pod openshift-network-diagnostics/network-check-target-s97zs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:52.679721 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.679652 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp podName:381d224d-21be-41fc-96f7-8477a8e25573 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:54.679619613 +0000 UTC m=+6.201107935 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-85nfp" (UniqueName: "kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp") pod "network-check-target-s97zs" (UID: "381d224d-21be-41fc-96f7-8477a8e25573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:52.895406 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.895287 2569 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-14 07:43:50 +0000 UTC" deadline="2027-11-10 00:58:17.176245158 +0000 UTC" Jun 15 07:48:52.895406 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.895329 2569 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12305h9m24.280921866s" Jun 15 07:48:52.931604 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.931571 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:52.931783 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.931735 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:48:52.932237 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.932218 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:52.932387 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:52.932364 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:48:52.952573 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:52.952508 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" event={"ID":"39de84c6bdac381194cf5e1a2256d8be","Type":"ContainerStarted","Data":"acc5137dd97836e0fcc1ab91de8623f5a29be3729ce0fc09c5c12ccdffe1e747"} Jun 15 07:48:53.918663 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:53.918630 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:53.919109 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:53.918772 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:48:54.495477 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:54.495425 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:54.495644 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.495612 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:54.495710 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.495675 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs podName:02ffc07a-6d44-47df-90ea-c657938899b3 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:58.495656525 +0000 UTC m=+10.017144834 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs") pod "network-metrics-daemon-gl5lq" (UID: "02ffc07a-6d44-47df-90ea-c657938899b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:54.597497 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:54.596802 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:54.597497 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.597079 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:54.597497 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.597149 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret podName:61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e nodeName:}" failed. No retries permitted until 2026-06-15 07:48:58.597129921 +0000 UTC m=+10.118618228 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret") pod "global-pull-secret-syncer-wkn8j" (UID: "61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e") : object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:54.697561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:54.697523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:54.697722 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.697678 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 07:48:54.697722 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.697696 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 07:48:54.697722 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.697708 2569 projected.go:196] Error preparing data for projected volume kube-api-access-85nfp for pod openshift-network-diagnostics/network-check-target-s97zs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:54.697893 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.697768 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp podName:381d224d-21be-41fc-96f7-8477a8e25573 nodeName:}" failed. No retries permitted until 2026-06-15 07:48:58.697749188 +0000 UTC m=+10.219237530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-85nfp" (UniqueName: "kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp") pod "network-check-target-s97zs" (UID: "381d224d-21be-41fc-96f7-8477a8e25573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:54.918167 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:54.918132 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:54.918327 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.918264 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:48:54.918554 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:54.918524 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:54.918672 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:54.918647 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:48:55.918281 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:55.918247 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:55.918855 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:55.918387 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:48:56.918111 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:56.918034 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:56.918292 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:56.918160 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:48:56.918292 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:56.918256 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:56.918686 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:56.918357 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:48:57.918547 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:57.918516 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:57.919035 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:57.918659 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:48:58.528295 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:58.528249 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:58.528556 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.528368 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:58.528556 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.528441 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs podName:02ffc07a-6d44-47df-90ea-c657938899b3 nodeName:}" failed. No retries permitted until 2026-06-15 07:49:06.528419808 +0000 UTC m=+18.049908113 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs") pod "network-metrics-daemon-gl5lq" (UID: "02ffc07a-6d44-47df-90ea-c657938899b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:48:58.628778 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:58.628737 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:58.628944 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.628914 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:58.629037 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.629007 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret podName:61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e nodeName:}" failed. No retries permitted until 2026-06-15 07:49:06.628987933 +0000 UTC m=+18.150476240 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret") pod "global-pull-secret-syncer-wkn8j" (UID: "61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e") : object "kube-system"/"original-pull-secret" not registered Jun 15 07:48:58.729774 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:58.729738 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:58.729948 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.729917 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 07:48:58.729948 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.729935 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 07:48:58.729948 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.729944 2569 projected.go:196] Error preparing data for projected volume kube-api-access-85nfp for pod openshift-network-diagnostics/network-check-target-s97zs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:58.730079 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.729994 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp podName:381d224d-21be-41fc-96f7-8477a8e25573 nodeName:}" failed. No retries permitted until 2026-06-15 07:49:06.729980023 +0000 UTC m=+18.251468326 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-85nfp" (UniqueName: "kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp") pod "network-check-target-s97zs" (UID: "381d224d-21be-41fc-96f7-8477a8e25573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:48:58.919930 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:58.919266 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:48:58.919930 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.919375 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:48:58.919930 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:58.919440 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:48:58.919930 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:58.919554 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:48:59.917867 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:48:59.917827 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:48:59.918041 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:48:59.917965 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:00.917878 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:00.917842 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:00.918329 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:00.917848 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:00.918329 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:00.917979 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:00.918329 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:00.918071 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:01.918424 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:01.918387 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:01.918817 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:01.918522 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:02.917784 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:02.917746 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:02.917966 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:02.917750 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:02.917966 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:02.917871 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:02.917966 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:02.917952 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:03.918482 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:03.918334 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:03.918482 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:03.918469 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:04.918299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:04.918262 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:04.918523 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:04.918264 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:04.918523 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:04.918394 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:04.918523 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:04.918497 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:05.917712 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:05.917679 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:05.917927 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:05.917815 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:06.590356 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:06.590316 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:06.590770 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.590503 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:49:06.590770 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.590573 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs podName:02ffc07a-6d44-47df-90ea-c657938899b3 nodeName:}" failed. No retries permitted until 2026-06-15 07:49:22.590557098 +0000 UTC m=+34.112045422 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs") pod "network-metrics-daemon-gl5lq" (UID: "02ffc07a-6d44-47df-90ea-c657938899b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:49:06.691695 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:06.691650 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:06.691893 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.691827 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 07:49:06.691950 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.691896 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret podName:61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e nodeName:}" failed. No retries permitted until 2026-06-15 07:49:22.691879739 +0000 UTC m=+34.213368044 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret") pod "global-pull-secret-syncer-wkn8j" (UID: "61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e") : object "kube-system"/"original-pull-secret" not registered Jun 15 07:49:06.792550 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:06.792514 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:06.792723 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.792706 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 07:49:06.792800 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.792727 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 07:49:06.792800 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.792737 2569 projected.go:196] Error preparing data for projected volume kube-api-access-85nfp for pod openshift-network-diagnostics/network-check-target-s97zs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:49:06.792800 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.792785 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp podName:381d224d-21be-41fc-96f7-8477a8e25573 nodeName:}" failed. No retries permitted until 2026-06-15 07:49:22.792773266 +0000 UTC m=+34.314261573 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-85nfp" (UniqueName: "kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp") pod "network-check-target-s97zs" (UID: "381d224d-21be-41fc-96f7-8477a8e25573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:49:06.917735 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:06.917701 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:06.917911 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.917831 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:06.917911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:06.917890 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:06.918075 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:06.917994 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:07.917942 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:07.917876 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:07.918405 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:07.918025 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:08.918556 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:08.918520 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:08.919013 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:08.918670 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:08.919013 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:08.918716 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:08.919013 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:08.918791 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:09.917793 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:09.917761 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:09.917948 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:09.917889 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:10.918235 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.917938 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:10.918235 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.918155 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:10.919221 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:10.918270 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:10.919221 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:10.918357 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:10.993447 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.993406 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-nqbjb" event={"ID":"ec666f4a-a0a2-4825-a5b8-185bf1e17bad","Type":"ContainerStarted","Data":"8e6ce007078c41bbafb6654d04e89058ab8544aa9ed92f1e8156d3976846d126"} Jun 15 07:49:10.994937 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.994902 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zn2b9" event={"ID":"cca22368-c7d6-44cd-b459-e09750ca54f0","Type":"ContainerStarted","Data":"7a69da7ff30cbba7d9bf65587ea731eae8c99df83fa817c1f67af6db38e5ec19"} Jun 15 07:49:10.996665 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.996501 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:49:10.996974 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.996953 2569 generic.go:356] "Generic (PLEG): container finished" podID="27755659-ebe8-4960-b423-0963fb3cee94" containerID="a4293017f67e7139fe835214bc73073fe20cfe5f2e6c5f28650c4dd2835c6150" exitCode=1 Jun 15 07:49:10.997056 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.997009 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerDied","Data":"a4293017f67e7139fe835214bc73073fe20cfe5f2e6c5f28650c4dd2835c6150"} Jun 15 07:49:10.997115 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.997070 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"40cec883bb702199096f6a7dbabbd57eb1bf90b756790598745ae3ccd4f32375"} Jun 15 07:49:10.998648 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:10.998619 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" event={"ID":"1b054194-76c5-401b-9a3e-10130af865a7","Type":"ContainerStarted","Data":"bae017c5d40103da13ebc0a68bd89a563aebe3a6cff28970c9b079aa6bf00476"} Jun 15 07:49:11.000316 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.000293 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-vndmk" event={"ID":"55fa6a13-40dd-4e8e-9535-95e8afadd6ad","Type":"ContainerStarted","Data":"f44053e11fd96bd1de997998faf40676a75736a71c8d99446cd97a9e9eb7f17f"} Jun 15 07:49:11.001895 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.001866 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4hpfc" event={"ID":"ef25b266-91ad-4e31-96d5-b655f06e5ccd","Type":"ContainerStarted","Data":"e981a0419febb37f485442ba3a145c2b9947b3886fb43fc934e68f8ee4abd8d2"} Jun 15 07:49:11.003623 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.003598 2569 generic.go:356] "Generic (PLEG): container finished" podID="2af84169-400a-4278-9c5d-bc3c83460473" containerID="2231f882272ef07e735642a164a14f6ea81f9cf5103b7a0238d3afd00a0235d1" exitCode=0 Jun 15 07:49:11.003724 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.003705 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerDied","Data":"2231f882272ef07e735642a164a14f6ea81f9cf5103b7a0238d3afd00a0235d1"} Jun 15 07:49:11.005199 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.005133 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" event={"ID":"4f1afe11-7085-438a-96f8-180023bad754","Type":"ContainerStarted","Data":"31fa4cf455216149326f084bbcbcb5e9e7ec106ec0ef839aa402062e02c6c62c"} Jun 15 07:49:11.009286 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.009250 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-nqbjb" podStartSLOduration=7.563004728 podStartE2EDuration="22.009237782s" totalImagesPullingTime="14.446233054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:11.00899632 +0000 UTC m=+22.530484645" watchObservedRunningTime="2026-06-15 07:49:11.009237782 +0000 UTC m=+22.530726107" Jun 15 07:49:11.009734 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.009707 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-143-10.ec2.internal" podStartSLOduration=21.009699406 podStartE2EDuration="21.009699406s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:48:52.969511008 +0000 UTC m=+4.490999336" watchObservedRunningTime="2026-06-15 07:49:11.009699406 +0000 UTC m=+22.531187731" Jun 15 07:49:11.024497 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.024446 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zn2b9" podStartSLOduration=3.018072149 podStartE2EDuration="22.024434758s" totalImagesPullingTime="19.006362609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:11.024160503 +0000 UTC m=+22.545648829" watchObservedRunningTime="2026-06-15 07:49:11.024434758 +0000 UTC m=+22.545923083" Jun 15 07:49:11.039268 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.039233 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-vndmk" podStartSLOduration=3.031188367 podStartE2EDuration="22.039220819s" totalImagesPullingTime="19.008032452s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:11.039049797 +0000 UTC m=+22.560538121" watchObservedRunningTime="2026-06-15 07:49:11.039220819 +0000 UTC m=+22.560709144" Jun 15 07:49:11.080017 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.079975 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5dcxj" podStartSLOduration=3.071293649 podStartE2EDuration="22.079960531s" totalImagesPullingTime="19.008666882s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:11.062336475 +0000 UTC m=+22.583824802" watchObservedRunningTime="2026-06-15 07:49:11.079960531 +0000 UTC m=+22.601448856" Jun 15 07:49:11.080434 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.080412 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4hpfc" podStartSLOduration=3.025383097 podStartE2EDuration="22.08040355s" totalImagesPullingTime="19.055020453s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:11.079891864 +0000 UTC m=+22.601380189" watchObservedRunningTime="2026-06-15 07:49:11.08040355 +0000 UTC m=+22.601891876" Jun 15 07:49:11.918595 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:11.918570 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:11.919028 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:11.918669 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:12.010417 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.010388 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:49:12.010900 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.010868 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"74738b6a2694482b899e92e9103118720e6583facc40605cd51a127d7a61e6d5"} Jun 15 07:49:12.011025 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.010956 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"3e8ff431bc632f6d6c3221a48568c0b0f58529a535bf83a2351a2b9429014bf1"} Jun 15 07:49:12.011025 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.011006 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"90478b92083a2d414d5634fd1cd59a81c32c15f798ce1f3690c2e5aed607bc0f"} Jun 15 07:49:12.011134 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.011058 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"ebd288c109d9d3dacf39841c3e5b65c7d7f72e222f631426b902da9afbb5cc9b"} Jun 15 07:49:12.186680 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.186497 2569 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 15 07:49:12.918366 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.918336 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:12.918674 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.918449 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:12.918674 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.918470 2569 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-15T07:49:12.186677454Z","UUID":"fb0347d7-2f73-4377-b899-c1d98448cfa9","Handler":null,"Name":"","Endpoint":""} Jun 15 07:49:12.918674 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:12.918549 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:12.918674 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:12.918447 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:12.920053 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.920018 2569 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 15 07:49:12.920217 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:12.920059 2569 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 15 07:49:13.015069 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:13.015029 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-jcwlb" event={"ID":"8630922f-ef6d-4d23-89ad-01d6b9c34698","Type":"ContainerStarted","Data":"02b8e08c5f0a08a027e23bd84ec90e8daea6fcdb2eab512707f5b3e559cf2446"} Jun 15 07:49:13.017249 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:13.017217 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" event={"ID":"4f1afe11-7085-438a-96f8-180023bad754","Type":"ContainerStarted","Data":"d40e5222cb6cc857df383c666d22a0fd92194d8bc15abab4a645a15ac095a090"} Jun 15 07:49:13.031878 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:13.031818 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-jcwlb" podStartSLOduration=5.017951873 podStartE2EDuration="24.031805381s" totalImagesPullingTime="19.013853508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:13.031318185 +0000 UTC m=+24.552806510" watchObservedRunningTime="2026-06-15 07:49:13.031805381 +0000 UTC m=+24.553293707" Jun 15 07:49:13.918487 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:13.918444 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:13.918711 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:13.918566 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:14.023248 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.023224 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:49:14.023686 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.023658 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"9c72ab6eb33e91722e46e6790ee4a8cfabf9590af186e2d0155aab12fcbf0fad"} Jun 15 07:49:14.025927 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.025897 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" event={"ID":"4f1afe11-7085-438a-96f8-180023bad754","Type":"ContainerStarted","Data":"01fda9f113acc0966ff80a60bbe7d47c0599cc5dbc915f2f6812f6ed4e106b9a"} Jun 15 07:49:14.043916 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.043858 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kc7mp" podStartSLOduration=3.765500609 podStartE2EDuration="25.043839881s" totalImagesPullingTime="21.278339272s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:14.043239462 +0000 UTC m=+25.564727811" watchObservedRunningTime="2026-06-15 07:49:14.043839881 +0000 UTC m=+25.565328207" Jun 15 07:49:14.872606 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.872574 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:49:14.873243 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.873216 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:49:14.918268 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.918242 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:14.918414 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:14.918355 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:14.918513 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:14.918437 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:14.918569 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:14.918544 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:15.027494 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:15.027450 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:49:15.028146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:15.028129 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-nqbjb" Jun 15 07:49:15.918498 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:15.918309 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:15.918679 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:15.918585 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:16.034836 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:16.034809 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:49:16.035377 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:16.035226 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"0ce8a3520d20df365b4898f19990e26ee8ce6986eea36d7d5d2bb8ad43ebc1f9"} Jun 15 07:49:16.035670 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:16.035653 2569 scope.go:117] "RemoveContainer" containerID="a4293017f67e7139fe835214bc73073fe20cfe5f2e6c5f28650c4dd2835c6150" Jun 15 07:49:16.918565 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:16.918527 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:16.918722 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:16.918527 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:16.918722 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:16.918655 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:16.918843 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:16.918717 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:17.918616 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:17.918592 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:17.918923 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:17.918697 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:18.043443 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.043414 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:49:18.043866 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.043836 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" event={"ID":"27755659-ebe8-4960-b423-0963fb3cee94","Type":"ContainerStarted","Data":"80b8fe302d417e374e445db801d40192bc22f650c980e122c6833310ea5de004"} Jun 15 07:49:18.044120 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.044093 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:49:18.044219 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.044191 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:49:18.044274 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.044224 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:49:18.045863 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.045831 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerStarted","Data":"23722483c7baaeefe8da9da213fb05a457b0c8aa4b83234c4441bad90c7a5371"} Jun 15 07:49:18.059693 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.059674 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:49:18.061080 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.061062 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:49:18.073432 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.073393 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" podStartSLOduration=9.930481489 podStartE2EDuration="29.073380208s" totalImagesPullingTime="19.142898719s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:18.072803693 +0000 UTC m=+29.594292021" watchObservedRunningTime="2026-06-15 07:49:18.073380208 +0000 UTC m=+29.594868533" Jun 15 07:49:18.918958 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.918928 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:18.919446 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:18.919018 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:18.919446 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:18.919071 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:18.919446 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:18.919167 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:19.049224 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:19.049197 2569 generic.go:356] "Generic (PLEG): container finished" podID="2af84169-400a-4278-9c5d-bc3c83460473" containerID="23722483c7baaeefe8da9da213fb05a457b0c8aa4b83234c4441bad90c7a5371" exitCode=0 Jun 15 07:49:19.049375 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:19.049288 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerDied","Data":"23722483c7baaeefe8da9da213fb05a457b0c8aa4b83234c4441bad90c7a5371"} Jun 15 07:49:19.918990 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:19.918965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:19.919328 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:19.919094 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:20.056440 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:20.056412 2569 generic.go:356] "Generic (PLEG): container finished" podID="2af84169-400a-4278-9c5d-bc3c83460473" containerID="c522227e165aac213a9b696985480425e4a1cd5e118ecea6a8e63614301f8869" exitCode=0 Jun 15 07:49:20.056553 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:20.056503 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerDied","Data":"c522227e165aac213a9b696985480425e4a1cd5e118ecea6a8e63614301f8869"} Jun 15 07:49:20.066437 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:20.066269 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" podUID="27755659-ebe8-4960-b423-0963fb3cee94" containerName="ovnkube-controller" probeResult="failure" output="" Jun 15 07:49:20.917811 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:20.917777 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:20.917979 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:20.917867 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:20.917979 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:20.917925 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:20.918096 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:20.918001 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:21.061314 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:21.061287 2569 generic.go:356] "Generic (PLEG): container finished" podID="2af84169-400a-4278-9c5d-bc3c83460473" containerID="634e03f42d23a54eb1cea0cbb80f535e186747af3fd2a0f870e5b980772b6878" exitCode=0 Jun 15 07:49:21.061778 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:21.061327 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerDied","Data":"634e03f42d23a54eb1cea0cbb80f535e186747af3fd2a0f870e5b980772b6878"} Jun 15 07:49:21.917700 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:21.917668 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:21.917891 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:21.917782 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:22.618172 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:22.618124 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:22.618619 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.618245 2569 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:49:22.618619 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.618306 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs podName:02ffc07a-6d44-47df-90ea-c657938899b3 nodeName:}" failed. No retries permitted until 2026-06-15 07:49:54.61829075 +0000 UTC m=+66.139779054 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs") pod "network-metrics-daemon-gl5lq" (UID: "02ffc07a-6d44-47df-90ea-c657938899b3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 15 07:49:22.718825 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:22.718791 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:22.719012 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.718909 2569 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 15 07:49:22.719012 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.718980 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret podName:61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e nodeName:}" failed. No retries permitted until 2026-06-15 07:49:54.718962098 +0000 UTC m=+66.240450404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret") pod "global-pull-secret-syncer-wkn8j" (UID: "61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e") : object "kube-system"/"original-pull-secret" not registered Jun 15 07:49:22.820107 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:22.820072 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:22.820267 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.820230 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 15 07:49:22.820267 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.820247 2569 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 15 07:49:22.820267 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.820255 2569 projected.go:196] Error preparing data for projected volume kube-api-access-85nfp for pod openshift-network-diagnostics/network-check-target-s97zs: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:49:22.820431 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.820317 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp podName:381d224d-21be-41fc-96f7-8477a8e25573 nodeName:}" failed. No retries permitted until 2026-06-15 07:49:54.8203041 +0000 UTC m=+66.341792404 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-85nfp" (UniqueName: "kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp") pod "network-check-target-s97zs" (UID: "381d224d-21be-41fc-96f7-8477a8e25573") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 15 07:49:22.921913 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:22.921877 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:22.922097 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.922035 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:22.922166 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:22.922090 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:22.922229 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:22.922206 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:23.918168 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:23.918139 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:23.918603 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:23.918262 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:24.918219 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:24.918180 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:24.918692 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:24.918314 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:24.918692 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:24.918341 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:24.918692 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:24.918479 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:25.918554 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:25.918524 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:25.918928 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:25.918636 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:26.918269 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:26.918229 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:26.918445 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:26.918359 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:26.918445 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:26.918407 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:26.918549 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:26.918523 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:27.078261 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:27.078220 2569 generic.go:356] "Generic (PLEG): container finished" podID="2af84169-400a-4278-9c5d-bc3c83460473" containerID="d09ddb188b85346729586538ce69bdb116bcfc7c58e0ae2f24e3faf6e2ce4d18" exitCode=0 Jun 15 07:49:27.078743 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:27.078274 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerDied","Data":"d09ddb188b85346729586538ce69bdb116bcfc7c58e0ae2f24e3faf6e2ce4d18"} Jun 15 07:49:27.917924 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:27.917895 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:27.918105 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:27.918001 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:28.083866 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:28.083835 2569 generic.go:356] "Generic (PLEG): container finished" podID="2af84169-400a-4278-9c5d-bc3c83460473" containerID="5ee34ed3dfe0857d8ff2425b53b08790a372b7d633053c0ff98dd1594faf4015" exitCode=0 Jun 15 07:49:28.084310 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:28.083875 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerDied","Data":"5ee34ed3dfe0857d8ff2425b53b08790a372b7d633053c0ff98dd1594faf4015"} Jun 15 07:49:28.923493 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:28.923448 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:28.923822 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:28.923789 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:28.923934 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:28.923855 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:28.923993 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:28.923958 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:29.089933 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.089899 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" event={"ID":"2af84169-400a-4278-9c5d-bc3c83460473","Type":"ContainerStarted","Data":"e2accaa61c6ba642d6ed8803944780674c2f2a8a3384e091d41785f7d74e095a"} Jun 15 07:49:29.122977 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.122924 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dsk8s" podStartSLOduration=7.954803269 podStartE2EDuration="40.122906233s" totalImagesPullingTime="32.168102964s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:29.122773187 +0000 UTC m=+40.644261512" watchObservedRunningTime="2026-06-15 07:49:29.122906233 +0000 UTC m=+40.644394558" Jun 15 07:49:29.917981 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.917939 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:29.918178 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:29.918077 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:29.953151 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.953085 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s97zs"] Jun 15 07:49:29.953321 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.953270 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:29.953413 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:29.953390 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:29.953889 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.953860 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gl5lq"] Jun 15 07:49:29.954869 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.954841 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkn8j"] Jun 15 07:49:29.954968 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:29.954937 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:29.955057 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:29.955035 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:30.092681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:30.092595 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:30.093254 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:30.092709 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:31.918233 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:31.918041 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:31.918647 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:31.918072 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:31.918647 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:31.918307 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gl5lq" podUID="02ffc07a-6d44-47df-90ea-c657938899b3" Jun 15 07:49:31.918647 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:31.918373 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-s97zs" podUID="381d224d-21be-41fc-96f7-8477a8e25573" Jun 15 07:49:31.918647 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:31.918083 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:31.918647 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:31.918444 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-wkn8j" podUID="61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e" Jun 15 07:49:33.284411 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.284385 2569 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-143-10.ec2.internal" event="NodeReady" Jun 15 07:49:33.284775 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.284547 2569 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 15 07:49:33.333499 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.333443 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cf8q5"] Jun 15 07:49:33.355054 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.355021 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vlj5g"] Jun 15 07:49:33.355187 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.355139 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.357679 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.357657 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 15 07:49:33.357809 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.357658 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7fqb2\"" Jun 15 07:49:33.357809 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.357694 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 15 07:49:33.377149 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.377122 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlj5g"] Jun 15 07:49:33.377273 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.377158 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cf8q5"] Jun 15 07:49:33.377273 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.377179 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xbmq2"] Jun 15 07:49:33.377273 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.377196 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.379719 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.379700 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 15 07:49:33.379797 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.379700 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 15 07:49:33.380013 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.379996 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4rq6g\"" Jun 15 07:49:33.380013 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.380007 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 15 07:49:33.401185 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.401156 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xbmq2"] Jun 15 07:49:33.401327 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.401285 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.403427 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403404 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9877a11-9555-4c5d-8744-841ba91822dc-config-volume\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.403633 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403441 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9877a11-9555-4c5d-8744-841ba91822dc-tmp-dir\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.403633 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403483 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3dc158d-9dca-4a72-aa1d-e48a703efb05-data-volume\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.403633 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403540 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3dc158d-9dca-4a72-aa1d-e48a703efb05-crio-socket\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.403633 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403567 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gjkw\" (UniqueName: \"kubernetes.io/projected/abdf1a09-d8a6-4b98-a230-02587cc16cb1-kube-api-access-6gjkw\") pod \"ingress-canary-vlj5g\" (UID: \"abdf1a09-d8a6-4b98-a230-02587cc16cb1\") " pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.403633 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403589 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abdf1a09-d8a6-4b98-a230-02587cc16cb1-cert\") pod \"ingress-canary-vlj5g\" (UID: \"abdf1a09-d8a6-4b98-a230-02587cc16cb1\") " pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.403633 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403606 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3dc158d-9dca-4a72-aa1d-e48a703efb05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.403633 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403632 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbhfv\" (UniqueName: \"kubernetes.io/projected/a3dc158d-9dca-4a72-aa1d-e48a703efb05-kube-api-access-gbhfv\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.404060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9877a11-9555-4c5d-8744-841ba91822dc-metrics-tls\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.404060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403674 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3dc158d-9dca-4a72-aa1d-e48a703efb05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.404060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403690 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6tqx5\" (UniqueName: \"kubernetes.io/projected/f9877a11-9555-4c5d-8744-841ba91822dc-kube-api-access-6tqx5\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.404060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403845 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-k2x7t\"" Jun 15 07:49:33.404060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403888 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 15 07:49:33.404060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.403893 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 15 07:49:33.404251 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.404220 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 15 07:49:33.404251 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.404238 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 15 07:49:33.504359 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504268 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abdf1a09-d8a6-4b98-a230-02587cc16cb1-cert\") pod \"ingress-canary-vlj5g\" (UID: \"abdf1a09-d8a6-4b98-a230-02587cc16cb1\") " pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.504359 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504308 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3dc158d-9dca-4a72-aa1d-e48a703efb05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.504359 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504334 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbhfv\" (UniqueName: \"kubernetes.io/projected/a3dc158d-9dca-4a72-aa1d-e48a703efb05-kube-api-access-gbhfv\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.504359 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504357 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9877a11-9555-4c5d-8744-841ba91822dc-metrics-tls\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.504714 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504383 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3dc158d-9dca-4a72-aa1d-e48a703efb05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.504714 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504401 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6tqx5\" (UniqueName: \"kubernetes.io/projected/f9877a11-9555-4c5d-8744-841ba91822dc-kube-api-access-6tqx5\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.504714 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504436 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9877a11-9555-4c5d-8744-841ba91822dc-config-volume\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.504714 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504561 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9877a11-9555-4c5d-8744-841ba91822dc-tmp-dir\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.504714 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504592 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3dc158d-9dca-4a72-aa1d-e48a703efb05-data-volume\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.504714 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504655 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3dc158d-9dca-4a72-aa1d-e48a703efb05-crio-socket\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.504714 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.504679 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gjkw\" (UniqueName: \"kubernetes.io/projected/abdf1a09-d8a6-4b98-a230-02587cc16cb1-kube-api-access-6gjkw\") pod \"ingress-canary-vlj5g\" (UID: \"abdf1a09-d8a6-4b98-a230-02587cc16cb1\") " pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.505025 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.505005 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3dc158d-9dca-4a72-aa1d-e48a703efb05-data-volume\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.505025 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.505012 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3dc158d-9dca-4a72-aa1d-e48a703efb05-crio-socket\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.505192 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.505162 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3dc158d-9dca-4a72-aa1d-e48a703efb05-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.505290 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.505166 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f9877a11-9555-4c5d-8744-841ba91822dc-tmp-dir\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.505290 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.505230 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/f9877a11-9555-4c5d-8744-841ba91822dc-config-volume\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.508741 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.508719 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3dc158d-9dca-4a72-aa1d-e48a703efb05-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.508834 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.508744 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/abdf1a09-d8a6-4b98-a230-02587cc16cb1-cert\") pod \"ingress-canary-vlj5g\" (UID: \"abdf1a09-d8a6-4b98-a230-02587cc16cb1\") " pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.508834 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.508765 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/f9877a11-9555-4c5d-8744-841ba91822dc-metrics-tls\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.513195 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.513175 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbhfv\" (UniqueName: \"kubernetes.io/projected/a3dc158d-9dca-4a72-aa1d-e48a703efb05-kube-api-access-gbhfv\") pod \"insights-runtime-extractor-xbmq2\" (UID: \"a3dc158d-9dca-4a72-aa1d-e48a703efb05\") " pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.513370 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.513350 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6tqx5\" (UniqueName: \"kubernetes.io/projected/f9877a11-9555-4c5d-8744-841ba91822dc-kube-api-access-6tqx5\") pod \"dns-default-cf8q5\" (UID: \"f9877a11-9555-4c5d-8744-841ba91822dc\") " pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.513431 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.513373 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gjkw\" (UniqueName: \"kubernetes.io/projected/abdf1a09-d8a6-4b98-a230-02587cc16cb1-kube-api-access-6gjkw\") pod \"ingress-canary-vlj5g\" (UID: \"abdf1a09-d8a6-4b98-a230-02587cc16cb1\") " pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.665118 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.665079 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:33.685306 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.685278 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vlj5g" Jun 15 07:49:33.709060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.709031 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xbmq2" Jun 15 07:49:33.863782 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.863734 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vlj5g"] Jun 15 07:49:33.864527 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.864507 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cf8q5"] Jun 15 07:49:33.869013 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.868992 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xbmq2"] Jun 15 07:49:33.870564 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:33.870532 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf9877a11_9555_4c5d_8744_841ba91822dc.slice/crio-05f424063dd0c3e7c77de9404d775adbf5988d8e7d6eb0b86ab0fa374ebd0566 WatchSource:0}: Error finding container 05f424063dd0c3e7c77de9404d775adbf5988d8e7d6eb0b86ab0fa374ebd0566: Status 404 returned error can't find the container with id 05f424063dd0c3e7c77de9404d775adbf5988d8e7d6eb0b86ab0fa374ebd0566 Jun 15 07:49:33.871094 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:33.871068 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podabdf1a09_d8a6_4b98_a230_02587cc16cb1.slice/crio-850d1898709e402e5931396380d0e105773fb8cf46377ab2be346ea6bce675a1 WatchSource:0}: Error finding container 850d1898709e402e5931396380d0e105773fb8cf46377ab2be346ea6bce675a1: Status 404 returned error can't find the container with id 850d1898709e402e5931396380d0e105773fb8cf46377ab2be346ea6bce675a1 Jun 15 07:49:33.871745 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:33.871667 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3dc158d_9dca_4a72_aa1d_e48a703efb05.slice/crio-dea07fcf8f77ea3fdcbe35bbe8d7d01cea9f6b724fc93ac704d4b9649def50fe WatchSource:0}: Error finding container dea07fcf8f77ea3fdcbe35bbe8d7d01cea9f6b724fc93ac704d4b9649def50fe: Status 404 returned error can't find the container with id dea07fcf8f77ea3fdcbe35bbe8d7d01cea9f6b724fc93ac704d4b9649def50fe Jun 15 07:49:33.918539 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.918510 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:33.918702 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.918544 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:33.918702 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.918597 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:33.921362 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.921340 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 07:49:33.921703 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.921687 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 07:49:33.921776 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.921714 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 07:49:33.921816 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.921788 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8fnrw\"" Jun 15 07:49:33.921857 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.921839 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8vjrj\"" Jun 15 07:49:33.922622 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:33.922606 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 07:49:34.101627 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:34.101536 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbmq2" event={"ID":"a3dc158d-9dca-4a72-aa1d-e48a703efb05","Type":"ContainerStarted","Data":"dea07fcf8f77ea3fdcbe35bbe8d7d01cea9f6b724fc93ac704d4b9649def50fe"} Jun 15 07:49:34.102681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:34.102659 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlj5g" event={"ID":"abdf1a09-d8a6-4b98-a230-02587cc16cb1","Type":"ContainerStarted","Data":"850d1898709e402e5931396380d0e105773fb8cf46377ab2be346ea6bce675a1"} Jun 15 07:49:34.103799 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:34.103777 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf8q5" event={"ID":"f9877a11-9555-4c5d-8744-841ba91822dc","Type":"ContainerStarted","Data":"05f424063dd0c3e7c77de9404d775adbf5988d8e7d6eb0b86ab0fa374ebd0566"} Jun 15 07:49:39.121250 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:39.121117 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf8q5" event={"ID":"f9877a11-9555-4c5d-8744-841ba91822dc","Type":"ContainerStarted","Data":"c03cbb3d618a2c7d75b9524c6cbbf2db0265cd2f6c77c994a08517645269145e"} Jun 15 07:49:40.124557 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:40.124512 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbmq2" event={"ID":"a3dc158d-9dca-4a72-aa1d-e48a703efb05","Type":"ContainerStarted","Data":"4e9aed922b74455544f2fd80517220c27b2d7cfae57bbe7695de831b480f3c30"} Jun 15 07:49:40.125875 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:40.125849 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vlj5g" event={"ID":"abdf1a09-d8a6-4b98-a230-02587cc16cb1","Type":"ContainerStarted","Data":"650bf3b4df75ab41f1bd52a24d801a39668169786fd423749e1ada8dbcfccc3a"} Jun 15 07:49:40.127593 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:40.127573 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cf8q5" event={"ID":"f9877a11-9555-4c5d-8744-841ba91822dc","Type":"ContainerStarted","Data":"fe4b53a68d2d6fa0aae7d34f7eb8ca44ca834a5996ef1d748aaa55f041113295"} Jun 15 07:49:40.127712 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:40.127695 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:40.143991 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:40.143954 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vlj5g" podStartSLOduration=1.9977771 podStartE2EDuration="7.143942327s" totalImagesPullingTime="5.146165227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:40.142291522 +0000 UTC m=+51.663779849" watchObservedRunningTime="2026-06-15 07:49:40.143942327 +0000 UTC m=+51.665430650" Jun 15 07:49:40.160355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:40.160314 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cf8q5" podStartSLOduration=2.014621057 podStartE2EDuration="7.160300524s" totalImagesPullingTime="5.145679467s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:40.159757159 +0000 UTC m=+51.681245487" watchObservedRunningTime="2026-06-15 07:49:40.160300524 +0000 UTC m=+51.681788851" Jun 15 07:49:41.133028 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.132983 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbmq2" event={"ID":"a3dc158d-9dca-4a72-aa1d-e48a703efb05","Type":"ContainerStarted","Data":"511d8eb7b80172580131111b1767afd7d204806e3ef7b4a8a3ce62ef74055376"} Jun 15 07:49:41.898875 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.898630 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-694c955b9-mqc9x"] Jun 15 07:49:41.923075 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.923043 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-mqc9x"] Jun 15 07:49:41.923075 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.923074 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-mqc9x" Jun 15 07:49:41.925838 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.925684 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-m7tbp\"" Jun 15 07:49:41.925838 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.925741 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 15 07:49:41.925838 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.925745 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 15 07:49:41.962507 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:41.962479 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9x6m4\" (UniqueName: \"kubernetes.io/projected/390c8ea5-8cb6-44fc-81a1-4134a1c5ada3-kube-api-access-9x6m4\") pod \"downloads-694c955b9-mqc9x\" (UID: \"390c8ea5-8cb6-44fc-81a1-4134a1c5ada3\") " pod="openshift-console/downloads-694c955b9-mqc9x" Jun 15 07:49:42.063548 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:42.063516 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9x6m4\" (UniqueName: \"kubernetes.io/projected/390c8ea5-8cb6-44fc-81a1-4134a1c5ada3-kube-api-access-9x6m4\") pod \"downloads-694c955b9-mqc9x\" (UID: \"390c8ea5-8cb6-44fc-81a1-4134a1c5ada3\") " pod="openshift-console/downloads-694c955b9-mqc9x" Jun 15 07:49:42.077124 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:42.077096 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9x6m4\" (UniqueName: \"kubernetes.io/projected/390c8ea5-8cb6-44fc-81a1-4134a1c5ada3-kube-api-access-9x6m4\") pod \"downloads-694c955b9-mqc9x\" (UID: \"390c8ea5-8cb6-44fc-81a1-4134a1c5ada3\") " pod="openshift-console/downloads-694c955b9-mqc9x" Jun 15 07:49:42.234897 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:42.234782 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-694c955b9-mqc9x" Jun 15 07:49:42.389908 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:42.389882 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-694c955b9-mqc9x"] Jun 15 07:49:42.393494 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:42.393450 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod390c8ea5_8cb6_44fc_81a1_4134a1c5ada3.slice/crio-72ec646c2e231dbe39589224bd58bd1106612fc8b8414bc2d47fd834f9d4d4fd WatchSource:0}: Error finding container 72ec646c2e231dbe39589224bd58bd1106612fc8b8414bc2d47fd834f9d4d4fd: Status 404 returned error can't find the container with id 72ec646c2e231dbe39589224bd58bd1106612fc8b8414bc2d47fd834f9d4d4fd Jun 15 07:49:43.140775 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:43.140735 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-mqc9x" event={"ID":"390c8ea5-8cb6-44fc-81a1-4134a1c5ada3","Type":"ContainerStarted","Data":"72ec646c2e231dbe39589224bd58bd1106612fc8b8414bc2d47fd834f9d4d4fd"} Jun 15 07:49:43.143002 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:43.142968 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xbmq2" event={"ID":"a3dc158d-9dca-4a72-aa1d-e48a703efb05","Type":"ContainerStarted","Data":"e87628285de4f5739b78f9f13f7331e9250fd41a7fb1fc4fad41769999b22f6b"} Jun 15 07:49:43.162684 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:43.162631 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xbmq2" podStartSLOduration=2.0125769 podStartE2EDuration="10.162609828s" totalImagesPullingTime="8.150032928s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:49:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:43.161976539 +0000 UTC m=+54.683464865" watchObservedRunningTime="2026-06-15 07:49:43.162609828 +0000 UTC m=+54.684098155" Jun 15 07:49:45.387188 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.386971 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7"] Jun 15 07:49:45.389193 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.389177 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.391808 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.391785 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 15 07:49:45.391911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.391788 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 15 07:49:45.393088 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.393066 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 15 07:49:45.393178 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.393129 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 15 07:49:45.393178 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.393066 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-x9b5s\"" Jun 15 07:49:45.393178 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.393079 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 15 07:49:45.399224 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.399205 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7"] Jun 15 07:49:45.492509 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.492478 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77b150fc-5955-4074-aba9-03bd950841cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.492671 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.492522 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77b150fc-5955-4074-aba9-03bd950841cf-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.492671 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.492553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/77b150fc-5955-4074-aba9-03bd950841cf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.492671 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.492621 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h9cmj\" (UniqueName: \"kubernetes.io/projected/77b150fc-5955-4074-aba9-03bd950841cf-kube-api-access-h9cmj\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.593838 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.593800 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77b150fc-5955-4074-aba9-03bd950841cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.594022 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.593848 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77b150fc-5955-4074-aba9-03bd950841cf-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.594022 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.593883 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/77b150fc-5955-4074-aba9-03bd950841cf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.594022 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.593944 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h9cmj\" (UniqueName: \"kubernetes.io/projected/77b150fc-5955-4074-aba9-03bd950841cf-kube-api-access-h9cmj\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.594760 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.594727 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/77b150fc-5955-4074-aba9-03bd950841cf-metrics-client-ca\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.598594 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.598569 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/77b150fc-5955-4074-aba9-03bd950841cf-prometheus-operator-tls\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.598712 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.598568 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/77b150fc-5955-4074-aba9-03bd950841cf-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.603080 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.602948 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h9cmj\" (UniqueName: \"kubernetes.io/projected/77b150fc-5955-4074-aba9-03bd950841cf-kube-api-access-h9cmj\") pod \"prometheus-operator-864fcfc6f9-pjjk7\" (UID: \"77b150fc-5955-4074-aba9-03bd950841cf\") " pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.702389 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.702358 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" Jun 15 07:49:45.841295 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:45.841265 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7"] Jun 15 07:49:45.844940 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:45.844910 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77b150fc_5955_4074_aba9_03bd950841cf.slice/crio-5294dc39d578fbda68d31b2488bf5aa71a7549f594e6e9a0e6609bb12d415d0b WatchSource:0}: Error finding container 5294dc39d578fbda68d31b2488bf5aa71a7549f594e6e9a0e6609bb12d415d0b: Status 404 returned error can't find the container with id 5294dc39d578fbda68d31b2488bf5aa71a7549f594e6e9a0e6609bb12d415d0b Jun 15 07:49:46.155118 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:46.155084 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" event={"ID":"77b150fc-5955-4074-aba9-03bd950841cf","Type":"ContainerStarted","Data":"5294dc39d578fbda68d31b2488bf5aa71a7549f594e6e9a0e6609bb12d415d0b"} Jun 15 07:49:48.166745 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:48.166704 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" event={"ID":"77b150fc-5955-4074-aba9-03bd950841cf","Type":"ContainerStarted","Data":"3735c9a50528814e2740057eba6034f80f7dbda9cbc37421fed859f9586b0547"} Jun 15 07:49:48.167229 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:48.166804 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" event={"ID":"77b150fc-5955-4074-aba9-03bd950841cf","Type":"ContainerStarted","Data":"76f910b4ad05412b2fcf76f7efbc4317abe2907aa6f20a9b5a9696890d091f47"} Jun 15 07:49:48.184949 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:48.184905 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-864fcfc6f9-pjjk7" podStartSLOduration=1.8820225879999999 podStartE2EDuration="3.184891213s" totalImagesPullingTime="1.302868625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:49:48.183627067 +0000 UTC m=+59.705115397" watchObservedRunningTime="2026-06-15 07:49:48.184891213 +0000 UTC m=+59.706379560" Jun 15 07:49:49.748288 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.748251 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw"] Jun 15 07:49:49.772360 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.772329 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-96g9h"] Jun 15 07:49:49.772543 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.772431 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.774995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.774970 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 15 07:49:49.776425 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.776363 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-tbb6r\"" Jun 15 07:49:49.776425 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.776412 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 15 07:49:49.776600 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.776437 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 15 07:49:49.794476 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.794442 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw"] Jun 15 07:49:49.794584 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.794573 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.796869 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.796849 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-sjfgn\"" Jun 15 07:49:49.797116 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.797095 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 15 07:49:49.797210 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.797126 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 15 07:49:49.797210 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.797205 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 15 07:49:49.826762 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826735 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.826902 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826772 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fab62719-b262-4f52-a896-b8662210495c-node-exporter-tls\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.826902 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826797 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fab62719-b262-4f52-a896-b8662210495c-node-exporter-textfile\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.826902 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826825 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fab62719-b262-4f52-a896-b8662210495c-node-exporter-accelerators-collector-config\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.826902 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826868 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fab62719-b262-4f52-a896-b8662210495c-metrics-client-ca\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.826902 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826886 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-sys\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.827135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826910 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.827135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.826936 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw496\" (UniqueName: \"kubernetes.io/projected/fab62719-b262-4f52-a896-b8662210495c-kube-api-access-dw496\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.827135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.827002 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-node-exporter-wtmp\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.827135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.827038 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fab62719-b262-4f52-a896-b8662210495c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.827135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.827059 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.827135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.827075 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.827436 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.827138 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.827436 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.827178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z92rc\" (UniqueName: \"kubernetes.io/projected/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-api-access-z92rc\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.827436 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.827227 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-root\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928346 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928314 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fab62719-b262-4f52-a896-b8662210495c-node-exporter-tls\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928346 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928350 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fab62719-b262-4f52-a896-b8662210495c-node-exporter-textfile\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928598 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928376 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fab62719-b262-4f52-a896-b8662210495c-node-exporter-accelerators-collector-config\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928662 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928592 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fab62719-b262-4f52-a896-b8662210495c-metrics-client-ca\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928662 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928637 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-sys\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928762 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928667 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.928762 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928694 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw496\" (UniqueName: \"kubernetes.io/projected/fab62719-b262-4f52-a896-b8662210495c-kube-api-access-dw496\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928762 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928738 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-node-exporter-wtmp\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928782 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fab62719-b262-4f52-a896-b8662210495c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928794 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/fab62719-b262-4f52-a896-b8662210495c-node-exporter-textfile\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.928911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928811 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.928911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928837 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.928911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928874 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.928911 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928902 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z92rc\" (UniqueName: \"kubernetes.io/projected/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-api-access-z92rc\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.929184 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928946 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-root\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.929184 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.928978 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.929184 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929005 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/fab62719-b262-4f52-a896-b8662210495c-node-exporter-accelerators-collector-config\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.929184 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929162 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.929389 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929200 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-sys\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.929389 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929259 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/fab62719-b262-4f52-a896-b8662210495c-metrics-client-ca\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.929389 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929303 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-node-exporter-wtmp\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.929389 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929358 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/fab62719-b262-4f52-a896-b8662210495c-root\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.929711 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929659 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.929825 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.929766 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.931397 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.931378 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/fab62719-b262-4f52-a896-b8662210495c-node-exporter-tls\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.932115 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.932088 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.932204 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.932140 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:49.932204 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.932157 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/fab62719-b262-4f52-a896-b8662210495c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.937172 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.937142 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw496\" (UniqueName: \"kubernetes.io/projected/fab62719-b262-4f52-a896-b8662210495c-kube-api-access-dw496\") pod \"node-exporter-96g9h\" (UID: \"fab62719-b262-4f52-a896-b8662210495c\") " pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:49.937172 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:49.937153 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z92rc\" (UniqueName: \"kubernetes.io/projected/eb5c44e8-6c87-40d9-9f45-5782d3393c6a-kube-api-access-z92rc\") pod \"kube-state-metrics-678bc549d7-vtxtw\" (UID: \"eb5c44e8-6c87-40d9-9f45-5782d3393c6a\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:50.067956 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:50.067887 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-zcc9c" Jun 15 07:49:50.082800 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:50.082778 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" Jun 15 07:49:50.106777 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:50.106750 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-96g9h" Jun 15 07:49:50.124595 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:50.124561 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfab62719_b262_4f52_a896_b8662210495c.slice/crio-48277e6c263ebb408c5a06d6e0ee60ebca94229c274eecb7e9c63b3bed777d20 WatchSource:0}: Error finding container 48277e6c263ebb408c5a06d6e0ee60ebca94229c274eecb7e9c63b3bed777d20: Status 404 returned error can't find the container with id 48277e6c263ebb408c5a06d6e0ee60ebca94229c274eecb7e9c63b3bed777d20 Jun 15 07:49:50.135952 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:50.135476 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cf8q5" Jun 15 07:49:50.177282 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:50.177154 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96g9h" event={"ID":"fab62719-b262-4f52-a896-b8662210495c","Type":"ContainerStarted","Data":"48277e6c263ebb408c5a06d6e0ee60ebca94229c274eecb7e9c63b3bed777d20"} Jun 15 07:49:50.266450 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:50.266417 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw"] Jun 15 07:49:50.270831 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:50.270803 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb5c44e8_6c87_40d9_9f45_5782d3393c6a.slice/crio-2f4d48ace7d6b0a7cb51159418a8736a46a9fd11658c46210d8b748c2d188b23 WatchSource:0}: Error finding container 2f4d48ace7d6b0a7cb51159418a8736a46a9fd11658c46210d8b748c2d188b23: Status 404 returned error can't find the container with id 2f4d48ace7d6b0a7cb51159418a8736a46a9fd11658c46210d8b748c2d188b23 Jun 15 07:49:51.182990 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.182942 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" event={"ID":"eb5c44e8-6c87-40d9-9f45-5782d3393c6a","Type":"ContainerStarted","Data":"2f4d48ace7d6b0a7cb51159418a8736a46a9fd11658c46210d8b748c2d188b23"} Jun 15 07:49:51.741181 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.741156 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-77969c67b6-9v4g5"] Jun 15 07:49:51.744029 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.743383 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.746202 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.746182 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 15 07:49:51.746509 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.746445 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 15 07:49:51.746861 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.746838 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 15 07:49:51.746974 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.746957 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 15 07:49:51.747045 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.746997 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-e3qpui20ukked\"" Jun 15 07:49:51.747100 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.747042 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-z49f5\"" Jun 15 07:49:51.747515 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.747498 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 15 07:49:51.757818 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.757789 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77969c67b6-9v4g5"] Jun 15 07:49:51.846312 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846257 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.846491 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846337 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e24901-27b9-4965-a4ba-519463deaa1c-metrics-client-ca\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.846537 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846503 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.846580 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846544 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-grpc-tls\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.846614 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846585 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fchdl\" (UniqueName: \"kubernetes.io/projected/38e24901-27b9-4965-a4ba-519463deaa1c-kube-api-access-fchdl\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.846648 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846611 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-tls\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.846713 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846652 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.846798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.846729 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.947841 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.947746 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.947841 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.947795 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-grpc-tls\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.947841 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.947830 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fchdl\" (UniqueName: \"kubernetes.io/projected/38e24901-27b9-4965-a4ba-519463deaa1c-kube-api-access-fchdl\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.948102 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.947854 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-tls\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.948102 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.947887 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.948102 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.947916 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.948102 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.947980 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.948102 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.948022 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e24901-27b9-4965-a4ba-519463deaa1c-metrics-client-ca\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.948839 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.948786 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/38e24901-27b9-4965-a4ba-519463deaa1c-metrics-client-ca\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.951035 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.950972 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.951135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.951089 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-grpc-tls\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.951757 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.951724 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.952156 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.952135 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.952252 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.952190 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.952560 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.952543 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/38e24901-27b9-4965-a4ba-519463deaa1c-secret-thanos-querier-tls\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:51.957342 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:51.957311 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fchdl\" (UniqueName: \"kubernetes.io/projected/38e24901-27b9-4965-a4ba-519463deaa1c-kube-api-access-fchdl\") pod \"thanos-querier-77969c67b6-9v4g5\" (UID: \"38e24901-27b9-4965-a4ba-519463deaa1c\") " pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:52.056401 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:52.056357 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:49:52.193798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:52.193760 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96g9h" event={"ID":"fab62719-b262-4f52-a896-b8662210495c","Type":"ContainerStarted","Data":"010a5936c7e1f5a99a946a8525661ec235aca87be1826c994769c12f2c673fa3"} Jun 15 07:49:52.195516 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:52.195491 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" event={"ID":"eb5c44e8-6c87-40d9-9f45-5782d3393c6a","Type":"ContainerStarted","Data":"4abfbbade8758b98f03b8e616e7eb41b8c68f64653d204dd1591f951ffcee8d3"} Jun 15 07:49:54.044750 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.044712 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-5b4b977964-qkt95"] Jun 15 07:49:54.047139 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.047112 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.049508 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.049364 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 15 07:49:54.049764 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.049738 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 15 07:49:54.049892 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.049839 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 15 07:49:54.050982 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.050961 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-gb6kw\"" Jun 15 07:49:54.050982 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.050961 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 15 07:49:54.051140 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.051059 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1178olh8glvd4\"" Jun 15 07:49:54.059810 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.059789 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b4b977964-qkt95"] Jun 15 07:49:54.167706 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.167667 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjprk\" (UniqueName: \"kubernetes.io/projected/c94c3744-a2d4-4e4d-a653-e5cd0782941e-kube-api-access-xjprk\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.167873 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.167725 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-client-ca-bundle\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.167873 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.167831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-secret-metrics-server-client-certs\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.167982 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.167915 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-secret-metrics-server-tls\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.167982 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.167955 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94c3744-a2d4-4e4d-a653-e5cd0782941e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.168066 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.168025 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c94c3744-a2d4-4e4d-a653-e5cd0782941e-audit-log\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.168066 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.168047 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c94c3744-a2d4-4e4d-a653-e5cd0782941e-metrics-server-audit-profiles\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269216 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c94c3744-a2d4-4e4d-a653-e5cd0782941e-metrics-server-audit-profiles\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269401 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjprk\" (UniqueName: \"kubernetes.io/projected/c94c3744-a2d4-4e4d-a653-e5cd0782941e-kube-api-access-xjprk\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269401 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269324 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-client-ca-bundle\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269401 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-secret-metrics-server-client-certs\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269401 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269395 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-secret-metrics-server-tls\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269597 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269421 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94c3744-a2d4-4e4d-a653-e5cd0782941e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269597 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269499 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c94c3744-a2d4-4e4d-a653-e5cd0782941e-audit-log\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.269865 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.269837 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/c94c3744-a2d4-4e4d-a653-e5cd0782941e-audit-log\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.270297 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.270248 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c94c3744-a2d4-4e4d-a653-e5cd0782941e-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.270394 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.270324 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/c94c3744-a2d4-4e4d-a653-e5cd0782941e-metrics-server-audit-profiles\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.272272 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.272253 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-secret-metrics-server-client-certs\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.272368 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.272352 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-client-ca-bundle\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.272562 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.272533 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/c94c3744-a2d4-4e4d-a653-e5cd0782941e-secret-metrics-server-tls\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.278909 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.278866 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjprk\" (UniqueName: \"kubernetes.io/projected/c94c3744-a2d4-4e4d-a653-e5cd0782941e-kube-api-access-xjprk\") pod \"metrics-server-5b4b977964-qkt95\" (UID: \"c94c3744-a2d4-4e4d-a653-e5cd0782941e\") " pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.358451 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.358378 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:49:54.517196 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.517159 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk"] Jun 15 07:49:54.519355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.519333 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:54.521786 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.521758 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-5zmcz\"" Jun 15 07:49:54.521786 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.521783 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 15 07:49:54.535373 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.535345 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk"] Jun 15 07:49:54.572058 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.572023 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-snnt9\" (UniqueName: \"kubernetes.io/projected/6e8f199a-46fa-450c-ab64-2ad95b7979f3-kube-api-access-snnt9\") pod \"monitoring-plugin-589576dfc7-ddxnk\" (UID: \"6e8f199a-46fa-450c-ab64-2ad95b7979f3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:54.572191 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.572136 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e8f199a-46fa-450c-ab64-2ad95b7979f3-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-ddxnk\" (UID: \"6e8f199a-46fa-450c-ab64-2ad95b7979f3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:54.672732 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.672693 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-snnt9\" (UniqueName: \"kubernetes.io/projected/6e8f199a-46fa-450c-ab64-2ad95b7979f3-kube-api-access-snnt9\") pod \"monitoring-plugin-589576dfc7-ddxnk\" (UID: \"6e8f199a-46fa-450c-ab64-2ad95b7979f3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:54.672930 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.672779 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:54.672930 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.672831 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e8f199a-46fa-450c-ab64-2ad95b7979f3-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-ddxnk\" (UID: \"6e8f199a-46fa-450c-ab64-2ad95b7979f3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:54.673060 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:54.672944 2569 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 15 07:49:54.673060 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:49:54.672999 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6e8f199a-46fa-450c-ab64-2ad95b7979f3-monitoring-plugin-cert podName:6e8f199a-46fa-450c-ab64-2ad95b7979f3 nodeName:}" failed. No retries permitted until 2026-06-15 07:49:55.172985574 +0000 UTC m=+66.694473877 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/6e8f199a-46fa-450c-ab64-2ad95b7979f3-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-ddxnk" (UID: "6e8f199a-46fa-450c-ab64-2ad95b7979f3") : secret "monitoring-plugin-cert" not found Jun 15 07:49:54.675243 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.675214 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 15 07:49:54.684243 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.684219 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-snnt9\" (UniqueName: \"kubernetes.io/projected/6e8f199a-46fa-450c-ab64-2ad95b7979f3-kube-api-access-snnt9\") pod \"monitoring-plugin-589576dfc7-ddxnk\" (UID: \"6e8f199a-46fa-450c-ab64-2ad95b7979f3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:54.686104 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.686081 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/02ffc07a-6d44-47df-90ea-c657938899b3-metrics-certs\") pod \"network-metrics-daemon-gl5lq\" (UID: \"02ffc07a-6d44-47df-90ea-c657938899b3\") " pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:54.773624 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.773577 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:54.776060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.776032 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 15 07:49:54.786600 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.786579 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e-original-pull-secret\") pod \"global-pull-secret-syncer-wkn8j\" (UID: \"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e\") " pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:54.874890 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.874853 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:54.877435 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.877411 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 15 07:49:54.887903 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.887878 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 15 07:49:54.900906 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.900881 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-85nfp\" (UniqueName: \"kubernetes.io/projected/381d224d-21be-41fc-96f7-8477a8e25573-kube-api-access-85nfp\") pod \"network-check-target-s97zs\" (UID: \"381d224d-21be-41fc-96f7-8477a8e25573\") " pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:54.926571 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.926506 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-55d8b596b5-zfdt7"] Jun 15 07:49:54.929544 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.929525 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.931239 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.931215 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8fnrw\"" Jun 15 07:49:54.931948 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.931926 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 15 07:49:54.932121 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.931954 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 15 07:49:54.932217 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.932166 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 15 07:49:54.932298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.932274 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 15 07:49:54.932411 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.932398 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qkvwb\"" Jun 15 07:49:54.932540 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.932517 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 15 07:49:54.939479 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.938931 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-wkn8j" Jun 15 07:49:54.940055 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.939528 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:49:54.940884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.940303 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-8vjrj\"" Jun 15 07:49:54.944082 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.944062 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55d8b596b5-zfdt7"] Jun 15 07:49:54.944637 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.944613 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 15 07:49:54.944784 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.944764 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gl5lq" Jun 15 07:49:54.976063 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976032 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-telemeter-client-tls\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.976197 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976090 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-federate-client-tls\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.976197 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976113 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.976197 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976142 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bvqpk\" (UniqueName: \"kubernetes.io/projected/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-kube-api-access-bvqpk\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.976367 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976198 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-secret-telemeter-client\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.976367 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976234 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-metrics-client-ca\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.976367 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976256 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-serving-certs-ca-bundle\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:54.976367 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:54.976278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.077580 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077542 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-telemeter-client-tls\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.078023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077603 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-federate-client-tls\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.078023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077629 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.078023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077659 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bvqpk\" (UniqueName: \"kubernetes.io/projected/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-kube-api-access-bvqpk\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.078023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-secret-telemeter-client\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.078023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077726 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-metrics-client-ca\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.078023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077757 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-serving-certs-ca-bundle\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.078023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.077774 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.079350 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.078713 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-metrics-client-ca\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.079350 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.078722 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-telemeter-trusted-ca-bundle\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.079350 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.079255 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-serving-certs-ca-bundle\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.080754 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.080722 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.080954 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.080926 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-federate-client-tls\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.081078 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.080978 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-secret-telemeter-client\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.081078 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.080984 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-telemeter-client-tls\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.087069 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.087048 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bvqpk\" (UniqueName: \"kubernetes.io/projected/a2f834ba-efa3-43fb-bb8f-e7dd6d742629-kube-api-access-bvqpk\") pod \"telemeter-client-55d8b596b5-zfdt7\" (UID: \"a2f834ba-efa3-43fb-bb8f-e7dd6d742629\") " pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.178452 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.178369 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e8f199a-46fa-450c-ab64-2ad95b7979f3-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-ddxnk\" (UID: \"6e8f199a-46fa-450c-ab64-2ad95b7979f3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:55.180940 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.180917 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6e8f199a-46fa-450c-ab64-2ad95b7979f3-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-ddxnk\" (UID: \"6e8f199a-46fa-450c-ab64-2ad95b7979f3\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:55.245013 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.244981 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" Jun 15 07:49:55.430063 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.429983 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:49:55.948432 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.948384 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:49:55.968034 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.968003 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:49:55.968217 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.968185 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:55.971297 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.971117 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c8gic3vvm6drl\"" Jun 15 07:49:55.971297 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.971239 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 07:49:55.971524 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.971484 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 07:49:55.971524 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.971492 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 07:49:55.971634 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.971549 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 07:49:55.971796 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.971768 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 07:49:55.971888 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.971857 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 07:49:55.972049 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.972034 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-thwfm\"" Jun 15 07:49:55.973876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.972846 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 07:49:55.973876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.973042 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 07:49:55.973876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.973257 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 07:49:55.973876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.973502 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 07:49:55.973876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.973706 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 07:49:55.973876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.973740 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 07:49:55.974239 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.974087 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 07:49:55.975041 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:55.974865 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 07:49:56.087473 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087410 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087491 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087557 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087588 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087633 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087657 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087712 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087754 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087797 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087823 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087845 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087898 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087944 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087972 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.087987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.087996 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.088701 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.088024 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.088701 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.088059 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.088701 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.088097 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.088701 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.088126 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48s46\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-kube-api-access-48s46\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.088701 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.088161 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.188885 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.188835 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.188892 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.188937 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.188983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189014 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189071 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189097 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189123 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189158 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189189 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189213 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189237 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189266 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189300 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189330 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48s46\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-kube-api-access-48s46\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189389 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189437 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189506 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189629 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.189987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.189742 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.190188 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.190170 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.190883 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.190570 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.190883 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.190698 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.191367 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.191341 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.192015 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.191987 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.192368 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.192344 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.193548 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.193211 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-web-config\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.194286 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.194246 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.195474 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.195410 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.196539 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.196491 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.197985 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.197958 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.198346 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.198324 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.199026 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.198673 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.199026 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.198884 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.199026 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.199010 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.199026 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.199020 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.200649 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.200609 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config-out\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.201477 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.201438 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48s46\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-kube-api-access-48s46\") pod \"prometheus-k8s-0\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:56.284507 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:56.284413 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:49:59.251017 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.250927 2569 generic.go:356] "Generic (PLEG): container finished" podID="fab62719-b262-4f52-a896-b8662210495c" containerID="010a5936c7e1f5a99a946a8525661ec235aca87be1826c994769c12f2c673fa3" exitCode=0 Jun 15 07:49:59.251017 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.250974 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96g9h" event={"ID":"fab62719-b262-4f52-a896-b8662210495c","Type":"ContainerDied","Data":"010a5936c7e1f5a99a946a8525661ec235aca87be1826c994769c12f2c673fa3"} Jun 15 07:49:59.371573 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.371005 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-77969c67b6-9v4g5"] Jun 15 07:49:59.377128 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.377105 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gl5lq"] Jun 15 07:49:59.396067 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.395974 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-s97zs"] Jun 15 07:49:59.483681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.483591 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:49:59.485949 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:59.485920 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac85a5aa_89cd_43c7_9c6b_ecb27a1ceb52.slice/crio-e7a8496749948ab8c876b95fe11a534bf3261ae39ca21d55314c44cadc7a8b81 WatchSource:0}: Error finding container e7a8496749948ab8c876b95fe11a534bf3261ae39ca21d55314c44cadc7a8b81: Status 404 returned error can't find the container with id e7a8496749948ab8c876b95fe11a534bf3261ae39ca21d55314c44cadc7a8b81 Jun 15 07:49:59.630706 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.630560 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-wkn8j"] Jun 15 07:49:59.633560 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.633531 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk"] Jun 15 07:49:59.634243 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:59.634216 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61ef1fc1_b8e0_4e3c_a9af_f9517f336e8e.slice/crio-df6bd7d97adf68f2cfef5fca8984fec99907e3568bbb6baeb8003ff96363d8e3 WatchSource:0}: Error finding container df6bd7d97adf68f2cfef5fca8984fec99907e3568bbb6baeb8003ff96363d8e3: Status 404 returned error can't find the container with id df6bd7d97adf68f2cfef5fca8984fec99907e3568bbb6baeb8003ff96363d8e3 Jun 15 07:49:59.637142 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:59.637117 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e8f199a_46fa_450c_ab64_2ad95b7979f3.slice/crio-2a36868f4e2a55962031cc693c98e97695712a1ffefd687eb783c899a084a88c WatchSource:0}: Error finding container 2a36868f4e2a55962031cc693c98e97695712a1ffefd687eb783c899a084a88c: Status 404 returned error can't find the container with id 2a36868f4e2a55962031cc693c98e97695712a1ffefd687eb783c899a084a88c Jun 15 07:49:59.641668 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.641647 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-5b4b977964-qkt95"] Jun 15 07:49:59.644128 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:59.644105 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc94c3744_a2d4_4e4d_a653_e5cd0782941e.slice/crio-72ba964d4202dae08b8b332cc92fa2bb1e3ca0df23dc84e7452b11e66d07d5e3 WatchSource:0}: Error finding container 72ba964d4202dae08b8b332cc92fa2bb1e3ca0df23dc84e7452b11e66d07d5e3: Status 404 returned error can't find the container with id 72ba964d4202dae08b8b332cc92fa2bb1e3ca0df23dc84e7452b11e66d07d5e3 Jun 15 07:49:59.652034 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:49:59.651902 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-55d8b596b5-zfdt7"] Jun 15 07:49:59.655043 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:49:59.655004 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f834ba_efa3_43fb_bb8f_e7dd6d742629.slice/crio-14f442154df3d324ded9f87bd8de341116e45d2c4177c77cd2fc57b3cb27dc76 WatchSource:0}: Error finding container 14f442154df3d324ded9f87bd8de341116e45d2c4177c77cd2fc57b3cb27dc76: Status 404 returned error can't find the container with id 14f442154df3d324ded9f87bd8de341116e45d2c4177c77cd2fc57b3cb27dc76 Jun 15 07:50:00.271674 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.271084 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" event={"ID":"eb5c44e8-6c87-40d9-9f45-5782d3393c6a","Type":"ContainerStarted","Data":"4ab67224a595d7ed5fe8f017adf895146521aab195643848b3d921040a71b725"} Jun 15 07:50:00.271674 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.271163 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" event={"ID":"eb5c44e8-6c87-40d9-9f45-5782d3393c6a","Type":"ContainerStarted","Data":"19e1aaa4c406b26d4f69b9f9e7486fe7fae1a6e7704b09aecaf791f1ae0a9489"} Jun 15 07:50:00.279684 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.279586 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerStarted","Data":"e7a8496749948ab8c876b95fe11a534bf3261ae39ca21d55314c44cadc7a8b81"} Jun 15 07:50:00.294946 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.294885 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-vtxtw" podStartSLOduration=9.896412394 podStartE2EDuration="11.29486346s" totalImagesPullingTime="1.398451066s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:00.294093533 +0000 UTC m=+71.815581859" watchObservedRunningTime="2026-06-15 07:50:00.29486346 +0000 UTC m=+71.816351786" Jun 15 07:50:00.300403 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.298713 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-694c955b9-mqc9x" event={"ID":"390c8ea5-8cb6-44fc-81a1-4134a1c5ada3","Type":"ContainerStarted","Data":"402886e914f35e377cff66324696dafd4ee5b12f3d1e1341d9b66ce420e457c6"} Jun 15 07:50:00.300403 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.300354 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-694c955b9-mqc9x" Jun 15 07:50:00.306406 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.306352 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s97zs" event={"ID":"381d224d-21be-41fc-96f7-8477a8e25573","Type":"ContainerStarted","Data":"4dbdbd679941a5bbf2a1c23fe132eb1ca51784605ac5beba26a952b6eb87065d"} Jun 15 07:50:00.309035 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.308964 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" event={"ID":"a2f834ba-efa3-43fb-bb8f-e7dd6d742629","Type":"ContainerStarted","Data":"14f442154df3d324ded9f87bd8de341116e45d2c4177c77cd2fc57b3cb27dc76"} Jun 15 07:50:00.311006 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.310969 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-694c955b9-mqc9x" Jun 15 07:50:00.312828 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.312738 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" event={"ID":"38e24901-27b9-4965-a4ba-519463deaa1c","Type":"ContainerStarted","Data":"53c4630118f49363201350768d63213ec78803849a12e252980f97dc7d2290da"} Jun 15 07:50:00.319680 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.319653 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" event={"ID":"6e8f199a-46fa-450c-ab64-2ad95b7979f3","Type":"ContainerStarted","Data":"2a36868f4e2a55962031cc693c98e97695712a1ffefd687eb783c899a084a88c"} Jun 15 07:50:00.325144 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.325113 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96g9h" event={"ID":"fab62719-b262-4f52-a896-b8662210495c","Type":"ContainerStarted","Data":"76991ca733e7cb2551e2069f16c7456399ecd6258e515b9b81c4c264e66e4e3b"} Jun 15 07:50:00.325243 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.325164 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-96g9h" event={"ID":"fab62719-b262-4f52-a896-b8662210495c","Type":"ContainerStarted","Data":"adc9593ae40424318e083d74a3dcd816b13dc11133a705264596184f501d377d"} Jun 15 07:50:00.332128 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.332100 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" event={"ID":"c94c3744-a2d4-4e4d-a653-e5cd0782941e","Type":"ContainerStarted","Data":"72ba964d4202dae08b8b332cc92fa2bb1e3ca0df23dc84e7452b11e66d07d5e3"} Jun 15 07:50:00.338955 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.338877 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-694c955b9-mqc9x" podStartSLOduration=2.531026894 podStartE2EDuration="19.338859188s" totalImagesPullingTime="16.807832294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:00.318037127 +0000 UTC m=+71.839525454" watchObservedRunningTime="2026-06-15 07:50:00.338859188 +0000 UTC m=+71.860347515" Jun 15 07:50:00.340031 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.340008 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkn8j" event={"ID":"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e","Type":"ContainerStarted","Data":"df6bd7d97adf68f2cfef5fca8984fec99907e3568bbb6baeb8003ff96363d8e3"} Jun 15 07:50:00.344836 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:00.344778 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gl5lq" event={"ID":"02ffc07a-6d44-47df-90ea-c657938899b3","Type":"ContainerStarted","Data":"131ba29d82761d534dc80d2ceb6503c5a496badd823cfdf17f6e37dd5e7312d4"} Jun 15 07:50:10.397596 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.397561 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" event={"ID":"c94c3744-a2d4-4e4d-a653-e5cd0782941e","Type":"ContainerStarted","Data":"3a61ad5f1a851bca7adef08311b0c21b9672a142d0c61669d1768498d83128b5"} Jun 15 07:50:10.399206 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.399155 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-wkn8j" event={"ID":"61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e","Type":"ContainerStarted","Data":"a61032b83df36482945c09cc4c047ebb7513893f20ae7e027f3e0915451d14bf"} Jun 15 07:50:10.400961 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.400933 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gl5lq" event={"ID":"02ffc07a-6d44-47df-90ea-c657938899b3","Type":"ContainerStarted","Data":"24098d067a0175eb1623a0a103ad05b861f23628ee18d941a5ade83ed73c155b"} Jun 15 07:50:10.401061 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.400989 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gl5lq" event={"ID":"02ffc07a-6d44-47df-90ea-c657938899b3","Type":"ContainerStarted","Data":"f0be6a4a2dca412de092101ca92079555554293f843089d331c8fca374e5f95b"} Jun 15 07:50:10.402516 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.402493 2569 generic.go:356] "Generic (PLEG): container finished" podID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" exitCode=0 Jun 15 07:50:10.402595 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.402571 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535"} Jun 15 07:50:10.404323 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.404209 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-s97zs" event={"ID":"381d224d-21be-41fc-96f7-8477a8e25573","Type":"ContainerStarted","Data":"f1b6d23fa540d51270c32166922a41f3abf045811818c02958f85dba85654387"} Jun 15 07:50:10.404323 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.404265 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:50:10.406477 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.406430 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" event={"ID":"a2f834ba-efa3-43fb-bb8f-e7dd6d742629","Type":"ContainerStarted","Data":"9b95f25bf91ccefbb9554f2993ad2ac05cc621650359f382e9130de19e5eeab7"} Jun 15 07:50:10.406575 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.406521 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" event={"ID":"a2f834ba-efa3-43fb-bb8f-e7dd6d742629","Type":"ContainerStarted","Data":"34db2956b32c5d804c252581096ebe94e16ec3b2df9fe2fc71c29e80a76c2f8a"} Jun 15 07:50:10.406575 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.406554 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" event={"ID":"a2f834ba-efa3-43fb-bb8f-e7dd6d742629","Type":"ContainerStarted","Data":"a461b8a7c5c5b47501964ef4b563725f1a3065e31f497935fdaaa10cfd8a6bfe"} Jun 15 07:50:10.408555 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.408533 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" event={"ID":"38e24901-27b9-4965-a4ba-519463deaa1c","Type":"ContainerStarted","Data":"dc17560fd667060d59a67b23bc130bf066fde18a5e0a751b3efcf3edcf347896"} Jun 15 07:50:10.408651 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.408599 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" event={"ID":"38e24901-27b9-4965-a4ba-519463deaa1c","Type":"ContainerStarted","Data":"b8fdf4493bef3e511349c1dce5cab383bb2be81ab39860b7f25970cea98c27b7"} Jun 15 07:50:10.408651 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.408643 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" event={"ID":"38e24901-27b9-4965-a4ba-519463deaa1c","Type":"ContainerStarted","Data":"8e36a5f3cb160f881c5af696adca0f941ecea1d7e86ff94612879a541e0923ed"} Jun 15 07:50:10.410008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.409989 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" event={"ID":"6e8f199a-46fa-450c-ab64-2ad95b7979f3","Type":"ContainerStarted","Data":"f1ef6f25ac2f706756e170ebc3dd116d369258bccf36b0dcf8b02aea01fe9254"} Jun 15 07:50:10.410191 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.410177 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:50:10.415279 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.415255 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" Jun 15 07:50:10.416079 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.416043 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" podStartSLOduration=6.300115541 podStartE2EDuration="16.416030696s" totalImagesPullingTime="10.115915155s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:10.415341282 +0000 UTC m=+81.936829609" watchObservedRunningTime="2026-06-15 07:50:10.416030696 +0000 UTC m=+81.937519003" Jun 15 07:50:10.416572 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.416546 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-96g9h" podStartSLOduration=19.790174162 podStartE2EDuration="21.416536201s" totalImagesPullingTime="1.544306083s" totalInitContainerRuntime="82.055956ms" isStatefulPod=true podCreationTimestamp="2026-06-15 07:49:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:00.36083126 +0000 UTC m=+71.882319587" watchObservedRunningTime="2026-06-15 07:50:10.416536201 +0000 UTC m=+81.938024537" Jun 15 07:50:10.459337 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.459296 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gl5lq" podStartSLOduration=71.119559093 podStartE2EDuration="1m21.45928309s" totalImagesPullingTime="10.339723997s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:10.458142924 +0000 UTC m=+81.979631276" watchObservedRunningTime="2026-06-15 07:50:10.45928309 +0000 UTC m=+81.980771416" Jun 15 07:50:10.475191 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.475151 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-wkn8j" podStartSLOduration=71.338143766 podStartE2EDuration="1m21.475138548s" totalImagesPullingTime="10.136994782s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:10.474179992 +0000 UTC m=+81.995668317" watchObservedRunningTime="2026-06-15 07:50:10.475138548 +0000 UTC m=+81.996626868" Jun 15 07:50:10.490593 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.490553 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-ddxnk" podStartSLOduration=6.366677589 podStartE2EDuration="16.490544331s" totalImagesPullingTime="10.123866742s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:10.489870416 +0000 UTC m=+82.011358766" watchObservedRunningTime="2026-06-15 07:50:10.490544331 +0000 UTC m=+82.012032658" Jun 15 07:50:10.511624 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.511580 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-s97zs" podStartSLOduration=71.155086745 podStartE2EDuration="1m21.511568502s" totalImagesPullingTime="10.356481757s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:48:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:10.510769524 +0000 UTC m=+82.032257849" watchObservedRunningTime="2026-06-15 07:50:10.511568502 +0000 UTC m=+82.033056827" Jun 15 07:50:10.537145 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:10.537073 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-55d8b596b5-zfdt7" podStartSLOduration=6.458335857 podStartE2EDuration="16.537062604s" totalImagesPullingTime="10.078726747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:10.535376303 +0000 UTC m=+82.056864630" watchObservedRunningTime="2026-06-15 07:50:10.537062604 +0000 UTC m=+82.058550945" Jun 15 07:50:12.423424 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:12.423381 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" event={"ID":"38e24901-27b9-4965-a4ba-519463deaa1c","Type":"ContainerStarted","Data":"0e958654c41313f14f44258463b6e2260189ac16aeafaec4bedf27fe6ecd7212"} Jun 15 07:50:12.423910 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:12.423530 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" event={"ID":"38e24901-27b9-4965-a4ba-519463deaa1c","Type":"ContainerStarted","Data":"fa503764cad29fa0e2e597d1b5763973b8cbca4ff10a63c4b8d782d2250c503b"} Jun 15 07:50:12.423910 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:12.423573 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" event={"ID":"38e24901-27b9-4965-a4ba-519463deaa1c","Type":"ContainerStarted","Data":"eca7ff7b7986683b8368ed9b6e40474d20cd30e79f53f5a84fdf1ebe40e0d3bc"} Jun 15 07:50:12.451300 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:12.451247 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" podStartSLOduration=9.859739889 podStartE2EDuration="21.451232604s" totalImagesPullingTime="11.591492715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:51 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:12.448727162 +0000 UTC m=+83.970215488" watchObservedRunningTime="2026-06-15 07:50:12.451232604 +0000 UTC m=+83.972720930" Jun 15 07:50:13.427529 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:13.427494 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:50:14.359129 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:14.359102 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:50:14.359250 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:14.359190 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:50:14.436407 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:14.436377 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerStarted","Data":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} Jun 15 07:50:14.436924 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:14.436440 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerStarted","Data":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} Jun 15 07:50:15.443514 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:15.443476 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerStarted","Data":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} Jun 15 07:50:15.443983 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:15.443545 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerStarted","Data":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} Jun 15 07:50:15.443983 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:15.443573 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerStarted","Data":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} Jun 15 07:50:15.443983 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:15.443596 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerStarted","Data":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} Jun 15 07:50:15.474932 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:15.474883 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.50151087 podStartE2EDuration="20.474861781s" totalImagesPullingTime="13.95369116s" totalInitContainerRuntime="19.659751ms" isStatefulPod=false podCreationTimestamp="2026-06-15 07:49:55 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:50:15.472434448 +0000 UTC m=+86.993922784" watchObservedRunningTime="2026-06-15 07:50:15.474861781 +0000 UTC m=+86.996350110" Jun 15 07:50:16.285401 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:16.285365 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:50:19.443366 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:19.443337 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-77969c67b6-9v4g5" Jun 15 07:50:34.363913 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:34.363884 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:50:34.367737 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:34.367714 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-5b4b977964-qkt95" Jun 15 07:50:41.419541 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:41.419498 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-s97zs" Jun 15 07:50:56.285008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:56.284974 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:50:56.350704 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:56.350680 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:50:56.613081 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:50:56.613000 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:14.301140 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.301107 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:51:14.301695 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.301405 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="prometheus" containerID="cri-o://a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" gracePeriod=600 Jun 15 07:51:14.301695 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.301425 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="thanos-sidecar" containerID="cri-o://d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" gracePeriod=600 Jun 15 07:51:14.301695 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.301469 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-thanos" containerID="cri-o://eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" gracePeriod=600 Jun 15 07:51:14.301695 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.301494 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="config-reloader" containerID="cri-o://b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" gracePeriod=600 Jun 15 07:51:14.301695 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.301514 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-web" containerID="cri-o://74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" gracePeriod=600 Jun 15 07:51:14.301695 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.301422 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy" containerID="cri-o://f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" gracePeriod=600 Jun 15 07:51:14.549194 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.549165 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:14.665452 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665420 2569 generic.go:356] "Generic (PLEG): container finished" podID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" exitCode=0 Jun 15 07:51:14.665452 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665444 2569 generic.go:356] "Generic (PLEG): container finished" podID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" exitCode=0 Jun 15 07:51:14.665452 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665451 2569 generic.go:356] "Generic (PLEG): container finished" podID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" exitCode=0 Jun 15 07:51:14.665452 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665471 2569 generic.go:356] "Generic (PLEG): container finished" podID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" exitCode=0 Jun 15 07:51:14.665452 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665476 2569 generic.go:356] "Generic (PLEG): container finished" podID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" exitCode=0 Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665470 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665519 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665548 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665481 2569 generic.go:356] "Generic (PLEG): container finished" podID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" exitCode=0 Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665584 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665610 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665642 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665641 2569 scope.go:117] "RemoveContainer" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665667 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} Jun 15 07:51:14.665849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.665692 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52","Type":"ContainerDied","Data":"e7a8496749948ab8c876b95fe11a534bf3261ae39ca21d55314c44cadc7a8b81"} Jun 15 07:51:14.673264 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.673247 2569 scope.go:117] "RemoveContainer" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.676334 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676318 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-1\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676429 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676340 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-0\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676429 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676357 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-trusted-ca-bundle\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676429 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676375 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676429 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676399 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-kube-rbac-proxy\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676657 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676447 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config-out\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676657 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676496 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676657 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676529 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-db\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676657 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676556 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-tls-assets\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676657 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676583 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-thanos-prometheus-http-client-file\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676657 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676611 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-2\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676657 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676637 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-kubelet-serving-ca-bundle\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676661 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-metrics-client-ca\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676701 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676736 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-web-config\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676772 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-serving-certs-ca-bundle\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676805 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-tls\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676836 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-metrics-client-certs\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676860 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48s46\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-kube-api-access-48s46\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676892 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 07:51:14.676995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.676901 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-grpc-tls\") pod \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\" (UID: \"ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52\") " Jun 15 07:51:14.677412 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.677056 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 07:51:14.677412 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.677268 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 07:51:14.677412 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.677301 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.677412 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.677322 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-trusted-ca-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.678285 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.678056 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 07:51:14.678982 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.678537 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 07:51:14.679112 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.679084 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 07:51:14.679541 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.679514 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 07:51:14.680059 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.680029 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 07:51:14.681215 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.681177 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config-out" (OuterVolumeSpecName: "config-out") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 15 07:51:14.681607 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.681561 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.681731 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.681707 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config" (OuterVolumeSpecName: "config") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.682346 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682325 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.682492 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682448 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.682569 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682498 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:51:14.682641 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682561 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.682641 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682628 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.682749 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682669 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-kube-api-access-48s46" (OuterVolumeSpecName: "kube-api-access-48s46") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "kube-api-access-48s46". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:51:14.682749 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682673 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.682835 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.682761 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.683587 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.683565 2569 scope.go:117] "RemoveContainer" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.690019 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.689998 2569 scope.go:117] "RemoveContainer" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.692618 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.692595 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-web-config" (OuterVolumeSpecName: "web-config") pod "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" (UID: "ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:51:14.696250 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.696236 2569 scope.go:117] "RemoveContainer" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.702491 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.702474 2569 scope.go:117] "RemoveContainer" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.708920 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.708905 2569 scope.go:117] "RemoveContainer" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.715085 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.715069 2569 scope.go:117] "RemoveContainer" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.715324 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:51:14.715305 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": container with ID starting with eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec not found: ID does not exist" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.715369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.715333 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} err="failed to get container status \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": rpc error: code = NotFound desc = could not find container \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": container with ID starting with eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec not found: ID does not exist" Jun 15 07:51:14.715369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.715365 2569 scope.go:117] "RemoveContainer" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.715598 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:51:14.715582 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": container with ID starting with f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b not found: ID does not exist" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.715644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.715602 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} err="failed to get container status \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": rpc error: code = NotFound desc = could not find container \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": container with ID starting with f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b not found: ID does not exist" Jun 15 07:51:14.715644 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.715615 2569 scope.go:117] "RemoveContainer" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.715830 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:51:14.715815 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": container with ID starting with 74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a not found: ID does not exist" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.715884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.715832 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} err="failed to get container status \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": rpc error: code = NotFound desc = could not find container \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": container with ID starting with 74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a not found: ID does not exist" Jun 15 07:51:14.715884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.715846 2569 scope.go:117] "RemoveContainer" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.716045 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:51:14.716032 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": container with ID starting with d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28 not found: ID does not exist" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.716085 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716047 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} err="failed to get container status \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": rpc error: code = NotFound desc = could not find container \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": container with ID starting with d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28 not found: ID does not exist" Jun 15 07:51:14.716085 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716058 2569 scope.go:117] "RemoveContainer" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.716270 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:51:14.716254 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": container with ID starting with b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca not found: ID does not exist" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.716316 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716272 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} err="failed to get container status \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": rpc error: code = NotFound desc = could not find container \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": container with ID starting with b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca not found: ID does not exist" Jun 15 07:51:14.716316 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716283 2569 scope.go:117] "RemoveContainer" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.716523 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:51:14.716499 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": container with ID starting with a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f not found: ID does not exist" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.716625 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716527 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} err="failed to get container status \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": rpc error: code = NotFound desc = could not find container \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": container with ID starting with a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f not found: ID does not exist" Jun 15 07:51:14.716625 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716546 2569 scope.go:117] "RemoveContainer" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.716781 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:51:14.716766 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": container with ID starting with 5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535 not found: ID does not exist" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.716818 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716785 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535"} err="failed to get container status \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": rpc error: code = NotFound desc = could not find container \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": container with ID starting with 5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535 not found: ID does not exist" Jun 15 07:51:14.716818 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716796 2569 scope.go:117] "RemoveContainer" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.716984 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716968 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} err="failed to get container status \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": rpc error: code = NotFound desc = could not find container \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": container with ID starting with eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec not found: ID does not exist" Jun 15 07:51:14.717033 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.716984 2569 scope.go:117] "RemoveContainer" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.717159 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717139 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} err="failed to get container status \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": rpc error: code = NotFound desc = could not find container \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": container with ID starting with f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b not found: ID does not exist" Jun 15 07:51:14.717209 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717160 2569 scope.go:117] "RemoveContainer" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.717390 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717369 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} err="failed to get container status \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": rpc error: code = NotFound desc = could not find container \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": container with ID starting with 74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a not found: ID does not exist" Jun 15 07:51:14.717526 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717392 2569 scope.go:117] "RemoveContainer" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.717648 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717632 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} err="failed to get container status \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": rpc error: code = NotFound desc = could not find container \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": container with ID starting with d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28 not found: ID does not exist" Jun 15 07:51:14.717684 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717648 2569 scope.go:117] "RemoveContainer" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.717861 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717842 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} err="failed to get container status \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": rpc error: code = NotFound desc = could not find container \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": container with ID starting with b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca not found: ID does not exist" Jun 15 07:51:14.717899 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.717866 2569 scope.go:117] "RemoveContainer" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.718101 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718084 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} err="failed to get container status \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": rpc error: code = NotFound desc = could not find container \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": container with ID starting with a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f not found: ID does not exist" Jun 15 07:51:14.718101 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718101 2569 scope.go:117] "RemoveContainer" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.718284 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718264 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535"} err="failed to get container status \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": rpc error: code = NotFound desc = could not find container \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": container with ID starting with 5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535 not found: ID does not exist" Jun 15 07:51:14.718333 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718285 2569 scope.go:117] "RemoveContainer" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.718488 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718470 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} err="failed to get container status \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": rpc error: code = NotFound desc = could not find container \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": container with ID starting with eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec not found: ID does not exist" Jun 15 07:51:14.718540 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718489 2569 scope.go:117] "RemoveContainer" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.718740 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718716 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} err="failed to get container status \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": rpc error: code = NotFound desc = could not find container \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": container with ID starting with f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b not found: ID does not exist" Jun 15 07:51:14.718740 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718740 2569 scope.go:117] "RemoveContainer" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.718959 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718941 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} err="failed to get container status \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": rpc error: code = NotFound desc = could not find container \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": container with ID starting with 74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a not found: ID does not exist" Jun 15 07:51:14.719030 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.718961 2569 scope.go:117] "RemoveContainer" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.719169 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719152 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} err="failed to get container status \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": rpc error: code = NotFound desc = could not find container \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": container with ID starting with d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28 not found: ID does not exist" Jun 15 07:51:14.719216 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719170 2569 scope.go:117] "RemoveContainer" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.719372 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719355 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} err="failed to get container status \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": rpc error: code = NotFound desc = could not find container \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": container with ID starting with b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca not found: ID does not exist" Jun 15 07:51:14.719439 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719373 2569 scope.go:117] "RemoveContainer" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.719584 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719567 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} err="failed to get container status \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": rpc error: code = NotFound desc = could not find container \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": container with ID starting with a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f not found: ID does not exist" Jun 15 07:51:14.719634 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719584 2569 scope.go:117] "RemoveContainer" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.719788 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719770 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535"} err="failed to get container status \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": rpc error: code = NotFound desc = could not find container \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": container with ID starting with 5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535 not found: ID does not exist" Jun 15 07:51:14.719864 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719789 2569 scope.go:117] "RemoveContainer" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.720009 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.719994 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} err="failed to get container status \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": rpc error: code = NotFound desc = could not find container \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": container with ID starting with eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec not found: ID does not exist" Jun 15 07:51:14.720055 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720010 2569 scope.go:117] "RemoveContainer" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.720206 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720189 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} err="failed to get container status \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": rpc error: code = NotFound desc = could not find container \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": container with ID starting with f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b not found: ID does not exist" Jun 15 07:51:14.720272 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720207 2569 scope.go:117] "RemoveContainer" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.720445 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720428 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} err="failed to get container status \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": rpc error: code = NotFound desc = could not find container \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": container with ID starting with 74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a not found: ID does not exist" Jun 15 07:51:14.720516 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720445 2569 scope.go:117] "RemoveContainer" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.720689 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720670 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} err="failed to get container status \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": rpc error: code = NotFound desc = could not find container \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": container with ID starting with d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28 not found: ID does not exist" Jun 15 07:51:14.720756 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720690 2569 scope.go:117] "RemoveContainer" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.720910 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720895 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} err="failed to get container status \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": rpc error: code = NotFound desc = could not find container \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": container with ID starting with b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca not found: ID does not exist" Jun 15 07:51:14.720956 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.720910 2569 scope.go:117] "RemoveContainer" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.721100 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721082 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} err="failed to get container status \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": rpc error: code = NotFound desc = could not find container \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": container with ID starting with a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f not found: ID does not exist" Jun 15 07:51:14.721143 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721101 2569 scope.go:117] "RemoveContainer" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.721321 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721305 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535"} err="failed to get container status \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": rpc error: code = NotFound desc = could not find container \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": container with ID starting with 5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535 not found: ID does not exist" Jun 15 07:51:14.721382 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721322 2569 scope.go:117] "RemoveContainer" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.721544 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721527 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} err="failed to get container status \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": rpc error: code = NotFound desc = could not find container \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": container with ID starting with eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec not found: ID does not exist" Jun 15 07:51:14.721597 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721544 2569 scope.go:117] "RemoveContainer" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.721739 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721722 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} err="failed to get container status \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": rpc error: code = NotFound desc = could not find container \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": container with ID starting with f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b not found: ID does not exist" Jun 15 07:51:14.721805 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721740 2569 scope.go:117] "RemoveContainer" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.721943 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721927 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} err="failed to get container status \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": rpc error: code = NotFound desc = could not find container \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": container with ID starting with 74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a not found: ID does not exist" Jun 15 07:51:14.721987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.721943 2569 scope.go:117] "RemoveContainer" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.722150 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722133 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} err="failed to get container status \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": rpc error: code = NotFound desc = could not find container \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": container with ID starting with d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28 not found: ID does not exist" Jun 15 07:51:14.722214 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722152 2569 scope.go:117] "RemoveContainer" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.722369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722354 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} err="failed to get container status \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": rpc error: code = NotFound desc = could not find container \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": container with ID starting with b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca not found: ID does not exist" Jun 15 07:51:14.722409 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722370 2569 scope.go:117] "RemoveContainer" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.722577 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722559 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} err="failed to get container status \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": rpc error: code = NotFound desc = could not find container \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": container with ID starting with a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f not found: ID does not exist" Jun 15 07:51:14.722626 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722577 2569 scope.go:117] "RemoveContainer" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.722759 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722742 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535"} err="failed to get container status \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": rpc error: code = NotFound desc = could not find container \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": container with ID starting with 5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535 not found: ID does not exist" Jun 15 07:51:14.722807 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722759 2569 scope.go:117] "RemoveContainer" containerID="eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec" Jun 15 07:51:14.722935 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722919 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec"} err="failed to get container status \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": rpc error: code = NotFound desc = could not find container \"eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec\": container with ID starting with eeaa9dddace837e7c33d78ef56f7c3c0d9e7e087847b03512d1ab70281d37fec not found: ID does not exist" Jun 15 07:51:14.722978 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.722936 2569 scope.go:117] "RemoveContainer" containerID="f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b" Jun 15 07:51:14.723139 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723122 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b"} err="failed to get container status \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": rpc error: code = NotFound desc = could not find container \"f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b\": container with ID starting with f63bf1f65fbb1ed45f2e3246f1177d1631e2580881cda6974492bb817e4f1f5b not found: ID does not exist" Jun 15 07:51:14.723180 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723140 2569 scope.go:117] "RemoveContainer" containerID="74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a" Jun 15 07:51:14.723336 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723321 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a"} err="failed to get container status \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": rpc error: code = NotFound desc = could not find container \"74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a\": container with ID starting with 74df07018f9897a92df0bb9b96caa94862741ef8527cbf015a9d21ef3d88691a not found: ID does not exist" Jun 15 07:51:14.723378 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723337 2569 scope.go:117] "RemoveContainer" containerID="d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28" Jun 15 07:51:14.723540 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723524 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28"} err="failed to get container status \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": rpc error: code = NotFound desc = could not find container \"d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28\": container with ID starting with d9583ed17c36a939ac6c74b7aa752362b4bef3084405183784cbe23b17ef7f28 not found: ID does not exist" Jun 15 07:51:14.723580 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723541 2569 scope.go:117] "RemoveContainer" containerID="b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca" Jun 15 07:51:14.723720 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723702 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca"} err="failed to get container status \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": rpc error: code = NotFound desc = could not find container \"b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca\": container with ID starting with b66aaee803de30426a2663c5e548ea8686887e163cde92b54eb43baa02765bca not found: ID does not exist" Jun 15 07:51:14.723762 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723720 2569 scope.go:117] "RemoveContainer" containerID="a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f" Jun 15 07:51:14.723904 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723890 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f"} err="failed to get container status \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": rpc error: code = NotFound desc = could not find container \"a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f\": container with ID starting with a5c16e5403946cc6fc00e53d023727ec15891163becb9fac84eb2630e5ad092f not found: ID does not exist" Jun 15 07:51:14.723904 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.723904 2569 scope.go:117] "RemoveContainer" containerID="5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535" Jun 15 07:51:14.724068 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.724055 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535"} err="failed to get container status \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": rpc error: code = NotFound desc = could not find container \"5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535\": container with ID starting with 5f0bcdcf1d717cde87a02aafa458eb323f46c7a2cf8ca43d5fc4eb3bc7f2d535 not found: ID does not exist" Jun 15 07:51:14.778469 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778439 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778492 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778509 2569 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-kube-rbac-proxy\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778524 2569 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config-out\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778535 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778564 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-db\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778577 2569 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-tls-assets\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778589 2569 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-thanos-prometheus-http-client-file\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778603 2569 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778616 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778632 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-metrics-client-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778646 2569 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778658 2569 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-web-config\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778671 2569 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778684 2569 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-prometheus-k8s-tls\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778698 2569 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-metrics-client-certs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778712 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48s46\" (UniqueName: \"kubernetes.io/projected/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-kube-api-access-48s46\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.778860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.778727 2569 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52-secret-grpc-tls\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:51:14.990320 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.990293 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:51:14.993734 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:14.993712 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:51:15.019023 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019001 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:51:15.019262 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019250 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="thanos-sidecar" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019264 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="thanos-sidecar" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019274 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-thanos" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019279 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-thanos" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019287 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="prometheus" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019292 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="prometheus" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019298 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-web" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019303 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-web" Jun 15 07:51:15.019311 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019314 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="init-config-reloader" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019319 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="init-config-reloader" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019330 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="config-reloader" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019336 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="config-reloader" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019341 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019346 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019387 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-thanos" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019396 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="config-reloader" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019401 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy-web" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019407 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="kube-rbac-proxy" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019412 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="prometheus" Jun 15 07:51:15.019561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.019416 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" containerName="thanos-sidecar" Jun 15 07:51:15.024255 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.024238 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.027059 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027035 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 15 07:51:15.027166 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027075 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 15 07:51:15.027227 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027215 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c8gic3vvm6drl\"" Jun 15 07:51:15.027731 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027538 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 15 07:51:15.027731 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027550 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 15 07:51:15.027731 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027579 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 15 07:51:15.027731 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027691 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 15 07:51:15.028008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027801 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 15 07:51:15.028008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027883 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-thwfm\"" Jun 15 07:51:15.028008 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.027959 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 15 07:51:15.028156 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.028094 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 15 07:51:15.028156 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.028120 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 15 07:51:15.028542 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.028524 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 15 07:51:15.028625 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.028534 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 15 07:51:15.031555 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.031532 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 15 07:51:15.033441 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.033424 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 15 07:51:15.037190 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.037171 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:51:15.182379 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182299 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7lmqx\" (UniqueName: \"kubernetes.io/projected/c0ef1b06-3103-48ed-8720-9e6bb1652453-kube-api-access-7lmqx\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182379 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182330 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182379 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182350 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0ef1b06-3103-48ed-8720-9e6bb1652453-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182379 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182376 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-config\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182487 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182520 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182566 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182585 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182602 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182681 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182654 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182682 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182711 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0ef1b06-3103-48ed-8720-9e6bb1652453-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182732 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182757 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182776 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182791 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182810 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182824 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.182884 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182878 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.183142 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.182934 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284227 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284189 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284227 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284229 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284247 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284275 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284298 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284326 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284355 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284725 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284647 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7lmqx\" (UniqueName: \"kubernetes.io/projected/c0ef1b06-3103-48ed-8720-9e6bb1652453-kube-api-access-7lmqx\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284725 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284695 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284838 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0ef1b06-3103-48ed-8720-9e6bb1652453-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284838 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284768 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-config\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.284939 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.284900 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285047 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285015 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285104 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285050 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285104 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285054 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285204 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285149 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285251 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285203 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285251 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285228 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285354 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285275 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285354 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285301 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285479 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285354 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0ef1b06-3103-48ed-8720-9e6bb1652453-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285479 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285386 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.285700 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.285675 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.287359 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.286300 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.287359 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.286809 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.287359 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.287306 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.287757 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.287514 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.287757 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.287541 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.287757 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.287618 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.287895 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.287778 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-config\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.288730 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.288257 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.288730 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.288688 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.288887 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.288769 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c0ef1b06-3103-48ed-8720-9e6bb1652453-config-out\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.289102 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.289076 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c0ef1b06-3103-48ed-8720-9e6bb1652453-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.289844 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.289818 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.290004 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.289985 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.290071 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.290015 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.290327 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.290310 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c0ef1b06-3103-48ed-8720-9e6bb1652453-web-config\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.290876 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.290858 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c0ef1b06-3103-48ed-8720-9e6bb1652453-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.296137 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.296121 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7lmqx\" (UniqueName: \"kubernetes.io/projected/c0ef1b06-3103-48ed-8720-9e6bb1652453-kube-api-access-7lmqx\") pod \"prometheus-k8s-0\" (UID: \"c0ef1b06-3103-48ed-8720-9e6bb1652453\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.334021 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.333994 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:51:15.469908 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.469858 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 15 07:51:15.472509 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:51:15.472481 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0ef1b06_3103_48ed_8720_9e6bb1652453.slice/crio-998ee28dea236cd9da9a1d95b4d8c11ef6b068016fd8a8d60f40eb390e1d6152 WatchSource:0}: Error finding container 998ee28dea236cd9da9a1d95b4d8c11ef6b068016fd8a8d60f40eb390e1d6152: Status 404 returned error can't find the container with id 998ee28dea236cd9da9a1d95b4d8c11ef6b068016fd8a8d60f40eb390e1d6152 Jun 15 07:51:15.671428 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.671394 2569 generic.go:356] "Generic (PLEG): container finished" podID="c0ef1b06-3103-48ed-8720-9e6bb1652453" containerID="0a987fe5b2b372644874ff2224c61986cca3d5ea7076e2ff6009a48a1a084778" exitCode=0 Jun 15 07:51:15.671616 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.671470 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerDied","Data":"0a987fe5b2b372644874ff2224c61986cca3d5ea7076e2ff6009a48a1a084778"} Jun 15 07:51:15.671616 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:15.671523 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerStarted","Data":"998ee28dea236cd9da9a1d95b4d8c11ef6b068016fd8a8d60f40eb390e1d6152"} Jun 15 07:51:16.678283 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.678245 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerStarted","Data":"cf9e9afeafd254d5f04b5b46f42233f4b0ba8994ec5111c654b27b552bf62116"} Jun 15 07:51:16.678698 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.678355 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerStarted","Data":"671134dc71d9535687b85cfa766a1a90017c60ead50572cb823e7eed6dba3614"} Jun 15 07:51:16.678698 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.678398 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerStarted","Data":"72efb5be2d5d1bb40b3be3d0238dd9d1ae8b659a4fb687e33734e09a1144068a"} Jun 15 07:51:16.678698 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.678439 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerStarted","Data":"f4e737824bf093a74950bfdd11793d894b821b2189a1d32e72bb9774a73ce7f3"} Jun 15 07:51:16.678698 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.678499 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerStarted","Data":"9ca6c6362545f50eeecb5ddefa6dcbdee7acf17bf92fe0f5da81ca102a554179"} Jun 15 07:51:16.678698 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.678534 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c0ef1b06-3103-48ed-8720-9e6bb1652453","Type":"ContainerStarted","Data":"3a2a20d835ab072b9c13979344f16444e7860b3995c7a0963ed64ac02588be8b"} Jun 15 07:51:16.709477 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.709010 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.690706858 podStartE2EDuration="2.708990388s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.28353ms" isStatefulPod=false podCreationTimestamp="2026-06-15 07:51:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:51:16.707365301 +0000 UTC m=+148.228853626" watchObservedRunningTime="2026-06-15 07:51:16.708990388 +0000 UTC m=+148.230478717" Jun 15 07:51:16.923146 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:16.923112 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52" path="/var/lib/kubelet/pods/ac85a5aa-89cd-43c7-9c6b-ecb27a1ceb52/volumes" Jun 15 07:51:20.334687 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:51:20.334639 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:52:15.334882 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:15.334844 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:52:15.350118 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:15.350093 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:52:15.904535 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:15.904511 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 15 07:52:42.304583 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.304548 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt"] Jun 15 07:52:42.306650 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.306635 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.309315 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.309295 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 15 07:52:42.310745 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.310729 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 15 07:52:42.310849 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.310748 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-v7vj6\"" Jun 15 07:52:42.317784 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.317764 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt"] Jun 15 07:52:42.398466 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.398434 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6v7x\" (UniqueName: \"kubernetes.io/projected/6bb55560-815f-4405-9fd5-811172a94cd0-kube-api-access-d6v7x\") pod \"openshift-lws-operator-fd8ccff4c-jt5vt\" (UID: \"6bb55560-815f-4405-9fd5-811172a94cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.398610 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.398523 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bb55560-815f-4405-9fd5-811172a94cd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jt5vt\" (UID: \"6bb55560-815f-4405-9fd5-811172a94cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.499720 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.499688 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6v7x\" (UniqueName: \"kubernetes.io/projected/6bb55560-815f-4405-9fd5-811172a94cd0-kube-api-access-d6v7x\") pod \"openshift-lws-operator-fd8ccff4c-jt5vt\" (UID: \"6bb55560-815f-4405-9fd5-811172a94cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.499839 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.499761 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bb55560-815f-4405-9fd5-811172a94cd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jt5vt\" (UID: \"6bb55560-815f-4405-9fd5-811172a94cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.500119 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.500103 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6bb55560-815f-4405-9fd5-811172a94cd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-jt5vt\" (UID: \"6bb55560-815f-4405-9fd5-811172a94cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.520909 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.520883 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6v7x\" (UniqueName: \"kubernetes.io/projected/6bb55560-815f-4405-9fd5-811172a94cd0-kube-api-access-d6v7x\") pod \"openshift-lws-operator-fd8ccff4c-jt5vt\" (UID: \"6bb55560-815f-4405-9fd5-811172a94cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.628735 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.628634 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" Jun 15 07:52:42.756139 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.756113 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt"] Jun 15 07:52:42.758893 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:52:42.758869 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6bb55560_815f_4405_9fd5_811172a94cd0.slice/crio-57b8edcff86adc725b0e897898c67d87dd79b610aad4ab631abe496c29fc293e WatchSource:0}: Error finding container 57b8edcff86adc725b0e897898c67d87dd79b610aad4ab631abe496c29fc293e: Status 404 returned error can't find the container with id 57b8edcff86adc725b0e897898c67d87dd79b610aad4ab631abe496c29fc293e Jun 15 07:52:42.988297 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:42.988263 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" event={"ID":"6bb55560-815f-4405-9fd5-811172a94cd0","Type":"ContainerStarted","Data":"57b8edcff86adc725b0e897898c67d87dd79b610aad4ab631abe496c29fc293e"} Jun 15 07:52:46.003950 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:46.003918 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" event={"ID":"6bb55560-815f-4405-9fd5-811172a94cd0","Type":"ContainerStarted","Data":"77e9992300e458f4dce12332c79886670b4f5850a9ff14827b8bf74510c9fb5e"} Jun 15 07:52:46.028968 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:52:46.028922 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-jt5vt" podStartSLOduration=1.387185483 podStartE2EDuration="4.028904754s" totalImagesPullingTime="2.641719271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:52:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:52:46.02851826 +0000 UTC m=+237.550006589" watchObservedRunningTime="2026-06-15 07:52:46.028904754 +0000 UTC m=+237.550393081" Jun 15 07:53:02.483171 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.483094 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx"] Jun 15 07:53:02.489405 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.489376 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.492953 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.492919 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 15 07:53:02.493087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.493042 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-ttgxb\"" Jun 15 07:53:02.493087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.493058 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 15 07:53:02.493199 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.493147 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 15 07:53:02.493356 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.493340 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 15 07:53:02.499408 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.499385 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx"] Jun 15 07:53:02.573503 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.573472 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fpr4\" (UniqueName: \"kubernetes.io/projected/8153214a-9b2f-4fb2-add9-f7c1c0cede96-kube-api-access-6fpr4\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.573654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.573526 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8153214a-9b2f-4fb2-add9-f7c1c0cede96-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.573654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.573553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8153214a-9b2f-4fb2-add9-f7c1c0cede96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.573654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.573569 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8153214a-9b2f-4fb2-add9-f7c1c0cede96-tmp\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.573654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.573586 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8153214a-9b2f-4fb2-add9-f7c1c0cede96-manifests\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.674244 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.674214 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8153214a-9b2f-4fb2-add9-f7c1c0cede96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.674434 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.674253 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8153214a-9b2f-4fb2-add9-f7c1c0cede96-tmp\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.674434 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.674282 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8153214a-9b2f-4fb2-add9-f7c1c0cede96-manifests\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.674434 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.674364 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fpr4\" (UniqueName: \"kubernetes.io/projected/8153214a-9b2f-4fb2-add9-f7c1c0cede96-kube-api-access-6fpr4\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.674652 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.674444 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8153214a-9b2f-4fb2-add9-f7c1c0cede96-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.674743 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.674724 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8153214a-9b2f-4fb2-add9-f7c1c0cede96-manifests\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.676779 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.676754 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8153214a-9b2f-4fb2-add9-f7c1c0cede96-tmp\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.676878 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.676814 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8153214a-9b2f-4fb2-add9-f7c1c0cede96-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.676937 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.676918 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8153214a-9b2f-4fb2-add9-f7c1c0cede96-webhook-cert\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.688994 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.688971 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fpr4\" (UniqueName: \"kubernetes.io/projected/8153214a-9b2f-4fb2-add9-f7c1c0cede96-kube-api-access-6fpr4\") pod \"opendatahub-operator-controller-manager-7f5bd64c79-nn7fx\" (UID: \"8153214a-9b2f-4fb2-add9-f7c1c0cede96\") " pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.800949 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.800867 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:02.964591 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:02.964567 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx"] Jun 15 07:53:02.967366 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:53:02.967341 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8153214a_9b2f_4fb2_add9_f7c1c0cede96.slice/crio-dee04c9f528b46bc58a51481912b1f21b1da46f503ec8607458229d8d2c533e3 WatchSource:0}: Error finding container dee04c9f528b46bc58a51481912b1f21b1da46f503ec8607458229d8d2c533e3: Status 404 returned error can't find the container with id dee04c9f528b46bc58a51481912b1f21b1da46f503ec8607458229d8d2c533e3 Jun 15 07:53:03.062975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:03.062895 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" event={"ID":"8153214a-9b2f-4fb2-add9-f7c1c0cede96","Type":"ContainerStarted","Data":"dee04c9f528b46bc58a51481912b1f21b1da46f503ec8607458229d8d2c533e3"} Jun 15 07:53:06.078139 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:06.078093 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" event={"ID":"8153214a-9b2f-4fb2-add9-f7c1c0cede96","Type":"ContainerStarted","Data":"87492e1176914b4c774090c4ae3b41d0b88d96d4e8dc2da0c57388cbf1a0ce37"} Jun 15 07:53:07.083806 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:07.083762 2569 generic.go:356] "Generic (PLEG): container finished" podID="8153214a-9b2f-4fb2-add9-f7c1c0cede96" containerID="87492e1176914b4c774090c4ae3b41d0b88d96d4e8dc2da0c57388cbf1a0ce37" exitCode=0 Jun 15 07:53:07.083806 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:07.083810 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" event={"ID":"8153214a-9b2f-4fb2-add9-f7c1c0cede96","Type":"ContainerDied","Data":"87492e1176914b4c774090c4ae3b41d0b88d96d4e8dc2da0c57388cbf1a0ce37"} Jun 15 07:53:08.096251 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:08.096215 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" event={"ID":"8153214a-9b2f-4fb2-add9-f7c1c0cede96","Type":"ContainerStarted","Data":"5020d3ee26a6e31c5900aa3a6f2bb3758c8a1a6f902f79bec721188fc6f12a3e"} Jun 15 07:53:08.096697 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:08.096362 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:08.127343 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:08.127295 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" podStartSLOduration=1.9379391799999999 podStartE2EDuration="6.127282021s" totalImagesPullingTime="3.202392972s" totalInitContainerRuntime="986.949869ms" isStatefulPod=false podCreationTimestamp="2026-06-15 07:53:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:53:08.125054935 +0000 UTC m=+259.646543261" watchObservedRunningTime="2026-06-15 07:53:08.127282021 +0000 UTC m=+259.648770347" Jun 15 07:53:19.103066 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:19.103033 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7f5bd64c79-nn7fx" Jun 15 07:53:21.199830 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.199796 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m"] Jun 15 07:53:21.207655 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.207634 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.211869 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.211829 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 15 07:53:21.211869 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.211854 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mzxkm\"" Jun 15 07:53:21.212056 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.211901 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 15 07:53:21.212056 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.211855 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 15 07:53:21.230913 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.230889 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m"] Jun 15 07:53:21.324070 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.324036 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-cert\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.324219 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.324086 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-manager-config\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.324219 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.324150 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-metrics-cert\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.324306 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.324220 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75gv8\" (UniqueName: \"kubernetes.io/projected/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-kube-api-access-75gv8\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.425554 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.424952 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75gv8\" (UniqueName: \"kubernetes.io/projected/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-kube-api-access-75gv8\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.425554 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.425000 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-cert\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.425554 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.425042 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-manager-config\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.425554 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.425075 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-metrics-cert\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.426585 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.426561 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-manager-config\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.429006 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.428988 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-cert\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.429120 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.429069 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-metrics-cert\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.441994 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.441970 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-75gv8\" (UniqueName: \"kubernetes.io/projected/5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830-kube-api-access-75gv8\") pod \"lws-controller-manager-6b9cb757d6-pj75m\" (UID: \"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830\") " pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.517060 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.516988 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:21.678997 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.678968 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m"] Jun 15 07:53:21.682077 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:53:21.682042 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b3ed6f4_ac8b_4df0_80d1_bf51bdd4d830.slice/crio-cd678a8ff31ad2026fb353bdaa1d1164f8674332eb237ebb7cf50c0c805338d0 WatchSource:0}: Error finding container cd678a8ff31ad2026fb353bdaa1d1164f8674332eb237ebb7cf50c0c805338d0: Status 404 returned error can't find the container with id cd678a8ff31ad2026fb353bdaa1d1164f8674332eb237ebb7cf50c0c805338d0 Jun 15 07:53:21.894238 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.894155 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd"] Jun 15 07:53:21.899301 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.899280 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:21.911830 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.911812 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 15 07:53:21.912394 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.912379 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 15 07:53:21.912526 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.912511 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 15 07:53:21.912598 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.912525 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-z9525\"" Jun 15 07:53:21.912598 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.912526 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 15 07:53:21.935780 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:21.935754 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd"] Jun 15 07:53:22.030418 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.030389 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca014551-88ec-4daa-8ce2-a42dae6289f0-tls-certs\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.030603 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.030479 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bmh7l\" (UniqueName: \"kubernetes.io/projected/ca014551-88ec-4daa-8ce2-a42dae6289f0-kube-api-access-bmh7l\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.030603 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.030559 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca014551-88ec-4daa-8ce2-a42dae6289f0-tmp\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.131537 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.131503 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca014551-88ec-4daa-8ce2-a42dae6289f0-tmp\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.131716 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.131565 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca014551-88ec-4daa-8ce2-a42dae6289f0-tls-certs\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.131716 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.131597 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bmh7l\" (UniqueName: \"kubernetes.io/projected/ca014551-88ec-4daa-8ce2-a42dae6289f0-kube-api-access-bmh7l\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.133847 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.133817 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ca014551-88ec-4daa-8ce2-a42dae6289f0-tmp\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.133975 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.133958 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ca014551-88ec-4daa-8ce2-a42dae6289f0-tls-certs\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.150837 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.150819 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bmh7l\" (UniqueName: \"kubernetes.io/projected/ca014551-88ec-4daa-8ce2-a42dae6289f0-kube-api-access-bmh7l\") pod \"kube-auth-proxy-867cf8bfc-rxkmd\" (UID: \"ca014551-88ec-4daa-8ce2-a42dae6289f0\") " pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.157178 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.157156 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" event={"ID":"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830","Type":"ContainerStarted","Data":"cd678a8ff31ad2026fb353bdaa1d1164f8674332eb237ebb7cf50c0c805338d0"} Jun 15 07:53:22.211678 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.211648 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" Jun 15 07:53:22.392648 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:22.392618 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd"] Jun 15 07:53:22.397202 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:53:22.396999 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca014551_88ec_4daa_8ce2_a42dae6289f0.slice/crio-1109daa40bdda39677ea97fd382b57b240a7ca50f76cc95467c76fd37ba34ee6 WatchSource:0}: Error finding container 1109daa40bdda39677ea97fd382b57b240a7ca50f76cc95467c76fd37ba34ee6: Status 404 returned error can't find the container with id 1109daa40bdda39677ea97fd382b57b240a7ca50f76cc95467c76fd37ba34ee6 Jun 15 07:53:23.162111 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:23.162083 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" event={"ID":"ca014551-88ec-4daa-8ce2-a42dae6289f0","Type":"ContainerStarted","Data":"1109daa40bdda39677ea97fd382b57b240a7ca50f76cc95467c76fd37ba34ee6"} Jun 15 07:53:24.169412 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:24.169371 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" event={"ID":"5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830","Type":"ContainerStarted","Data":"5a1bba0e7b2efc9ddc14625a78b04deaae3f94020598fd3ea3e4cfd42ab807a6"} Jun 15 07:53:24.169878 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:24.169565 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:24.189886 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:24.189729 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" podStartSLOduration=1.7490192150000001 podStartE2EDuration="3.189711925s" totalImagesPullingTime="1.44069271s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:53:24.189364969 +0000 UTC m=+275.710853297" watchObservedRunningTime="2026-06-15 07:53:24.189711925 +0000 UTC m=+275.711200251" Jun 15 07:53:26.180615 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:26.180577 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" event={"ID":"ca014551-88ec-4daa-8ce2-a42dae6289f0","Type":"ContainerStarted","Data":"0d4de1b70e63f20bc1f45f96e692a78a81bbd85a16271b1ebf9c27e0e6c5e395"} Jun 15 07:53:26.206009 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:26.205952 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-867cf8bfc-rxkmd" podStartSLOduration=2.174269903 podStartE2EDuration="5.205936561s" totalImagesPullingTime="3.031666658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:53:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:53:26.204403241 +0000 UTC m=+277.725891567" watchObservedRunningTime="2026-06-15 07:53:26.205936561 +0000 UTC m=+277.727424888" Jun 15 07:53:35.176786 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:35.176746 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6b9cb757d6-pj75m" Jun 15 07:53:48.874816 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:48.874784 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:53:48.877494 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:48.877450 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:53:48.880378 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:53:48.880361 2569 kubelet.go:1648] "Image garbage collection succeeded" Jun 15 07:54:53.401135 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.401097 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9"] Jun 15 07:54:53.403270 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.403254 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" Jun 15 07:54:53.405899 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.405877 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lhwml\"" Jun 15 07:54:53.407156 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.407138 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 15 07:54:53.407260 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.407140 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 15 07:54:53.407260 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.407143 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 15 07:54:53.414216 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.414185 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9"] Jun 15 07:54:53.506867 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.506831 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zl2qn\" (UniqueName: \"kubernetes.io/projected/c4e33350-8901-47b2-8231-71f5128e94cf-kube-api-access-zl2qn\") pod \"dns-operator-controller-manager-864dd78c4c-bcxg9\" (UID: \"c4e33350-8901-47b2-8231-71f5128e94cf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" Jun 15 07:54:53.607600 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.607558 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zl2qn\" (UniqueName: \"kubernetes.io/projected/c4e33350-8901-47b2-8231-71f5128e94cf-kube-api-access-zl2qn\") pod \"dns-operator-controller-manager-864dd78c4c-bcxg9\" (UID: \"c4e33350-8901-47b2-8231-71f5128e94cf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" Jun 15 07:54:53.620860 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.620828 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zl2qn\" (UniqueName: \"kubernetes.io/projected/c4e33350-8901-47b2-8231-71f5128e94cf-kube-api-access-zl2qn\") pod \"dns-operator-controller-manager-864dd78c4c-bcxg9\" (UID: \"c4e33350-8901-47b2-8231-71f5128e94cf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" Jun 15 07:54:53.714905 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.714828 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" Jun 15 07:54:53.854382 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.854351 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9"] Jun 15 07:54:53.857448 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:54:53.857421 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4e33350_8901_47b2_8231_71f5128e94cf.slice/crio-fd28c63f6d63ff87cc824f911f27c4203b41f25b8b0d766af7323f30103f3675 WatchSource:0}: Error finding container fd28c63f6d63ff87cc824f911f27c4203b41f25b8b0d766af7323f30103f3675: Status 404 returned error can't find the container with id fd28c63f6d63ff87cc824f911f27c4203b41f25b8b0d766af7323f30103f3675 Jun 15 07:54:53.859538 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:53.859519 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 07:54:54.575830 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:54.575797 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" event={"ID":"c4e33350-8901-47b2-8231-71f5128e94cf","Type":"ContainerStarted","Data":"fd28c63f6d63ff87cc824f911f27c4203b41f25b8b0d766af7323f30103f3675"} Jun 15 07:54:55.408665 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.408631 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms"] Jun 15 07:54:55.411826 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.411810 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:54:55.414307 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.414288 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-2rmmj\"" Jun 15 07:54:55.422032 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.422008 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms"] Jun 15 07:54:55.525288 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.525249 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4pzk\" (UniqueName: \"kubernetes.io/projected/ff469b86-de2b-46fd-b101-fcca69da2553-kube-api-access-d4pzk\") pod \"limitador-operator-controller-manager-859d7b78bd-wfzms\" (UID: \"ff469b86-de2b-46fd-b101-fcca69da2553\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:54:55.625948 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.625913 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4pzk\" (UniqueName: \"kubernetes.io/projected/ff469b86-de2b-46fd-b101-fcca69da2553-kube-api-access-d4pzk\") pod \"limitador-operator-controller-manager-859d7b78bd-wfzms\" (UID: \"ff469b86-de2b-46fd-b101-fcca69da2553\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:54:55.635729 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.635703 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4pzk\" (UniqueName: \"kubernetes.io/projected/ff469b86-de2b-46fd-b101-fcca69da2553-kube-api-access-d4pzk\") pod \"limitador-operator-controller-manager-859d7b78bd-wfzms\" (UID: \"ff469b86-de2b-46fd-b101-fcca69da2553\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:54:55.722853 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.722757 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:54:55.881738 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:55.881705 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms"] Jun 15 07:54:56.149429 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:54:56.149400 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff469b86_de2b_46fd_b101_fcca69da2553.slice/crio-eafd2284eee03d1f47ec0d56b9842dbe34a18ce0a565885a8d6b33335b0375c0 WatchSource:0}: Error finding container eafd2284eee03d1f47ec0d56b9842dbe34a18ce0a565885a8d6b33335b0375c0: Status 404 returned error can't find the container with id eafd2284eee03d1f47ec0d56b9842dbe34a18ce0a565885a8d6b33335b0375c0 Jun 15 07:54:56.586878 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:56.586782 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" event={"ID":"c4e33350-8901-47b2-8231-71f5128e94cf","Type":"ContainerStarted","Data":"5561d180985cf95c7e02a4132301c1dfd29efd38fb10bd7b0b5d347051552de3"} Jun 15 07:54:56.587044 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:56.586888 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" Jun 15 07:54:56.588047 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:56.588019 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" event={"ID":"ff469b86-de2b-46fd-b101-fcca69da2553","Type":"ContainerStarted","Data":"eafd2284eee03d1f47ec0d56b9842dbe34a18ce0a565885a8d6b33335b0375c0"} Jun 15 07:54:56.612139 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:56.612091 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" podStartSLOduration=1.275835471 podStartE2EDuration="3.612075238s" totalImagesPullingTime="2.336239767s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:54:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:54:56.61068748 +0000 UTC m=+368.132175828" watchObservedRunningTime="2026-06-15 07:54:56.612075238 +0000 UTC m=+368.133563563" Jun 15 07:54:58.256969 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.256933 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4"] Jun 15 07:54:58.260331 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.260314 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.262897 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.262875 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 15 07:54:58.262993 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.262905 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 15 07:54:58.262993 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.262912 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-twdwp\"" Jun 15 07:54:58.268572 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.268545 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4"] Jun 15 07:54:58.355596 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.355507 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.355596 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.355549 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9qqm\" (UniqueName: \"kubernetes.io/projected/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-kube-api-access-d9qqm\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.355778 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.355627 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.456235 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.456198 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.456235 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.456242 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9qqm\" (UniqueName: \"kubernetes.io/projected/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-kube-api-access-d9qqm\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.456467 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.456281 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.456467 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:54:58.456346 2569 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 15 07:54:58.456467 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:54:58.456425 2569 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-plugin-serving-cert podName:50ca5009-d2b3-40a6-864c-74ae2d7a7cd4 nodeName:}" failed. No retries permitted until 2026-06-15 07:54:58.956407408 +0000 UTC m=+370.477895712 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-mrwc4" (UID: "50ca5009-d2b3-40a6-864c-74ae2d7a7cd4") : secret "plugin-serving-cert" not found Jun 15 07:54:58.456919 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.456901 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.465327 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.465305 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9qqm\" (UniqueName: \"kubernetes.io/projected/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-kube-api-access-d9qqm\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.600165 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.600129 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" event={"ID":"ff469b86-de2b-46fd-b101-fcca69da2553","Type":"ContainerStarted","Data":"ebf1432ac3db6a4da87e3283bb0101703c343bd0487ac35f6e5d7fad0095ef2e"} Jun 15 07:54:58.600346 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.600281 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:54:58.619873 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.619751 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" podStartSLOduration=1.673693906 podStartE2EDuration="3.619736895s" totalImagesPullingTime="1.946042989s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:54:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:54:58.617991081 +0000 UTC m=+370.139479427" watchObservedRunningTime="2026-06-15 07:54:58.619736895 +0000 UTC m=+370.141225221" Jun 15 07:54:58.959780 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.959745 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:58.962116 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:58.962096 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/50ca5009-d2b3-40a6-864c-74ae2d7a7cd4-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-mrwc4\" (UID: \"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:59.169447 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:59.169414 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" Jun 15 07:54:59.299213 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:59.299179 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4"] Jun 15 07:54:59.302509 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:54:59.302487 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod50ca5009_d2b3_40a6_864c_74ae2d7a7cd4.slice/crio-61389b6c299acd1dbf430898d4d770d9e9b8cd3b2f81f13188294ac05da8bba2 WatchSource:0}: Error finding container 61389b6c299acd1dbf430898d4d770d9e9b8cd3b2f81f13188294ac05da8bba2: Status 404 returned error can't find the container with id 61389b6c299acd1dbf430898d4d770d9e9b8cd3b2f81f13188294ac05da8bba2 Jun 15 07:54:59.605574 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:54:59.605486 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" event={"ID":"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4","Type":"ContainerStarted","Data":"61389b6c299acd1dbf430898d4d770d9e9b8cd3b2f81f13188294ac05da8bba2"} Jun 15 07:55:07.596428 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:07.596346 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-bcxg9" Jun 15 07:55:08.326767 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.326730 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms"] Jun 15 07:55:08.327066 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.327011 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" containerName="manager" containerID="cri-o://ebf1432ac3db6a4da87e3283bb0101703c343bd0487ac35f6e5d7fad0095ef2e" gracePeriod=2 Jun 15 07:55:08.329688 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.329661 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:08.340897 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.340855 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms"] Jun 15 07:55:08.347962 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:08.347337 2569 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"ff469b86-de2b-46fd-b101-fcca69da2553\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-wfzms\": pods \"limitador-operator-controller-manager-859d7b78bd-wfzms\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:08.349257 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.349232 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j"] Jun 15 07:55:08.349374 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:08.349344 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wfzms\" is forbidden: User \"system:node:ip-10-0-143-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-10.ec2.internal' and this object" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:08.349741 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.349723 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" containerName="manager" Jun 15 07:55:08.349831 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.349742 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" containerName="manager" Jun 15 07:55:08.349882 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.349830 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" containerName="manager" Jun 15 07:55:08.356349 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.356329 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" Jun 15 07:55:08.368607 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.368580 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j"] Jun 15 07:55:08.389801 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:08.389757 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wfzms\" is forbidden: User \"system:node:ip-10-0-143-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-10.ec2.internal' and this object" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:08.450642 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.450593 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2zds\" (UniqueName: \"kubernetes.io/projected/07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d-kube-api-access-z2zds\") pod \"limitador-operator-controller-manager-859d7b78bd-mhk9j\" (UID: \"07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" Jun 15 07:55:08.552165 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.552127 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2zds\" (UniqueName: \"kubernetes.io/projected/07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d-kube-api-access-z2zds\") pod \"limitador-operator-controller-manager-859d7b78bd-mhk9j\" (UID: \"07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" Jun 15 07:55:08.562985 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.562954 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2zds\" (UniqueName: \"kubernetes.io/projected/07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d-kube-api-access-z2zds\") pod \"limitador-operator-controller-manager-859d7b78bd-mhk9j\" (UID: \"07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" Jun 15 07:55:08.718523 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:08.718486 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" Jun 15 07:55:08.922249 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:08.922214 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wfzms\" is forbidden: User \"system:node:ip-10-0-143-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-10.ec2.internal' and this object" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:21.730536 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:21.730505 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j"] Jun 15 07:55:21.731021 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:21.730999 2569 generic.go:356] "Generic (PLEG): container finished" podID="ff469b86-de2b-46fd-b101-fcca69da2553" containerID="ebf1432ac3db6a4da87e3283bb0101703c343bd0487ac35f6e5d7fad0095ef2e" exitCode=0 Jun 15 07:55:21.732820 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:55:21.732795 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07a6c7ef_009b_4a0b_bab4_e7ab8f6f6e9d.slice/crio-3de268997253442fdcd19b850baae5c75577d23a4151b187b6012e5a284e3b7c WatchSource:0}: Error finding container 3de268997253442fdcd19b850baae5c75577d23a4151b187b6012e5a284e3b7c: Status 404 returned error can't find the container with id 3de268997253442fdcd19b850baae5c75577d23a4151b187b6012e5a284e3b7c Jun 15 07:55:21.785167 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:21.785127 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:21.787618 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:21.787584 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wfzms\" is forbidden: User \"system:node:ip-10-0-143-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-10.ec2.internal' and this object" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:21.881116 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:21.881040 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4pzk\" (UniqueName: \"kubernetes.io/projected/ff469b86-de2b-46fd-b101-fcca69da2553-kube-api-access-d4pzk\") pod \"ff469b86-de2b-46fd-b101-fcca69da2553\" (UID: \"ff469b86-de2b-46fd-b101-fcca69da2553\") " Jun 15 07:55:21.883388 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:21.883347 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff469b86-de2b-46fd-b101-fcca69da2553-kube-api-access-d4pzk" (OuterVolumeSpecName: "kube-api-access-d4pzk") pod "ff469b86-de2b-46fd-b101-fcca69da2553" (UID: "ff469b86-de2b-46fd-b101-fcca69da2553"). InnerVolumeSpecName "kube-api-access-d4pzk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:55:21.982116 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:21.982081 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4pzk\" (UniqueName: \"kubernetes.io/projected/ff469b86-de2b-46fd-b101-fcca69da2553-kube-api-access-d4pzk\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:55:22.737166 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.737128 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" event={"ID":"50ca5009-d2b3-40a6-864c-74ae2d7a7cd4","Type":"ContainerStarted","Data":"aba67a1a29445c5f3e8903bfae90e03effea57df2d4fe8e883b349670068efea"} Jun 15 07:55:22.738435 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.738410 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:22.738435 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.738423 2569 scope.go:117] "RemoveContainer" containerID="ebf1432ac3db6a4da87e3283bb0101703c343bd0487ac35f6e5d7fad0095ef2e" Jun 15 07:55:22.740153 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.740134 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" event={"ID":"07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d","Type":"ContainerStarted","Data":"d96434c1ad73397bda4a28f5e1bfd8bbd4d89f01e0cd40e5deae9d0b0e00f86d"} Jun 15 07:55:22.740253 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.740171 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" event={"ID":"07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d","Type":"ContainerStarted","Data":"3de268997253442fdcd19b850baae5c75577d23a4151b187b6012e5a284e3b7c"} Jun 15 07:55:22.740253 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.740222 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" Jun 15 07:55:22.753666 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.753624 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-mrwc4" podStartSLOduration=1.9889129909999999 podStartE2EDuration="24.753608314s" totalImagesPullingTime="22.764695323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:54:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:55:22.752590204 +0000 UTC m=+394.274078530" watchObservedRunningTime="2026-06-15 07:55:22.753608314 +0000 UTC m=+394.275096639" Jun 15 07:55:22.754546 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:22.754520 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wfzms\" is forbidden: User \"system:node:ip-10-0-143-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-10.ec2.internal' and this object" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:22.775205 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.775143 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" podStartSLOduration=14.775119963 podStartE2EDuration="14.775119963s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:55:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:55:22.773322551 +0000 UTC m=+394.294810876" watchObservedRunningTime="2026-06-15 07:55:22.775119963 +0000 UTC m=+394.296608280" Jun 15 07:55:22.775367 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:22.775211 2569 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-wfzms\" is forbidden: User \"system:node:ip-10-0-143-10.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-143-10.ec2.internal' and this object" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-wfzms" Jun 15 07:55:22.924025 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:22.923989 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff469b86-de2b-46fd-b101-fcca69da2553" path="/var/lib/kubelet/pods/ff469b86-de2b-46fd-b101-fcca69da2553/volumes" Jun 15 07:55:33.747596 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:33.747562 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mhk9j" Jun 15 07:55:39.670968 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.670936 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-4bz58"] Jun 15 07:55:39.673504 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.673484 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4bz58" Jun 15 07:55:39.675985 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.675965 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rbgb8\"" Jun 15 07:55:39.683685 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.683665 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4bz58"] Jun 15 07:55:39.734212 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.734174 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28974\" (UniqueName: \"kubernetes.io/projected/d84f4132-f7b2-4709-942e-0d4698fc3a3f-kube-api-access-28974\") pod \"authorino-58cd955675-4bz58\" (UID: \"d84f4132-f7b2-4709-942e-0d4698fc3a3f\") " pod="kuadrant-system/authorino-58cd955675-4bz58" Jun 15 07:55:39.835538 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.835508 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28974\" (UniqueName: \"kubernetes.io/projected/d84f4132-f7b2-4709-942e-0d4698fc3a3f-kube-api-access-28974\") pod \"authorino-58cd955675-4bz58\" (UID: \"d84f4132-f7b2-4709-942e-0d4698fc3a3f\") " pod="kuadrant-system/authorino-58cd955675-4bz58" Jun 15 07:55:39.844704 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.844672 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28974\" (UniqueName: \"kubernetes.io/projected/d84f4132-f7b2-4709-942e-0d4698fc3a3f-kube-api-access-28974\") pod \"authorino-58cd955675-4bz58\" (UID: \"d84f4132-f7b2-4709-942e-0d4698fc3a3f\") " pod="kuadrant-system/authorino-58cd955675-4bz58" Jun 15 07:55:39.982813 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:39.982732 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4bz58" Jun 15 07:55:40.019896 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.019855 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-wxztw"] Jun 15 07:55:40.029341 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.029292 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wxztw" Jun 15 07:55:40.030823 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.030789 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wxztw"] Jun 15 07:55:40.038147 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.038118 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxkvs\" (UniqueName: \"kubernetes.io/projected/4c57f8ac-1c1b-479e-b2a3-4f083052e457-kube-api-access-vxkvs\") pod \"authorino-75d556bd77-wxztw\" (UID: \"4c57f8ac-1c1b-479e-b2a3-4f083052e457\") " pod="kuadrant-system/authorino-75d556bd77-wxztw" Jun 15 07:55:40.131757 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.131730 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-4bz58"] Jun 15 07:55:40.134400 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:55:40.134364 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd84f4132_f7b2_4709_942e_0d4698fc3a3f.slice/crio-f2fbb42a33c469051eab08bb98cffe1ab1eafcc7b90368158434f9e67cfe8377 WatchSource:0}: Error finding container f2fbb42a33c469051eab08bb98cffe1ab1eafcc7b90368158434f9e67cfe8377: Status 404 returned error can't find the container with id f2fbb42a33c469051eab08bb98cffe1ab1eafcc7b90368158434f9e67cfe8377 Jun 15 07:55:40.139377 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.139354 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxkvs\" (UniqueName: \"kubernetes.io/projected/4c57f8ac-1c1b-479e-b2a3-4f083052e457-kube-api-access-vxkvs\") pod \"authorino-75d556bd77-wxztw\" (UID: \"4c57f8ac-1c1b-479e-b2a3-4f083052e457\") " pod="kuadrant-system/authorino-75d556bd77-wxztw" Jun 15 07:55:40.151189 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.151166 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxkvs\" (UniqueName: \"kubernetes.io/projected/4c57f8ac-1c1b-479e-b2a3-4f083052e457-kube-api-access-vxkvs\") pod \"authorino-75d556bd77-wxztw\" (UID: \"4c57f8ac-1c1b-479e-b2a3-4f083052e457\") " pod="kuadrant-system/authorino-75d556bd77-wxztw" Jun 15 07:55:40.341977 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.341905 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wxztw" Jun 15 07:55:40.471092 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.471063 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wxztw"] Jun 15 07:55:40.473588 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:55:40.473555 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4c57f8ac_1c1b_479e_b2a3_4f083052e457.slice/crio-723fb52a4899b6ea37367b217243b35cd7b6a20e24ee67618d2c0a27d936d685 WatchSource:0}: Error finding container 723fb52a4899b6ea37367b217243b35cd7b6a20e24ee67618d2c0a27d936d685: Status 404 returned error can't find the container with id 723fb52a4899b6ea37367b217243b35cd7b6a20e24ee67618d2c0a27d936d685 Jun 15 07:55:40.829973 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.829931 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4bz58" event={"ID":"d84f4132-f7b2-4709-942e-0d4698fc3a3f","Type":"ContainerStarted","Data":"f2fbb42a33c469051eab08bb98cffe1ab1eafcc7b90368158434f9e67cfe8377"} Jun 15 07:55:40.831908 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:40.831847 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wxztw" event={"ID":"4c57f8ac-1c1b-479e-b2a3-4f083052e457","Type":"ContainerStarted","Data":"723fb52a4899b6ea37367b217243b35cd7b6a20e24ee67618d2c0a27d936d685"} Jun 15 07:55:43.856069 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:43.856025 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wxztw" event={"ID":"4c57f8ac-1c1b-479e-b2a3-4f083052e457","Type":"ContainerStarted","Data":"46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be"} Jun 15 07:55:43.857314 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:43.857292 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4bz58" event={"ID":"d84f4132-f7b2-4709-942e-0d4698fc3a3f","Type":"ContainerStarted","Data":"e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38"} Jun 15 07:55:43.873601 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:43.872944 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-wxztw" podStartSLOduration=1.7250405930000001 podStartE2EDuration="4.87292418s" totalImagesPullingTime="3.147883587s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:55:43.871169332 +0000 UTC m=+415.392657670" watchObservedRunningTime="2026-06-15 07:55:43.87292418 +0000 UTC m=+415.394412507" Jun 15 07:55:43.886964 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:43.886911 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-4bz58" podStartSLOduration=1.405253201 podStartE2EDuration="4.886893948s" totalImagesPullingTime="3.481640747s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:55:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:55:43.885987553 +0000 UTC m=+415.407475882" watchObservedRunningTime="2026-06-15 07:55:43.886893948 +0000 UTC m=+415.408382274" Jun 15 07:55:43.911403 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:43.911369 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4bz58"] Jun 15 07:55:45.867916 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:45.867880 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-4bz58" podUID="d84f4132-f7b2-4709-942e-0d4698fc3a3f" containerName="authorino" containerID="cri-o://e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38" gracePeriod=30 Jun 15 07:55:46.112358 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.112324 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4bz58" Jun 15 07:55:46.192136 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.192100 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28974\" (UniqueName: \"kubernetes.io/projected/d84f4132-f7b2-4709-942e-0d4698fc3a3f-kube-api-access-28974\") pod \"d84f4132-f7b2-4709-942e-0d4698fc3a3f\" (UID: \"d84f4132-f7b2-4709-942e-0d4698fc3a3f\") " Jun 15 07:55:46.194207 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.194174 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d84f4132-f7b2-4709-942e-0d4698fc3a3f-kube-api-access-28974" (OuterVolumeSpecName: "kube-api-access-28974") pod "d84f4132-f7b2-4709-942e-0d4698fc3a3f" (UID: "d84f4132-f7b2-4709-942e-0d4698fc3a3f"). InnerVolumeSpecName "kube-api-access-28974". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:55:46.293498 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.293433 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28974\" (UniqueName: \"kubernetes.io/projected/d84f4132-f7b2-4709-942e-0d4698fc3a3f-kube-api-access-28974\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:55:46.873710 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.873675 2569 generic.go:356] "Generic (PLEG): container finished" podID="d84f4132-f7b2-4709-942e-0d4698fc3a3f" containerID="e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38" exitCode=0 Jun 15 07:55:46.874138 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.873716 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-4bz58" Jun 15 07:55:46.874138 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.873761 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4bz58" event={"ID":"d84f4132-f7b2-4709-942e-0d4698fc3a3f","Type":"ContainerDied","Data":"e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38"} Jun 15 07:55:46.874138 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.873798 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-4bz58" event={"ID":"d84f4132-f7b2-4709-942e-0d4698fc3a3f","Type":"ContainerDied","Data":"f2fbb42a33c469051eab08bb98cffe1ab1eafcc7b90368158434f9e67cfe8377"} Jun 15 07:55:46.874138 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.873819 2569 scope.go:117] "RemoveContainer" containerID="e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38" Jun 15 07:55:46.882762 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.882743 2569 scope.go:117] "RemoveContainer" containerID="e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38" Jun 15 07:55:46.883014 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:55:46.882994 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38\": container with ID starting with e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38 not found: ID does not exist" containerID="e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38" Jun 15 07:55:46.883081 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.883021 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38"} err="failed to get container status \"e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38\": rpc error: code = NotFound desc = could not find container \"e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38\": container with ID starting with e66a77e4fc1bff360f872505f10a34f118c45b07bef32666e904f84d8f9ebe38 not found: ID does not exist" Jun 15 07:55:46.898759 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.898731 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-4bz58"] Jun 15 07:55:46.905527 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.905500 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-4bz58"] Jun 15 07:55:46.923441 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:55:46.923408 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d84f4132-f7b2-4709-942e-0d4698fc3a3f" path="/var/lib/kubelet/pods/d84f4132-f7b2-4709-942e-0d4698fc3a3f/volumes" Jun 15 07:56:39.672042 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.672007 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:56:39.672430 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.672331 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d84f4132-f7b2-4709-942e-0d4698fc3a3f" containerName="authorino" Jun 15 07:56:39.672430 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.672342 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="d84f4132-f7b2-4709-942e-0d4698fc3a3f" containerName="authorino" Jun 15 07:56:39.672430 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.672411 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="d84f4132-f7b2-4709-942e-0d4698fc3a3f" containerName="authorino" Jun 15 07:56:39.674367 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.674351 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:39.677105 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.677084 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 07:56:39.677217 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.677171 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 07:56:39.677217 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.677182 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-n57rd\"" Jun 15 07:56:39.678425 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.678411 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 07:56:39.685299 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.685279 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:56:39.755200 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.755172 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7nl7j\" (UniqueName: \"kubernetes.io/projected/c01c9ce9-c4ae-4786-8cc9-e3a2599eddad-kube-api-access-7nl7j\") pod \"maas-keycloak-0\" (UID: \"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:39.855944 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.855908 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7nl7j\" (UniqueName: \"kubernetes.io/projected/c01c9ce9-c4ae-4786-8cc9-e3a2599eddad-kube-api-access-7nl7j\") pod \"maas-keycloak-0\" (UID: \"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:39.865226 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.865202 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7nl7j\" (UniqueName: \"kubernetes.io/projected/c01c9ce9-c4ae-4786-8cc9-e3a2599eddad-kube-api-access-7nl7j\") pod \"maas-keycloak-0\" (UID: \"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:39.985063 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:39.984989 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:40.116579 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:40.116555 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:56:40.118850 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:56:40.118822 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01c9ce9_c4ae_4786_8cc9_e3a2599eddad.slice/crio-80277050eac9b9623b693eb3ff401e5ccdb0fdf3bfd51721a93bccfa8c2256bc WatchSource:0}: Error finding container 80277050eac9b9623b693eb3ff401e5ccdb0fdf3bfd51721a93bccfa8c2256bc: Status 404 returned error can't find the container with id 80277050eac9b9623b693eb3ff401e5ccdb0fdf3bfd51721a93bccfa8c2256bc Jun 15 07:56:41.120998 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:41.120958 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad","Type":"ContainerStarted","Data":"80277050eac9b9623b693eb3ff401e5ccdb0fdf3bfd51721a93bccfa8c2256bc"} Jun 15 07:56:45.143958 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:45.143918 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad","Type":"ContainerStarted","Data":"fa1d79e9a25e5d2d5b507ee54b28f263aea149d2ee7cbc16fd4ca97fc0c81f2b"} Jun 15 07:56:45.163285 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:45.163216 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.901248305 podStartE2EDuration="6.163199088s" totalImagesPullingTime="4.261950783s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:56:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:56:45.162408265 +0000 UTC m=+476.683896602" watchObservedRunningTime="2026-06-15 07:56:45.163199088 +0000 UTC m=+476.684687414" Jun 15 07:56:45.985552 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:45.985515 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:45.987271 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:45.987228 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:46.985503 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:46.985438 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:47.985629 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:47.985573 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:48.986509 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:48.986421 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:49.985491 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:49.985420 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:49.986570 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:49.986535 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:50.985433 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:50.985383 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:51.985697 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:51.985649 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:52.986073 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:52.986028 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:53.986149 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:53.986104 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:54.986009 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:54.985944 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:55.986089 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:55.986043 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:56.985685 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:56.985645 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.28:9000/health/started\": dial tcp 10.133.0.28:9000: connect: connection refused" Jun 15 07:56:58.095018 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:58.094966 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 07:56:58.108250 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:56:58.108207 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 07:57:08.101927 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:08.101894 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 07:57:09.074274 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.074244 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msr7n"] Jun 15 07:57:09.076473 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.076444 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msr7n" Jun 15 07:57:09.087032 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.087006 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msr7n"] Jun 15 07:57:09.244745 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.244712 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pphjc\" (UniqueName: \"kubernetes.io/projected/36fae202-9a20-4054-9743-ab6c3d641d73-kube-api-access-pphjc\") pod \"authorino-5d4b67c446-msr7n\" (UID: \"36fae202-9a20-4054-9743-ab6c3d641d73\") " pod="kuadrant-system/authorino-5d4b67c446-msr7n" Jun 15 07:57:09.338279 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.338204 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msr7n"] Jun 15 07:57:09.338485 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:57:09.338452 2569 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-pphjc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-msr7n" podUID="36fae202-9a20-4054-9743-ab6c3d641d73" Jun 15 07:57:09.345851 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.345828 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pphjc\" (UniqueName: \"kubernetes.io/projected/36fae202-9a20-4054-9743-ab6c3d641d73-kube-api-access-pphjc\") pod \"authorino-5d4b67c446-msr7n\" (UID: \"36fae202-9a20-4054-9743-ab6c3d641d73\") " pod="kuadrant-system/authorino-5d4b67c446-msr7n" Jun 15 07:57:09.358423 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.358395 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pphjc\" (UniqueName: \"kubernetes.io/projected/36fae202-9a20-4054-9743-ab6c3d641d73-kube-api-access-pphjc\") pod \"authorino-5d4b67c446-msr7n\" (UID: \"36fae202-9a20-4054-9743-ab6c3d641d73\") " pod="kuadrant-system/authorino-5d4b67c446-msr7n" Jun 15 07:57:09.368437 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.368417 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-c8646f6bc-9h8hc"] Jun 15 07:57:09.370706 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.370693 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" Jun 15 07:57:09.381335 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.381315 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c8646f6bc-9h8hc"] Jun 15 07:57:09.548369 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.548334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqptp\" (UniqueName: \"kubernetes.io/projected/17742fe5-d6dc-4f2f-bdcc-a5b08cd95677-kube-api-access-sqptp\") pod \"authorino-c8646f6bc-9h8hc\" (UID: \"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677\") " pod="kuadrant-system/authorino-c8646f6bc-9h8hc" Jun 15 07:57:09.649804 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.649776 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqptp\" (UniqueName: \"kubernetes.io/projected/17742fe5-d6dc-4f2f-bdcc-a5b08cd95677-kube-api-access-sqptp\") pod \"authorino-c8646f6bc-9h8hc\" (UID: \"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677\") " pod="kuadrant-system/authorino-c8646f6bc-9h8hc" Jun 15 07:57:09.659515 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.659488 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqptp\" (UniqueName: \"kubernetes.io/projected/17742fe5-d6dc-4f2f-bdcc-a5b08cd95677-kube-api-access-sqptp\") pod \"authorino-c8646f6bc-9h8hc\" (UID: \"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677\") " pod="kuadrant-system/authorino-c8646f6bc-9h8hc" Jun 15 07:57:09.679857 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.679822 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" Jun 15 07:57:09.804357 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:09.804334 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-c8646f6bc-9h8hc"] Jun 15 07:57:09.806826 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:57:09.806803 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod17742fe5_d6dc_4f2f_bdcc_a5b08cd95677.slice/crio-6bfb25f882bf9addda2e4bb51000d26fb954347c417c6cde096366ff109040c2 WatchSource:0}: Error finding container 6bfb25f882bf9addda2e4bb51000d26fb954347c417c6cde096366ff109040c2: Status 404 returned error can't find the container with id 6bfb25f882bf9addda2e4bb51000d26fb954347c417c6cde096366ff109040c2 Jun 15 07:57:10.310679 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.310650 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msr7n" Jun 15 07:57:10.311076 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.310674 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" event={"ID":"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677","Type":"ContainerStarted","Data":"a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906"} Jun 15 07:57:10.311076 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.310720 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" event={"ID":"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677","Type":"ContainerStarted","Data":"6bfb25f882bf9addda2e4bb51000d26fb954347c417c6cde096366ff109040c2"} Jun 15 07:57:10.316990 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.316965 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msr7n" Jun 15 07:57:10.341506 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.341435 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" podStartSLOduration=0.945297596 podStartE2EDuration="1.341421221s" totalImagesPullingTime="396.123625ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:57:10.340979239 +0000 UTC m=+501.862467566" watchObservedRunningTime="2026-06-15 07:57:10.341421221 +0000 UTC m=+501.862909547" Jun 15 07:57:10.354517 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.354490 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pphjc\" (UniqueName: \"kubernetes.io/projected/36fae202-9a20-4054-9743-ab6c3d641d73-kube-api-access-pphjc\") pod \"36fae202-9a20-4054-9743-ab6c3d641d73\" (UID: \"36fae202-9a20-4054-9743-ab6c3d641d73\") " Jun 15 07:57:10.356581 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.356554 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/36fae202-9a20-4054-9743-ab6c3d641d73-kube-api-access-pphjc" (OuterVolumeSpecName: "kube-api-access-pphjc") pod "36fae202-9a20-4054-9743-ab6c3d641d73" (UID: "36fae202-9a20-4054-9743-ab6c3d641d73"). InnerVolumeSpecName "kube-api-access-pphjc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:57:10.370786 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.370760 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wxztw"] Jun 15 07:57:10.370939 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.370919 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-wxztw" podUID="4c57f8ac-1c1b-479e-b2a3-4f083052e457" containerName="authorino" containerID="cri-o://46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be" gracePeriod=30 Jun 15 07:57:10.455076 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.455010 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pphjc\" (UniqueName: \"kubernetes.io/projected/36fae202-9a20-4054-9743-ab6c3d641d73-kube-api-access-pphjc\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:57:10.610629 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.610605 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wxztw" Jun 15 07:57:10.656256 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.656227 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxkvs\" (UniqueName: \"kubernetes.io/projected/4c57f8ac-1c1b-479e-b2a3-4f083052e457-kube-api-access-vxkvs\") pod \"4c57f8ac-1c1b-479e-b2a3-4f083052e457\" (UID: \"4c57f8ac-1c1b-479e-b2a3-4f083052e457\") " Jun 15 07:57:10.658206 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.658176 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c57f8ac-1c1b-479e-b2a3-4f083052e457-kube-api-access-vxkvs" (OuterVolumeSpecName: "kube-api-access-vxkvs") pod "4c57f8ac-1c1b-479e-b2a3-4f083052e457" (UID: "4c57f8ac-1c1b-479e-b2a3-4f083052e457"). InnerVolumeSpecName "kube-api-access-vxkvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:57:10.757022 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.756954 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxkvs\" (UniqueName: \"kubernetes.io/projected/4c57f8ac-1c1b-479e-b2a3-4f083052e457-kube-api-access-vxkvs\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:57:10.768216 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.768189 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d46dd8f99-fjbq4"] Jun 15 07:57:10.768556 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.768543 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c57f8ac-1c1b-479e-b2a3-4f083052e457" containerName="authorino" Jun 15 07:57:10.768604 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.768558 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c57f8ac-1c1b-479e-b2a3-4f083052e457" containerName="authorino" Jun 15 07:57:10.768658 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.768642 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c57f8ac-1c1b-479e-b2a3-4f083052e457" containerName="authorino" Jun 15 07:57:10.770509 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.770493 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:10.773024 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.773006 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 15 07:57:10.781943 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.781920 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d46dd8f99-fjbq4"] Jun 15 07:57:10.857361 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.857325 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gszf2\" (UniqueName: \"kubernetes.io/projected/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-kube-api-access-gszf2\") pod \"authorino-5d46dd8f99-fjbq4\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:10.857534 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.857398 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-tls-cert\") pod \"authorino-5d46dd8f99-fjbq4\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:10.957957 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.957931 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-tls-cert\") pod \"authorino-5d46dd8f99-fjbq4\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:10.958063 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.957983 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gszf2\" (UniqueName: \"kubernetes.io/projected/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-kube-api-access-gszf2\") pod \"authorino-5d46dd8f99-fjbq4\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:10.960091 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.960067 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-tls-cert\") pod \"authorino-5d46dd8f99-fjbq4\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:10.966416 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:10.966395 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gszf2\" (UniqueName: \"kubernetes.io/projected/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-kube-api-access-gszf2\") pod \"authorino-5d46dd8f99-fjbq4\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:11.082349 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.082285 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:57:11.214843 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.214812 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d46dd8f99-fjbq4"] Jun 15 07:57:11.218359 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:57:11.218334 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5d900d16_0027_4fdf_a0a5_638bb2cd36e8.slice/crio-a213f8454e6a59b160df478a0ee97c1fb02012870c205d69ace436caf131824f WatchSource:0}: Error finding container a213f8454e6a59b160df478a0ee97c1fb02012870c205d69ace436caf131824f: Status 404 returned error can't find the container with id a213f8454e6a59b160df478a0ee97c1fb02012870c205d69ace436caf131824f Jun 15 07:57:11.316755 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.316719 2569 generic.go:356] "Generic (PLEG): container finished" podID="4c57f8ac-1c1b-479e-b2a3-4f083052e457" containerID="46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be" exitCode=0 Jun 15 07:57:11.317150 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.316777 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-wxztw" Jun 15 07:57:11.317150 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.316772 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wxztw" event={"ID":"4c57f8ac-1c1b-479e-b2a3-4f083052e457","Type":"ContainerDied","Data":"46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be"} Jun 15 07:57:11.317150 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.316821 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-wxztw" event={"ID":"4c57f8ac-1c1b-479e-b2a3-4f083052e457","Type":"ContainerDied","Data":"723fb52a4899b6ea37367b217243b35cd7b6a20e24ee67618d2c0a27d936d685"} Jun 15 07:57:11.317150 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.316843 2569 scope.go:117] "RemoveContainer" containerID="46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be" Jun 15 07:57:11.318097 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.318074 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" event={"ID":"5d900d16-0027-4fdf-a0a5-638bb2cd36e8","Type":"ContainerStarted","Data":"a213f8454e6a59b160df478a0ee97c1fb02012870c205d69ace436caf131824f"} Jun 15 07:57:11.318193 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.318101 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-msr7n" Jun 15 07:57:11.324962 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.324945 2569 scope.go:117] "RemoveContainer" containerID="46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be" Jun 15 07:57:11.325203 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:57:11.325184 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be\": container with ID starting with 46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be not found: ID does not exist" containerID="46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be" Jun 15 07:57:11.325251 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.325212 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be"} err="failed to get container status \"46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be\": rpc error: code = NotFound desc = could not find container \"46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be\": container with ID starting with 46bb7a7cc962fb6c48024057ced719bea32e1a208339298283799530ee5557be not found: ID does not exist" Jun 15 07:57:11.345256 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.345193 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msr7n"] Jun 15 07:57:11.351795 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.351774 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-msr7n"] Jun 15 07:57:11.363802 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.363776 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wxztw"] Jun 15 07:57:11.370164 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:11.370147 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-wxztw"] Jun 15 07:57:12.324969 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.324934 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" event={"ID":"5d900d16-0027-4fdf-a0a5-638bb2cd36e8","Type":"ContainerStarted","Data":"c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a"} Jun 15 07:57:12.348345 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.348304 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" podStartSLOduration=1.9703624180000001 podStartE2EDuration="2.348284535s" totalImagesPullingTime="377.922117ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:57:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:57:12.347662285 +0000 UTC m=+503.869150613" watchObservedRunningTime="2026-06-15 07:57:12.348284535 +0000 UTC m=+503.869772861" Jun 15 07:57:12.410073 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.410036 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c8646f6bc-9h8hc"] Jun 15 07:57:12.410217 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.410178 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" podUID="17742fe5-d6dc-4f2f-bdcc-a5b08cd95677" containerName="authorino" containerID="cri-o://a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906" gracePeriod=30 Jun 15 07:57:12.650484 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.650446 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" Jun 15 07:57:12.670407 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.670381 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sqptp\" (UniqueName: \"kubernetes.io/projected/17742fe5-d6dc-4f2f-bdcc-a5b08cd95677-kube-api-access-sqptp\") pod \"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677\" (UID: \"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677\") " Jun 15 07:57:12.672420 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.672397 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17742fe5-d6dc-4f2f-bdcc-a5b08cd95677-kube-api-access-sqptp" (OuterVolumeSpecName: "kube-api-access-sqptp") pod "17742fe5-d6dc-4f2f-bdcc-a5b08cd95677" (UID: "17742fe5-d6dc-4f2f-bdcc-a5b08cd95677"). InnerVolumeSpecName "kube-api-access-sqptp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:57:12.770954 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.770924 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sqptp\" (UniqueName: \"kubernetes.io/projected/17742fe5-d6dc-4f2f-bdcc-a5b08cd95677-kube-api-access-sqptp\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:57:12.924787 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.924753 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="36fae202-9a20-4054-9743-ab6c3d641d73" path="/var/lib/kubelet/pods/36fae202-9a20-4054-9743-ab6c3d641d73/volumes" Jun 15 07:57:12.925048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:12.925035 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c57f8ac-1c1b-479e-b2a3-4f083052e457" path="/var/lib/kubelet/pods/4c57f8ac-1c1b-479e-b2a3-4f083052e457/volumes" Jun 15 07:57:13.330211 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.330127 2569 generic.go:356] "Generic (PLEG): container finished" podID="17742fe5-d6dc-4f2f-bdcc-a5b08cd95677" containerID="a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906" exitCode=0 Jun 15 07:57:13.330211 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.330169 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" Jun 15 07:57:13.330636 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.330217 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" event={"ID":"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677","Type":"ContainerDied","Data":"a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906"} Jun 15 07:57:13.330636 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.330259 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-c8646f6bc-9h8hc" event={"ID":"17742fe5-d6dc-4f2f-bdcc-a5b08cd95677","Type":"ContainerDied","Data":"6bfb25f882bf9addda2e4bb51000d26fb954347c417c6cde096366ff109040c2"} Jun 15 07:57:13.330636 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.330276 2569 scope.go:117] "RemoveContainer" containerID="a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906" Jun 15 07:57:13.338955 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.338934 2569 scope.go:117] "RemoveContainer" containerID="a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906" Jun 15 07:57:13.339224 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:57:13.339200 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906\": container with ID starting with a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906 not found: ID does not exist" containerID="a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906" Jun 15 07:57:13.339325 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.339233 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906"} err="failed to get container status \"a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906\": rpc error: code = NotFound desc = could not find container \"a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906\": container with ID starting with a53b3b544f3a782bfd702b311c3ff202d9ad174b4b1685eb35af3772849c1906 not found: ID does not exist" Jun 15 07:57:13.352500 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.352451 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-c8646f6bc-9h8hc"] Jun 15 07:57:13.354607 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:13.354582 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-c8646f6bc-9h8hc"] Jun 15 07:57:14.233007 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.232977 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6ffd74cc5c-qmjrb"] Jun 15 07:57:14.233355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.233341 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17742fe5-d6dc-4f2f-bdcc-a5b08cd95677" containerName="authorino" Jun 15 07:57:14.233355 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.233356 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="17742fe5-d6dc-4f2f-bdcc-a5b08cd95677" containerName="authorino" Jun 15 07:57:14.233449 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.233420 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="17742fe5-d6dc-4f2f-bdcc-a5b08cd95677" containerName="authorino" Jun 15 07:57:14.235898 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.235883 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.238307 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.238283 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 07:57:14.238307 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.238294 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zlv2m\"" Jun 15 07:57:14.238649 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.238629 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 07:57:14.252382 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.252360 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ffd74cc5c-qmjrb"] Jun 15 07:57:14.285640 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.285620 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79622a85-9909-424e-80b2-fe3e5a5a2a7a-webhook-cert\") pod \"maas-controller-6ffd74cc5c-qmjrb\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.285744 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.285647 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzn7f\" (UniqueName: \"kubernetes.io/projected/79622a85-9909-424e-80b2-fe3e5a5a2a7a-kube-api-access-kzn7f\") pod \"maas-controller-6ffd74cc5c-qmjrb\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.386056 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.386028 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79622a85-9909-424e-80b2-fe3e5a5a2a7a-webhook-cert\") pod \"maas-controller-6ffd74cc5c-qmjrb\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.386431 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.386060 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzn7f\" (UniqueName: \"kubernetes.io/projected/79622a85-9909-424e-80b2-fe3e5a5a2a7a-kube-api-access-kzn7f\") pod \"maas-controller-6ffd74cc5c-qmjrb\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.388372 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.388344 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79622a85-9909-424e-80b2-fe3e5a5a2a7a-webhook-cert\") pod \"maas-controller-6ffd74cc5c-qmjrb\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.397518 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.397496 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzn7f\" (UniqueName: \"kubernetes.io/projected/79622a85-9909-424e-80b2-fe3e5a5a2a7a-kube-api-access-kzn7f\") pod \"maas-controller-6ffd74cc5c-qmjrb\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.423235 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.423209 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84f7d746c6-wxq2v"] Jun 15 07:57:14.425444 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.425431 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.437381 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.437350 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7d746c6-wxq2v"] Jun 15 07:57:14.487479 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.487400 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a71e675-b522-4e4f-85fa-a88c1d9e435b-webhook-cert\") pod \"maas-controller-84f7d746c6-wxq2v\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.487479 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.487430 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5qhf\" (UniqueName: \"kubernetes.io/projected/3a71e675-b522-4e4f-85fa-a88c1d9e435b-kube-api-access-r5qhf\") pod \"maas-controller-84f7d746c6-wxq2v\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.546373 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.546346 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:14.588031 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.588000 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a71e675-b522-4e4f-85fa-a88c1d9e435b-webhook-cert\") pod \"maas-controller-84f7d746c6-wxq2v\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.588166 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.588038 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r5qhf\" (UniqueName: \"kubernetes.io/projected/3a71e675-b522-4e4f-85fa-a88c1d9e435b-kube-api-access-r5qhf\") pod \"maas-controller-84f7d746c6-wxq2v\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.590618 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.590595 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a71e675-b522-4e4f-85fa-a88c1d9e435b-webhook-cert\") pod \"maas-controller-84f7d746c6-wxq2v\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.598138 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.598084 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5qhf\" (UniqueName: \"kubernetes.io/projected/3a71e675-b522-4e4f-85fa-a88c1d9e435b-kube-api-access-r5qhf\") pod \"maas-controller-84f7d746c6-wxq2v\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.675836 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.675790 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6ffd74cc5c-qmjrb"] Jun 15 07:57:14.677821 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:57:14.677793 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79622a85_9909_424e_80b2_fe3e5a5a2a7a.slice/crio-3f84922691c5ab3c7b934aefc1cb9443946848b3014d89bf0a97852934c47a2b WatchSource:0}: Error finding container 3f84922691c5ab3c7b934aefc1cb9443946848b3014d89bf0a97852934c47a2b: Status 404 returned error can't find the container with id 3f84922691c5ab3c7b934aefc1cb9443946848b3014d89bf0a97852934c47a2b Jun 15 07:57:14.736308 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.736285 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:14.863790 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.863767 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7d746c6-wxq2v"] Jun 15 07:57:14.865720 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:57:14.865690 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a71e675_b522_4e4f_85fa_a88c1d9e435b.slice/crio-42bdd5f25c85a8859408dfce75240b6405d8c01a7bce72c7ecc7ab5564a8da0f WatchSource:0}: Error finding container 42bdd5f25c85a8859408dfce75240b6405d8c01a7bce72c7ecc7ab5564a8da0f: Status 404 returned error can't find the container with id 42bdd5f25c85a8859408dfce75240b6405d8c01a7bce72c7ecc7ab5564a8da0f Jun 15 07:57:14.924138 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:14.924114 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="17742fe5-d6dc-4f2f-bdcc-a5b08cd95677" path="/var/lib/kubelet/pods/17742fe5-d6dc-4f2f-bdcc-a5b08cd95677/volumes" Jun 15 07:57:15.344936 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:15.344886 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" event={"ID":"3a71e675-b522-4e4f-85fa-a88c1d9e435b","Type":"ContainerStarted","Data":"42bdd5f25c85a8859408dfce75240b6405d8c01a7bce72c7ecc7ab5564a8da0f"} Jun 15 07:57:15.346764 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:15.346695 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" event={"ID":"79622a85-9909-424e-80b2-fe3e5a5a2a7a","Type":"ContainerStarted","Data":"3f84922691c5ab3c7b934aefc1cb9443946848b3014d89bf0a97852934c47a2b"} Jun 15 07:57:17.359539 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:17.359494 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" event={"ID":"79622a85-9909-424e-80b2-fe3e5a5a2a7a","Type":"ContainerStarted","Data":"2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32"} Jun 15 07:57:17.360049 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:17.359566 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:17.361154 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:17.361126 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" event={"ID":"3a71e675-b522-4e4f-85fa-a88c1d9e435b","Type":"ContainerStarted","Data":"b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45"} Jun 15 07:57:17.361279 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:17.361189 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:17.378129 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:17.378077 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" podStartSLOduration=1.604719515 podStartE2EDuration="3.378061529s" totalImagesPullingTime="1.773342014s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:57:17.376820803 +0000 UTC m=+508.898309132" watchObservedRunningTime="2026-06-15 07:57:17.378061529 +0000 UTC m=+508.899549855" Jun 15 07:57:17.401752 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:17.401701 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" podStartSLOduration=1.819592597 podStartE2EDuration="3.401685943s" totalImagesPullingTime="1.582093346s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:57:17.4005655 +0000 UTC m=+508.922053827" watchObservedRunningTime="2026-06-15 07:57:17.401685943 +0000 UTC m=+508.923174277" Jun 15 07:57:28.370678 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.370642 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 07:57:28.371070 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.370988 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:28.445690 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.445657 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ffd74cc5c-qmjrb"] Jun 15 07:57:28.445888 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.445866 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" podUID="79622a85-9909-424e-80b2-fe3e5a5a2a7a" containerName="manager" containerID="cri-o://2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32" gracePeriod=30 Jun 15 07:57:28.696434 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.696412 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:28.818509 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.818477 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79622a85-9909-424e-80b2-fe3e5a5a2a7a-webhook-cert\") pod \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " Jun 15 07:57:28.818660 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.818561 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kzn7f\" (UniqueName: \"kubernetes.io/projected/79622a85-9909-424e-80b2-fe3e5a5a2a7a-kube-api-access-kzn7f\") pod \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\" (UID: \"79622a85-9909-424e-80b2-fe3e5a5a2a7a\") " Jun 15 07:57:28.820679 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.820647 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/79622a85-9909-424e-80b2-fe3e5a5a2a7a-kube-api-access-kzn7f" (OuterVolumeSpecName: "kube-api-access-kzn7f") pod "79622a85-9909-424e-80b2-fe3e5a5a2a7a" (UID: "79622a85-9909-424e-80b2-fe3e5a5a2a7a"). InnerVolumeSpecName "kube-api-access-kzn7f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:57:28.820811 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.820682 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/79622a85-9909-424e-80b2-fe3e5a5a2a7a-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "79622a85-9909-424e-80b2-fe3e5a5a2a7a" (UID: "79622a85-9909-424e-80b2-fe3e5a5a2a7a"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:57:28.919179 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.919151 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/79622a85-9909-424e-80b2-fe3e5a5a2a7a-webhook-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:57:28.919179 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:28.919175 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kzn7f\" (UniqueName: \"kubernetes.io/projected/79622a85-9909-424e-80b2-fe3e5a5a2a7a-kube-api-access-kzn7f\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:57:29.419334 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.419301 2569 generic.go:356] "Generic (PLEG): container finished" podID="79622a85-9909-424e-80b2-fe3e5a5a2a7a" containerID="2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32" exitCode=0 Jun 15 07:57:29.419726 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.419344 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" Jun 15 07:57:29.419726 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.419378 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" event={"ID":"79622a85-9909-424e-80b2-fe3e5a5a2a7a","Type":"ContainerDied","Data":"2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32"} Jun 15 07:57:29.419726 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.419424 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6ffd74cc5c-qmjrb" event={"ID":"79622a85-9909-424e-80b2-fe3e5a5a2a7a","Type":"ContainerDied","Data":"3f84922691c5ab3c7b934aefc1cb9443946848b3014d89bf0a97852934c47a2b"} Jun 15 07:57:29.419726 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.419448 2569 scope.go:117] "RemoveContainer" containerID="2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32" Jun 15 07:57:29.428195 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.428179 2569 scope.go:117] "RemoveContainer" containerID="2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32" Jun 15 07:57:29.428445 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:57:29.428430 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32\": container with ID starting with 2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32 not found: ID does not exist" containerID="2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32" Jun 15 07:57:29.428513 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.428450 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32"} err="failed to get container status \"2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32\": rpc error: code = NotFound desc = could not find container \"2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32\": container with ID starting with 2c6edb9420381d2efb1fc841c66cede447fc4af72a84909c4083f75500fcae32 not found: ID does not exist" Jun 15 07:57:29.437489 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.437449 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-6ffd74cc5c-qmjrb"] Jun 15 07:57:29.443963 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:29.443943 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-6ffd74cc5c-qmjrb"] Jun 15 07:57:30.923160 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:30.923128 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="79622a85-9909-424e-80b2-fe3e5a5a2a7a" path="/var/lib/kubelet/pods/79622a85-9909-424e-80b2-fe3e5a5a2a7a/volumes" Jun 15 07:57:47.723534 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.723498 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-666df97d49-j9db5"] Jun 15 07:57:47.724046 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.723859 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="79622a85-9909-424e-80b2-fe3e5a5a2a7a" containerName="manager" Jun 15 07:57:47.724046 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.723881 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="79622a85-9909-424e-80b2-fe3e5a5a2a7a" containerName="manager" Jun 15 07:57:47.724046 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.723960 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="79622a85-9909-424e-80b2-fe3e5a5a2a7a" containerName="manager" Jun 15 07:57:47.727232 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.727213 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.729792 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.729772 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-7b2t9\"" Jun 15 07:57:47.729890 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.729773 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 15 07:57:47.738961 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.738939 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-666df97d49-j9db5"] Jun 15 07:57:47.889282 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.889251 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3b5628-4760-459c-a5cf-1d4eea82e966-openshift-service-ca\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.889432 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.889313 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hn8lr\" (UniqueName: \"kubernetes.io/projected/9d3b5628-4760-459c-a5cf-1d4eea82e966-kube-api-access-hn8lr\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.889432 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.889382 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d3b5628-4760-459c-a5cf-1d4eea82e966-maas-api-tls\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.990054 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.989973 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hn8lr\" (UniqueName: \"kubernetes.io/projected/9d3b5628-4760-459c-a5cf-1d4eea82e966-kube-api-access-hn8lr\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.990054 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.990019 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d3b5628-4760-459c-a5cf-1d4eea82e966-maas-api-tls\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.990233 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.990066 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3b5628-4760-459c-a5cf-1d4eea82e966-openshift-service-ca\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.990893 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.990860 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d3b5628-4760-459c-a5cf-1d4eea82e966-openshift-service-ca\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.992660 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.992636 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/9d3b5628-4760-459c-a5cf-1d4eea82e966-maas-api-tls\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:47.998991 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:47.998968 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hn8lr\" (UniqueName: \"kubernetes.io/projected/9d3b5628-4760-459c-a5cf-1d4eea82e966-kube-api-access-hn8lr\") pod \"maas-api-666df97d49-j9db5\" (UID: \"9d3b5628-4760-459c-a5cf-1d4eea82e966\") " pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:48.037798 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.037774 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:48.189113 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.189083 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-666df97d49-j9db5"] Jun 15 07:57:48.191226 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:57:48.191204 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d3b5628_4760_459c_a5cf_1d4eea82e966.slice/crio-7e42fe21af57a926861130896954100969e2efa3d01b607ae93fce2628bde56c WatchSource:0}: Error finding container 7e42fe21af57a926861130896954100969e2efa3d01b607ae93fce2628bde56c: Status 404 returned error can't find the container with id 7e42fe21af57a926861130896954100969e2efa3d01b607ae93fce2628bde56c Jun 15 07:57:48.241685 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.241616 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-tpz25"] Jun 15 07:57:48.246200 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.246181 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" Jun 15 07:57:48.248818 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.248802 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-h2hvt\"" Jun 15 07:57:48.248886 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.248848 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 07:57:48.253436 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.253417 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-tpz25"] Jun 15 07:57:48.394207 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.394164 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p75j9\" (UniqueName: \"kubernetes.io/projected/f251cd4d-ee40-4e12-8d14-4ca349376625-kube-api-access-p75j9\") pod \"payload-processing-699b6cd6c-tpz25\" (UID: \"f251cd4d-ee40-4e12-8d14-4ca349376625\") " pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" Jun 15 07:57:48.495010 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.494921 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p75j9\" (UniqueName: \"kubernetes.io/projected/f251cd4d-ee40-4e12-8d14-4ca349376625-kube-api-access-p75j9\") pod \"payload-processing-699b6cd6c-tpz25\" (UID: \"f251cd4d-ee40-4e12-8d14-4ca349376625\") " pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" Jun 15 07:57:48.504882 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.504856 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p75j9\" (UniqueName: \"kubernetes.io/projected/f251cd4d-ee40-4e12-8d14-4ca349376625-kube-api-access-p75j9\") pod \"payload-processing-699b6cd6c-tpz25\" (UID: \"f251cd4d-ee40-4e12-8d14-4ca349376625\") " pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" Jun 15 07:57:48.506813 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.506788 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-666df97d49-j9db5" event={"ID":"9d3b5628-4760-459c-a5cf-1d4eea82e966","Type":"ContainerStarted","Data":"7e42fe21af57a926861130896954100969e2efa3d01b607ae93fce2628bde56c"} Jun 15 07:57:48.558616 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.558586 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" Jun 15 07:57:48.687561 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:48.687536 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-tpz25"] Jun 15 07:57:48.690035 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:57:48.690009 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf251cd4d_ee40_4e12_8d14_4ca349376625.slice/crio-62eae17c43b82c0b44caf1ab86b0883c6e3749e99a65da05e9fdde030e2cf43e WatchSource:0}: Error finding container 62eae17c43b82c0b44caf1ab86b0883c6e3749e99a65da05e9fdde030e2cf43e: Status 404 returned error can't find the container with id 62eae17c43b82c0b44caf1ab86b0883c6e3749e99a65da05e9fdde030e2cf43e Jun 15 07:57:49.516151 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:49.516106 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" event={"ID":"f251cd4d-ee40-4e12-8d14-4ca349376625","Type":"ContainerStarted","Data":"62eae17c43b82c0b44caf1ab86b0883c6e3749e99a65da05e9fdde030e2cf43e"} Jun 15 07:57:50.958409 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:50.958388 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 15 07:57:51.527628 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:51.527591 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" event={"ID":"f251cd4d-ee40-4e12-8d14-4ca349376625","Type":"ContainerStarted","Data":"8a0670527bd519fc54c0b13783f359338c2f7bc8f66dcca88aac1cb688437861"} Jun 15 07:57:51.527993 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:51.527653 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" Jun 15 07:57:51.529024 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:51.529002 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-666df97d49-j9db5" event={"ID":"9d3b5628-4760-459c-a5cf-1d4eea82e966","Type":"ContainerStarted","Data":"75c633b3afc594db799da97accccd10e3d7d86b4e3694a7a9205000fa7339488"} Jun 15 07:57:51.529125 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:51.529112 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:51.545746 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:51.545697 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" podStartSLOduration=1.281629656 podStartE2EDuration="3.545681912s" totalImagesPullingTime="2.264052256s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:57:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:57:51.545286444 +0000 UTC m=+543.066774769" watchObservedRunningTime="2026-06-15 07:57:51.545681912 +0000 UTC m=+543.067170241" Jun 15 07:57:51.564172 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:51.564130 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-666df97d49-j9db5" podStartSLOduration=1.870475441 podStartE2EDuration="4.564116709s" totalImagesPullingTime="2.693641268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:57:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:57:51.563412776 +0000 UTC m=+543.084901128" watchObservedRunningTime="2026-06-15 07:57:51.564116709 +0000 UTC m=+543.085605036" Jun 15 07:57:57.539990 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:57.539963 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-666df97d49-j9db5" Jun 15 07:57:58.850316 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:58.850282 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:57:58.850791 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:57:58.850492 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" containerID="cri-o://fa1d79e9a25e5d2d5b507ee54b28f263aea149d2ee7cbc16fd4ca97fc0c81f2b" gracePeriod=30 Jun 15 07:58:00.579836 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:00.579740 2569 generic.go:356] "Generic (PLEG): container finished" podID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerID="fa1d79e9a25e5d2d5b507ee54b28f263aea149d2ee7cbc16fd4ca97fc0c81f2b" exitCode=143 Jun 15 07:58:00.579836 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:00.579794 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad","Type":"ContainerDied","Data":"fa1d79e9a25e5d2d5b507ee54b28f263aea149d2ee7cbc16fd4ca97fc0c81f2b"} Jun 15 07:58:00.893468 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:00.893432 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:00.987493 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:00.987443 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7nl7j\" (UniqueName: \"kubernetes.io/projected/c01c9ce9-c4ae-4786-8cc9-e3a2599eddad-kube-api-access-7nl7j\") pod \"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad\" (UID: \"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad\") " Jun 15 07:58:00.989439 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:00.989413 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01c9ce9-c4ae-4786-8cc9-e3a2599eddad-kube-api-access-7nl7j" (OuterVolumeSpecName: "kube-api-access-7nl7j") pod "c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" (UID: "c01c9ce9-c4ae-4786-8cc9-e3a2599eddad"). InnerVolumeSpecName "kube-api-access-7nl7j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:58:01.088422 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.088396 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7nl7j\" (UniqueName: \"kubernetes.io/projected/c01c9ce9-c4ae-4786-8cc9-e3a2599eddad-kube-api-access-7nl7j\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:58:01.585388 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.585361 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.585803 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.585395 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c01c9ce9-c4ae-4786-8cc9-e3a2599eddad","Type":"ContainerDied","Data":"80277050eac9b9623b693eb3ff401e5ccdb0fdf3bfd51721a93bccfa8c2256bc"} Jun 15 07:58:01.585803 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.585449 2569 scope.go:117] "RemoveContainer" containerID="fa1d79e9a25e5d2d5b507ee54b28f263aea149d2ee7cbc16fd4ca97fc0c81f2b" Jun 15 07:58:01.608624 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.608599 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:58:01.613336 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.613310 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:58:01.636943 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.636918 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:58:01.637255 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.637243 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" Jun 15 07:58:01.637298 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.637257 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" Jun 15 07:58:01.637332 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.637323 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" containerName="keycloak" Jun 15 07:58:01.641571 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.641556 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.644016 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.643997 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 15 07:58:01.644190 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.644167 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 15 07:58:01.644414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.644398 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 15 07:58:01.644483 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.644448 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 15 07:58:01.644551 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.644536 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-n57rd\"" Jun 15 07:58:01.652284 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.652264 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:58:01.692726 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.692696 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/806a0355-ec99-4a1e-b72d-8aea218c855a-test-realms\") pod \"maas-keycloak-0\" (UID: \"806a0355-ec99-4a1e-b72d-8aea218c855a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.692843 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.692747 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5q7q8\" (UniqueName: \"kubernetes.io/projected/806a0355-ec99-4a1e-b72d-8aea218c855a-kube-api-access-5q7q8\") pod \"maas-keycloak-0\" (UID: \"806a0355-ec99-4a1e-b72d-8aea218c855a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.793195 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.793162 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/806a0355-ec99-4a1e-b72d-8aea218c855a-test-realms\") pod \"maas-keycloak-0\" (UID: \"806a0355-ec99-4a1e-b72d-8aea218c855a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.793372 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.793217 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5q7q8\" (UniqueName: \"kubernetes.io/projected/806a0355-ec99-4a1e-b72d-8aea218c855a-kube-api-access-5q7q8\") pod \"maas-keycloak-0\" (UID: \"806a0355-ec99-4a1e-b72d-8aea218c855a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.793871 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.793849 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/806a0355-ec99-4a1e-b72d-8aea218c855a-test-realms\") pod \"maas-keycloak-0\" (UID: \"806a0355-ec99-4a1e-b72d-8aea218c855a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.802394 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.802374 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5q7q8\" (UniqueName: \"kubernetes.io/projected/806a0355-ec99-4a1e-b72d-8aea218c855a-kube-api-access-5q7q8\") pod \"maas-keycloak-0\" (UID: \"806a0355-ec99-4a1e-b72d-8aea218c855a\") " pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:01.951739 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:01.951707 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:02.086033 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.086002 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 15 07:58:02.089434 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:58:02.089409 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod806a0355_ec99_4a1e_b72d_8aea218c855a.slice/crio-4d192c858f20a6dde40c2fc40d5a8539056960e49f6e889201e333b6a7a087ed WatchSource:0}: Error finding container 4d192c858f20a6dde40c2fc40d5a8539056960e49f6e889201e333b6a7a087ed: Status 404 returned error can't find the container with id 4d192c858f20a6dde40c2fc40d5a8539056960e49f6e889201e333b6a7a087ed Jun 15 07:58:02.537615 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.537593 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-tpz25" Jun 15 07:58:02.593508 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.593450 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"806a0355-ec99-4a1e-b72d-8aea218c855a","Type":"ContainerStarted","Data":"7ac0eba92933aea43722f59144f976ec056fa3207fa159eabe241a7418d4ef73"} Jun 15 07:58:02.593942 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.593529 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"806a0355-ec99-4a1e-b72d-8aea218c855a","Type":"ContainerStarted","Data":"4d192c858f20a6dde40c2fc40d5a8539056960e49f6e889201e333b6a7a087ed"} Jun 15 07:58:02.612932 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.612883 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.21425393 podStartE2EDuration="1.612868404s" totalImagesPullingTime="398.614474ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:58:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:58:02.612385611 +0000 UTC m=+554.133873938" watchObservedRunningTime="2026-06-15 07:58:02.612868404 +0000 UTC m=+554.134356730" Jun 15 07:58:02.924295 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.924251 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c01c9ce9-c4ae-4786-8cc9-e3a2599eddad" path="/var/lib/kubelet/pods/c01c9ce9-c4ae-4786-8cc9-e3a2599eddad/volumes" Jun 15 07:58:02.952478 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.952423 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:02.954052 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:02.954021 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:03.952255 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:03.952199 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:04.952398 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:04.952345 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:05.952498 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:05.952427 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:06.952431 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:06.952382 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:07.952781 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:07.952731 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:08.953079 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:08.953028 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:09.953039 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:09.952992 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:10.952717 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:10.952675 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:11.952579 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:11.952531 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:11.952913 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:11.952877 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:12.952636 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:12.952582 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:13.952312 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:13.952268 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:14.952201 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:14.952161 2569 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="Get \"http://10.133.0.36:9000/health/started\": dial tcp 10.133.0.36:9000: connect: connection refused" Jun 15 07:58:16.052628 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:16.052579 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:16.070421 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:16.070354 2569 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="806a0355-ec99-4a1e-b72d-8aea218c855a" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 15 07:58:26.060278 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:26.060246 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 15 07:58:36.816629 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:36.816588 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fdccc9df9-hxbd4"] Jun 15 07:58:36.819521 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:36.819500 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:36.821974 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:36.821951 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 15 07:58:36.828366 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:36.828343 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fdccc9df9-hxbd4"] Jun 15 07:58:36.924673 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:36.924645 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97e8d548-af35-4628-be66-9289da80e06c-tls-cert\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:36.924832 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:36.924698 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/97e8d548-af35-4628-be66-9289da80e06c-oidc-ca\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:36.924832 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:36.924715 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k76fq\" (UniqueName: \"kubernetes.io/projected/97e8d548-af35-4628-be66-9289da80e06c-kube-api-access-k76fq\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.025575 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.025543 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/97e8d548-af35-4628-be66-9289da80e06c-oidc-ca\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.025771 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.025576 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k76fq\" (UniqueName: \"kubernetes.io/projected/97e8d548-af35-4628-be66-9289da80e06c-kube-api-access-k76fq\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.025771 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.025749 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97e8d548-af35-4628-be66-9289da80e06c-tls-cert\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.026242 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.026218 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/97e8d548-af35-4628-be66-9289da80e06c-oidc-ca\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.028194 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.028172 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97e8d548-af35-4628-be66-9289da80e06c-tls-cert\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.034304 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.034282 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k76fq\" (UniqueName: \"kubernetes.io/projected/97e8d548-af35-4628-be66-9289da80e06c-kube-api-access-k76fq\") pod \"authorino-7fdccc9df9-hxbd4\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.129148 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.129084 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 07:58:37.259620 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.259592 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fdccc9df9-hxbd4"] Jun 15 07:58:37.262113 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:58:37.262079 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97e8d548_af35_4628_be66_9289da80e06c.slice/crio-49edd03dc81e8f6f3d95eeb00614fb1691c39dfbae902835fd192f1697b012f0 WatchSource:0}: Error finding container 49edd03dc81e8f6f3d95eeb00614fb1691c39dfbae902835fd192f1697b012f0: Status 404 returned error can't find the container with id 49edd03dc81e8f6f3d95eeb00614fb1691c39dfbae902835fd192f1697b012f0 Jun 15 07:58:37.800630 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.800594 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" event={"ID":"97e8d548-af35-4628-be66-9289da80e06c","Type":"ContainerStarted","Data":"22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa"} Jun 15 07:58:37.800795 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.800635 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" event={"ID":"97e8d548-af35-4628-be66-9289da80e06c","Type":"ContainerStarted","Data":"49edd03dc81e8f6f3d95eeb00614fb1691c39dfbae902835fd192f1697b012f0"} Jun 15 07:58:37.818661 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.818615 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" podStartSLOduration=1.420621638 podStartE2EDuration="1.818600852s" totalImagesPullingTime="397.979214ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:58:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:58:37.817036871 +0000 UTC m=+589.338525199" watchObservedRunningTime="2026-06-15 07:58:37.818600852 +0000 UTC m=+589.340089217" Jun 15 07:58:37.848906 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.848876 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d46dd8f99-fjbq4"] Jun 15 07:58:37.849086 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:37.849042 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" podUID="5d900d16-0027-4fdf-a0a5-638bb2cd36e8" containerName="authorino" containerID="cri-o://c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a" gracePeriod=30 Jun 15 07:58:38.098897 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.098870 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:58:38.236025 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.235947 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-tls-cert\") pod \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " Jun 15 07:58:38.236167 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.236046 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gszf2\" (UniqueName: \"kubernetes.io/projected/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-kube-api-access-gszf2\") pod \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\" (UID: \"5d900d16-0027-4fdf-a0a5-638bb2cd36e8\") " Jun 15 07:58:38.237988 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.237961 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-kube-api-access-gszf2" (OuterVolumeSpecName: "kube-api-access-gszf2") pod "5d900d16-0027-4fdf-a0a5-638bb2cd36e8" (UID: "5d900d16-0027-4fdf-a0a5-638bb2cd36e8"). InnerVolumeSpecName "kube-api-access-gszf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 07:58:38.245857 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.245833 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "5d900d16-0027-4fdf-a0a5-638bb2cd36e8" (UID: "5d900d16-0027-4fdf-a0a5-638bb2cd36e8"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 07:58:38.337622 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.337592 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gszf2\" (UniqueName: \"kubernetes.io/projected/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-kube-api-access-gszf2\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:58:38.337622 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.337616 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/5d900d16-0027-4fdf-a0a5-638bb2cd36e8-tls-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 07:58:38.806654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.806612 2569 generic.go:356] "Generic (PLEG): container finished" podID="5d900d16-0027-4fdf-a0a5-638bb2cd36e8" containerID="c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a" exitCode=0 Jun 15 07:58:38.806654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.806655 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" Jun 15 07:58:38.806880 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.806694 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" event={"ID":"5d900d16-0027-4fdf-a0a5-638bb2cd36e8","Type":"ContainerDied","Data":"c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a"} Jun 15 07:58:38.806880 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.806750 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d46dd8f99-fjbq4" event={"ID":"5d900d16-0027-4fdf-a0a5-638bb2cd36e8","Type":"ContainerDied","Data":"a213f8454e6a59b160df478a0ee97c1fb02012870c205d69ace436caf131824f"} Jun 15 07:58:38.806880 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.806779 2569 scope.go:117] "RemoveContainer" containerID="c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a" Jun 15 07:58:38.815612 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.815601 2569 scope.go:117] "RemoveContainer" containerID="c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a" Jun 15 07:58:38.815871 ip-10-0-143-10 kubenswrapper[2569]: E0615 07:58:38.815854 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a\": container with ID starting with c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a not found: ID does not exist" containerID="c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a" Jun 15 07:58:38.815919 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.815879 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a"} err="failed to get container status \"c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a\": rpc error: code = NotFound desc = could not find container \"c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a\": container with ID starting with c809312885ed97175781626620d06b3223a5b4381b0c63b5ea96dd9eebc17d7a not found: ID does not exist" Jun 15 07:58:38.829112 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.829089 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d46dd8f99-fjbq4"] Jun 15 07:58:38.836615 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.836596 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d46dd8f99-fjbq4"] Jun 15 07:58:38.924157 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:38.924120 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5d900d16-0027-4fdf-a0a5-638bb2cd36e8" path="/var/lib/kubelet/pods/5d900d16-0027-4fdf-a0a5-638bb2cd36e8/volumes" Jun 15 07:58:44.171105 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.171068 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5"] Jun 15 07:58:44.171568 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.171410 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5d900d16-0027-4fdf-a0a5-638bb2cd36e8" containerName="authorino" Jun 15 07:58:44.171568 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.171421 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="5d900d16-0027-4fdf-a0a5-638bb2cd36e8" containerName="authorino" Jun 15 07:58:44.171568 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.171510 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="5d900d16-0027-4fdf-a0a5-638bb2cd36e8" containerName="authorino" Jun 15 07:58:44.175856 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.175825 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.179823 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.179797 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-xlbcc\"" Jun 15 07:58:44.180053 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.180036 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 15 07:58:44.180122 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.180099 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 15 07:58:44.180184 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.180165 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 15 07:58:44.185694 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.185675 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5"] Jun 15 07:58:44.290302 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.290272 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.290493 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.290308 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.290493 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.290329 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.290493 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.290440 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28sj2\" (UniqueName: \"kubernetes.io/projected/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-kube-api-access-28sj2\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.290654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.290506 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.290654 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.290542 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.391678 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.391649 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28sj2\" (UniqueName: \"kubernetes.io/projected/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-kube-api-access-28sj2\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.391828 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.391697 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.391828 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.391714 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.391828 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.391751 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.391828 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.391770 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.391828 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.391785 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.392111 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.392090 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.392144 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.392106 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.392177 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.392158 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.394103 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.394081 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.394357 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.394337 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.400972 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.400949 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-28sj2\" (UniqueName: \"kubernetes.io/projected/eb86e5f0-ed62-4d59-9253-22d4a6c7c71f-kube-api-access-28sj2\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5\" (UID: \"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.487549 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.487488 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" Jun 15 07:58:44.633836 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.633810 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5"] Jun 15 07:58:44.637313 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:58:44.637281 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb86e5f0_ed62_4d59_9253_22d4a6c7c71f.slice/crio-610834d3516a70a75c80b6dd7a1ea862ddf3f52fe798adb5d21f0cc76ac57331 WatchSource:0}: Error finding container 610834d3516a70a75c80b6dd7a1ea862ddf3f52fe798adb5d21f0cc76ac57331: Status 404 returned error can't find the container with id 610834d3516a70a75c80b6dd7a1ea862ddf3f52fe798adb5d21f0cc76ac57331 Jun 15 07:58:44.839383 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:44.839296 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" event={"ID":"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f","Type":"ContainerStarted","Data":"610834d3516a70a75c80b6dd7a1ea862ddf3f52fe798adb5d21f0cc76ac57331"} Jun 15 07:58:47.959368 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:47.959331 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r"] Jun 15 07:58:47.977771 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:47.977739 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r"] Jun 15 07:58:47.977970 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:47.977866 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:47.981076 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:47.981048 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 15 07:58:48.023251 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.023217 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.023383 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.023261 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.023383 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.023278 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6vp45\" (UniqueName: \"kubernetes.io/projected/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-kube-api-access-6vp45\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.023383 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.023334 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.023530 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.023511 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.023578 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.023553 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.125048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.124619 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.125048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.124685 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.125048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.124731 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.125048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.124761 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.125048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.124787 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6vp45\" (UniqueName: \"kubernetes.io/projected/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-kube-api-access-6vp45\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.125048 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.124819 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.126578 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.125809 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.126578 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.126045 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.126578 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.126266 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.128317 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.128280 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.128666 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.128643 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.134926 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.134907 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6vp45\" (UniqueName: \"kubernetes.io/projected/1fb9a217-0c89-48e2-9fea-c12c34eb22b3-kube-api-access-6vp45\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-q4z2r\" (UID: \"1fb9a217-0c89-48e2-9fea-c12c34eb22b3\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.291414 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.291302 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 07:58:48.691887 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.691861 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r"] Jun 15 07:58:48.694310 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:58:48.694289 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1fb9a217_0c89_48e2_9fea_c12c34eb22b3.slice/crio-1257030fcd0d27f3eab76e1545f73eaeeb01b61079bea59ba94b4cb2e3bf94f4 WatchSource:0}: Error finding container 1257030fcd0d27f3eab76e1545f73eaeeb01b61079bea59ba94b4cb2e3bf94f4: Status 404 returned error can't find the container with id 1257030fcd0d27f3eab76e1545f73eaeeb01b61079bea59ba94b4cb2e3bf94f4 Jun 15 07:58:48.866790 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.866436 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" event={"ID":"1fb9a217-0c89-48e2-9fea-c12c34eb22b3","Type":"ContainerStarted","Data":"228a3ae4778bdca3b6495ad11bf37e0e17ca5dea29854c6570ace1b4c942e159"} Jun 15 07:58:48.866790 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.866522 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" event={"ID":"1fb9a217-0c89-48e2-9fea-c12c34eb22b3","Type":"ContainerStarted","Data":"1257030fcd0d27f3eab76e1545f73eaeeb01b61079bea59ba94b4cb2e3bf94f4"} Jun 15 07:58:48.868595 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.868536 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5" event={"ID":"eb86e5f0-ed62-4d59-9253-22d4a6c7c71f","Type":"ContainerStarted","Data":"31707970a70a8141d8ce3de969d0dcc26a6b1c881dc1dbcbd70cdc0dc9a74685"} Jun 15 07:58:48.944087 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.943923 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:58:48.945232 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:58:48.945211 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 07:59:09.366430 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.366352 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt"] Jun 15 07:59:09.369598 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.369571 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.372123 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.372105 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jun 15 07:59:09.379623 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.379600 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt"] Jun 15 07:59:09.417978 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.417955 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.418085 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.417991 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-np562\" (UniqueName: \"kubernetes.io/projected/61e696a6-cf01-4417-9158-38b2ea9918a9-kube-api-access-np562\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.418085 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.418023 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.418085 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.418051 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.418085 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.418075 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.418215 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.418112 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61e696a6-cf01-4417-9158-38b2ea9918a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519112 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519083 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519112 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519122 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-np562\" (UniqueName: \"kubernetes.io/projected/61e696a6-cf01-4417-9158-38b2ea9918a9-kube-api-access-np562\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519353 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519146 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519353 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519175 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519353 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519209 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519353 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519253 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61e696a6-cf01-4417-9158-38b2ea9918a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519670 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519648 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519715 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519678 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.519757 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.519717 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.521758 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.521732 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/61e696a6-cf01-4417-9158-38b2ea9918a9-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.521865 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.521849 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/61e696a6-cf01-4417-9158-38b2ea9918a9-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.530701 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.530669 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-np562\" (UniqueName: \"kubernetes.io/projected/61e696a6-cf01-4417-9158-38b2ea9918a9-kube-api-access-np562\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt\" (UID: \"61e696a6-cf01-4417-9158-38b2ea9918a9\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.681546 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.681513 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:09.811502 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.811478 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt"] Jun 15 07:59:09.813894 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:59:09.813870 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61e696a6_cf01_4417_9158_38b2ea9918a9.slice/crio-a3966a4c87f1b7b4534213d8f86034170780bc8165869154832c5dc937d979e6 WatchSource:0}: Error finding container a3966a4c87f1b7b4534213d8f86034170780bc8165869154832c5dc937d979e6: Status 404 returned error can't find the container with id a3966a4c87f1b7b4534213d8f86034170780bc8165869154832c5dc937d979e6 Jun 15 07:59:09.965229 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.965136 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" event={"ID":"61e696a6-cf01-4417-9158-38b2ea9918a9","Type":"ContainerStarted","Data":"55ee2c6dac04e8ac4c959c0c2a5f3a8697ad6d4a0d734d0998dbac81d28a03e1"} Jun 15 07:59:09.965229 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:09.965193 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" event={"ID":"61e696a6-cf01-4417-9158-38b2ea9918a9","Type":"ContainerStarted","Data":"a3966a4c87f1b7b4534213d8f86034170780bc8165869154832c5dc937d979e6"} Jun 15 07:59:11.975987 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:11.975952 2569 generic.go:356] "Generic (PLEG): container finished" podID="61e696a6-cf01-4417-9158-38b2ea9918a9" containerID="55ee2c6dac04e8ac4c959c0c2a5f3a8697ad6d4a0d734d0998dbac81d28a03e1" exitCode=0 Jun 15 07:59:11.976345 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:11.976013 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" event={"ID":"61e696a6-cf01-4417-9158-38b2ea9918a9","Type":"ContainerDied","Data":"55ee2c6dac04e8ac4c959c0c2a5f3a8697ad6d4a0d734d0998dbac81d28a03e1"} Jun 15 07:59:13.986412 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:13.986380 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" event={"ID":"61e696a6-cf01-4417-9158-38b2ea9918a9","Type":"ContainerStarted","Data":"0b55eebb3828cba73f16376b91bcb2319eb0dae242add5841ab0bca4d9630f8e"} Jun 15 07:59:14.007006 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.006956 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" podStartSLOduration=2.568143511 podStartE2EDuration="5.006942044s" totalImagesPullingTime="1.026205133s" totalInitContainerRuntime="1.4125934s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:59:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 07:59:14.005372874 +0000 UTC m=+625.526861224" watchObservedRunningTime="2026-06-15 07:59:14.006942044 +0000 UTC m=+625.528430370" Jun 15 07:59:14.544440 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.544406 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr"] Jun 15 07:59:14.547125 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.547106 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.549621 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.549603 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 15 07:59:14.562449 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.562420 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr"] Jun 15 07:59:14.670009 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.669969 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.670160 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.670068 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.670160 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.670106 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9l44f\" (UniqueName: \"kubernetes.io/projected/b683be11-fdc3-44a3-8c94-11346aafbff3-kube-api-access-9l44f\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.670257 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.670151 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b683be11-fdc3-44a3-8c94-11346aafbff3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.670257 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.670178 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.670257 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.670199 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.772329 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.772302 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9l44f\" (UniqueName: \"kubernetes.io/projected/b683be11-fdc3-44a3-8c94-11346aafbff3-kube-api-access-9l44f\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.772515 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.772340 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b683be11-fdc3-44a3-8c94-11346aafbff3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.772515 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.772358 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.772515 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.772496 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.772701 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.772592 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.772766 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.772721 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.772851 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.772831 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.773026 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.773002 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.773104 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.773042 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.774836 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.774812 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b683be11-fdc3-44a3-8c94-11346aafbff3-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.774995 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.774978 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b683be11-fdc3-44a3-8c94-11346aafbff3-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.781209 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.781186 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9l44f\" (UniqueName: \"kubernetes.io/projected/b683be11-fdc3-44a3-8c94-11346aafbff3-kube-api-access-9l44f\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-97kkr\" (UID: \"b683be11-fdc3-44a3-8c94-11346aafbff3\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.859616 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.859562 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 07:59:14.992386 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:14.992355 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr"] Jun 15 07:59:14.995471 ip-10-0-143-10 kubenswrapper[2569]: W0615 07:59:14.995433 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb683be11_fdc3_44a3_8c94_11346aafbff3.slice/crio-74c189759e2c6a71a734daccf6240b528e125739206839e606802e023164e44e WatchSource:0}: Error finding container 74c189759e2c6a71a734daccf6240b528e125739206839e606802e023164e44e: Status 404 returned error can't find the container with id 74c189759e2c6a71a734daccf6240b528e125739206839e606802e023164e44e Jun 15 07:59:15.999294 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:15.999260 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" event={"ID":"b683be11-fdc3-44a3-8c94-11346aafbff3","Type":"ContainerStarted","Data":"ccff33e37560acf9f372e7d175fc4f3898a6f54d41c22c8a860ca35767d116d8"} Jun 15 07:59:15.999667 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:15.999316 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" event={"ID":"b683be11-fdc3-44a3-8c94-11346aafbff3","Type":"ContainerStarted","Data":"74c189759e2c6a71a734daccf6240b528e125739206839e606802e023164e44e"} Jun 15 07:59:19.682564 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:19.682512 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:19.683005 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:19.682601 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:19.695191 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:19.695164 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 07:59:20.028649 ip-10-0-143-10 kubenswrapper[2569]: I0615 07:59:20.028572 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt" Jun 15 08:00:21.324819 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:21.324781 2569 generic.go:356] "Generic (PLEG): container finished" podID="b683be11-fdc3-44a3-8c94-11346aafbff3" containerID="ccff33e37560acf9f372e7d175fc4f3898a6f54d41c22c8a860ca35767d116d8" exitCode=0 Jun 15 08:00:21.325229 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:21.324853 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" event={"ID":"b683be11-fdc3-44a3-8c94-11346aafbff3","Type":"ContainerDied","Data":"ccff33e37560acf9f372e7d175fc4f3898a6f54d41c22c8a860ca35767d116d8"} Jun 15 08:00:21.325542 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:21.325527 2569 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 15 08:00:22.331931 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:22.331898 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" event={"ID":"b683be11-fdc3-44a3-8c94-11346aafbff3","Type":"ContainerStarted","Data":"efca2d93d4d5a909e7ae774e8d92258d85b535c66935e76a582cc2d0f95e3428"} Jun 15 08:00:22.352223 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:22.352174 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" podStartSLOduration=2.597036349 podStartE2EDuration="1m8.352159176s" totalImagesPullingTime="355.022023ms" totalInitContainerRuntime="1m5.400100804s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:59:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:00:22.351516357 +0000 UTC m=+693.873004686" watchObservedRunningTime="2026-06-15 08:00:22.352159176 +0000 UTC m=+693.873647501" Jun 15 08:00:24.860643 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:24.860608 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 08:00:24.861105 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:24.860690 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 08:00:24.873212 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:24.873184 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 08:00:25.357750 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:25.357724 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-97kkr" Jun 15 08:00:35.134713 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.134674 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-786b4ff79d-vb859"] Jun 15 08:00:35.138084 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.138068 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.150884 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.150856 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786b4ff79d-vb859"] Jun 15 08:00:35.211255 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.211223 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-tls-cert\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.211255 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.211263 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t8nlz\" (UniqueName: \"kubernetes.io/projected/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-kube-api-access-t8nlz\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.211521 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.211403 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-oidc-ca\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.312557 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.312523 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-tls-cert\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.312557 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.312560 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t8nlz\" (UniqueName: \"kubernetes.io/projected/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-kube-api-access-t8nlz\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.312762 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.312643 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-oidc-ca\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.313252 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.313232 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-oidc-ca\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.315064 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.315038 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-tls-cert\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.326662 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.326631 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t8nlz\" (UniqueName: \"kubernetes.io/projected/0e3d26e8-5a7c-4775-85b1-6a74c0023b36-kube-api-access-t8nlz\") pod \"authorino-786b4ff79d-vb859\" (UID: \"0e3d26e8-5a7c-4775-85b1-6a74c0023b36\") " pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.401573 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.401540 2569 generic.go:356] "Generic (PLEG): container finished" podID="1fb9a217-0c89-48e2-9fea-c12c34eb22b3" containerID="228a3ae4778bdca3b6495ad11bf37e0e17ca5dea29854c6570ace1b4c942e159" exitCode=0 Jun 15 08:00:35.401763 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.401617 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" event={"ID":"1fb9a217-0c89-48e2-9fea-c12c34eb22b3","Type":"ContainerDied","Data":"228a3ae4778bdca3b6495ad11bf37e0e17ca5dea29854c6570ace1b4c942e159"} Jun 15 08:00:35.447346 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.447311 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-786b4ff79d-vb859" Jun 15 08:00:35.592346 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:35.592322 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-786b4ff79d-vb859"] Jun 15 08:00:35.594637 ip-10-0-143-10 kubenswrapper[2569]: W0615 08:00:35.594602 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0e3d26e8_5a7c_4775_85b1_6a74c0023b36.slice/crio-519e0e52e0899771207db374607d5cc097c37c5114b85f44f13c397d17ad8d0d WatchSource:0}: Error finding container 519e0e52e0899771207db374607d5cc097c37c5114b85f44f13c397d17ad8d0d: Status 404 returned error can't find the container with id 519e0e52e0899771207db374607d5cc097c37c5114b85f44f13c397d17ad8d0d Jun 15 08:00:36.408540 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.408495 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" event={"ID":"1fb9a217-0c89-48e2-9fea-c12c34eb22b3","Type":"ContainerStarted","Data":"13c43954a6a973171b419561c7e40f1ec38188d0ad42adef4452d1368d25f6f7"} Jun 15 08:00:36.410068 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.410045 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786b4ff79d-vb859" event={"ID":"0e3d26e8-5a7c-4775-85b1-6a74c0023b36","Type":"ContainerStarted","Data":"93d8a7ce184666a80bd389a377ede6d38c40becf8fa2d832bd0246666d97acfa"} Jun 15 08:00:36.410068 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.410074 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-786b4ff79d-vb859" event={"ID":"0e3d26e8-5a7c-4775-85b1-6a74c0023b36","Type":"ContainerStarted","Data":"519e0e52e0899771207db374607d5cc097c37c5114b85f44f13c397d17ad8d0d"} Jun 15 08:00:36.433389 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.433342 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" podStartSLOduration=3.5323579929999998 podStartE2EDuration="1m49.433329709s" totalImagesPullingTime="216.388481ms" totalInitContainerRuntime="1m45.684583235s" isStatefulPod=false podCreationTimestamp="2026-06-15 07:58:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:00:36.433188637 +0000 UTC m=+707.954676963" watchObservedRunningTime="2026-06-15 08:00:36.433329709 +0000 UTC m=+707.954818036" Jun 15 08:00:36.458072 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.458013 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-786b4ff79d-vb859" podStartSLOduration=0.837169897 podStartE2EDuration="1.457996244s" totalImagesPullingTime="620.826347ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:00:36.456770657 +0000 UTC m=+707.978258991" watchObservedRunningTime="2026-06-15 08:00:36.457996244 +0000 UTC m=+707.979484569" Jun 15 08:00:36.493989 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.493804 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fdccc9df9-hxbd4"] Jun 15 08:00:36.494153 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.494043 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" podUID="97e8d548-af35-4628-be66-9289da80e06c" containerName="authorino" containerID="cri-o://22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa" gracePeriod=30 Jun 15 08:00:36.775018 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.774976 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 08:00:36.832184 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.832151 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97e8d548-af35-4628-be66-9289da80e06c-tls-cert\") pod \"97e8d548-af35-4628-be66-9289da80e06c\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " Jun 15 08:00:36.832353 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.832204 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k76fq\" (UniqueName: \"kubernetes.io/projected/97e8d548-af35-4628-be66-9289da80e06c-kube-api-access-k76fq\") pod \"97e8d548-af35-4628-be66-9289da80e06c\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " Jun 15 08:00:36.832409 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.832359 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/97e8d548-af35-4628-be66-9289da80e06c-oidc-ca\") pod \"97e8d548-af35-4628-be66-9289da80e06c\" (UID: \"97e8d548-af35-4628-be66-9289da80e06c\") " Jun 15 08:00:36.834287 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.834249 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97e8d548-af35-4628-be66-9289da80e06c-kube-api-access-k76fq" (OuterVolumeSpecName: "kube-api-access-k76fq") pod "97e8d548-af35-4628-be66-9289da80e06c" (UID: "97e8d548-af35-4628-be66-9289da80e06c"). InnerVolumeSpecName "kube-api-access-k76fq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:00:36.838236 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.838202 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/97e8d548-af35-4628-be66-9289da80e06c-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "97e8d548-af35-4628-be66-9289da80e06c" (UID: "97e8d548-af35-4628-be66-9289da80e06c"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 15 08:00:36.844492 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.844429 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/97e8d548-af35-4628-be66-9289da80e06c-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "97e8d548-af35-4628-be66-9289da80e06c" (UID: "97e8d548-af35-4628-be66-9289da80e06c"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:00:36.933605 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.933519 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k76fq\" (UniqueName: \"kubernetes.io/projected/97e8d548-af35-4628-be66-9289da80e06c-kube-api-access-k76fq\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 08:00:36.933605 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.933547 2569 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/97e8d548-af35-4628-be66-9289da80e06c-oidc-ca\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 08:00:36.933605 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:36.933561 2569 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/97e8d548-af35-4628-be66-9289da80e06c-tls-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 08:00:37.415987 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.415953 2569 generic.go:356] "Generic (PLEG): container finished" podID="97e8d548-af35-4628-be66-9289da80e06c" containerID="22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa" exitCode=0 Jun 15 08:00:37.416412 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.416001 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" Jun 15 08:00:37.416412 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.416037 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" event={"ID":"97e8d548-af35-4628-be66-9289da80e06c","Type":"ContainerDied","Data":"22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa"} Jun 15 08:00:37.416412 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.416080 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fdccc9df9-hxbd4" event={"ID":"97e8d548-af35-4628-be66-9289da80e06c","Type":"ContainerDied","Data":"49edd03dc81e8f6f3d95eeb00614fb1691c39dfbae902835fd192f1697b012f0"} Jun 15 08:00:37.416412 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.416102 2569 scope.go:117] "RemoveContainer" containerID="22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa" Jun 15 08:00:37.425235 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.425218 2569 scope.go:117] "RemoveContainer" containerID="22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa" Jun 15 08:00:37.425505 ip-10-0-143-10 kubenswrapper[2569]: E0615 08:00:37.425484 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa\": container with ID starting with 22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa not found: ID does not exist" containerID="22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa" Jun 15 08:00:37.425601 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.425511 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa"} err="failed to get container status \"22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa\": rpc error: code = NotFound desc = could not find container \"22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa\": container with ID starting with 22ab4e0cce264909675b32dd440552e8ec4a4b0c7c54476d77627be5591923aa not found: ID does not exist" Jun 15 08:00:37.435501 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.435474 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7fdccc9df9-hxbd4"] Jun 15 08:00:37.438433 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:37.438407 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7fdccc9df9-hxbd4"] Jun 15 08:00:38.292149 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:38.292115 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 08:00:38.292335 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:38.292183 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 08:00:38.304947 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:38.304924 2569 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 08:00:38.433779 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:38.433747 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-q4z2r" Jun 15 08:00:38.928923 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:00:38.928886 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97e8d548-af35-4628-be66-9289da80e06c" path="/var/lib/kubelet/pods/97e8d548-af35-4628-be66-9289da80e06c/volumes" Jun 15 08:02:07.810588 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:07.810490 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f7d746c6-wxq2v"] Jun 15 08:02:07.811113 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:07.810720 2569 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" podUID="3a71e675-b522-4e4f-85fa-a88c1d9e435b" containerName="manager" containerID="cri-o://b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45" gracePeriod=30 Jun 15 08:02:08.061397 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.061332 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 08:02:08.173861 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.173822 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r5qhf\" (UniqueName: \"kubernetes.io/projected/3a71e675-b522-4e4f-85fa-a88c1d9e435b-kube-api-access-r5qhf\") pod \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " Jun 15 08:02:08.174035 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.173916 2569 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a71e675-b522-4e4f-85fa-a88c1d9e435b-webhook-cert\") pod \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\" (UID: \"3a71e675-b522-4e4f-85fa-a88c1d9e435b\") " Jun 15 08:02:08.175882 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.175840 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a71e675-b522-4e4f-85fa-a88c1d9e435b-kube-api-access-r5qhf" (OuterVolumeSpecName: "kube-api-access-r5qhf") pod "3a71e675-b522-4e4f-85fa-a88c1d9e435b" (UID: "3a71e675-b522-4e4f-85fa-a88c1d9e435b"). InnerVolumeSpecName "kube-api-access-r5qhf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 15 08:02:08.175993 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.175843 2569 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3a71e675-b522-4e4f-85fa-a88c1d9e435b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3a71e675-b522-4e4f-85fa-a88c1d9e435b" (UID: "3a71e675-b522-4e4f-85fa-a88c1d9e435b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 15 08:02:08.275268 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.275239 2569 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3a71e675-b522-4e4f-85fa-a88c1d9e435b-webhook-cert\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 08:02:08.275268 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.275265 2569 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r5qhf\" (UniqueName: \"kubernetes.io/projected/3a71e675-b522-4e4f-85fa-a88c1d9e435b-kube-api-access-r5qhf\") on node \"ip-10-0-143-10.ec2.internal\" DevicePath \"\"" Jun 15 08:02:08.859349 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.859318 2569 generic.go:356] "Generic (PLEG): container finished" podID="3a71e675-b522-4e4f-85fa-a88c1d9e435b" containerID="b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45" exitCode=0 Jun 15 08:02:08.859787 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.859372 2569 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" Jun 15 08:02:08.859787 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.859411 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" event={"ID":"3a71e675-b522-4e4f-85fa-a88c1d9e435b","Type":"ContainerDied","Data":"b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45"} Jun 15 08:02:08.859787 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.859475 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7d746c6-wxq2v" event={"ID":"3a71e675-b522-4e4f-85fa-a88c1d9e435b","Type":"ContainerDied","Data":"42bdd5f25c85a8859408dfce75240b6405d8c01a7bce72c7ecc7ab5564a8da0f"} Jun 15 08:02:08.859787 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.859502 2569 scope.go:117] "RemoveContainer" containerID="b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45" Jun 15 08:02:08.868982 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.868966 2569 scope.go:117] "RemoveContainer" containerID="b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45" Jun 15 08:02:08.869226 ip-10-0-143-10 kubenswrapper[2569]: E0615 08:02:08.869207 2569 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45\": container with ID starting with b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45 not found: ID does not exist" containerID="b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45" Jun 15 08:02:08.869287 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.869231 2569 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45"} err="failed to get container status \"b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45\": rpc error: code = NotFound desc = could not find container \"b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45\": container with ID starting with b191b6845a688ec139a29cd754e38342825d189a619c13f0b2e3c78efe925a45 not found: ID does not exist" Jun 15 08:02:08.883323 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.883298 2569 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-84f7d746c6-wxq2v"] Jun 15 08:02:08.888243 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.888211 2569 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-84f7d746c6-wxq2v"] Jun 15 08:02:08.925121 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:08.925090 2569 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a71e675-b522-4e4f-85fa-a88c1d9e435b" path="/var/lib/kubelet/pods/3a71e675-b522-4e4f-85fa-a88c1d9e435b/volumes" Jun 15 08:02:09.713332 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.713300 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-84f7d746c6-ff9sj"] Jun 15 08:02:09.713735 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.713721 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97e8d548-af35-4628-be66-9289da80e06c" containerName="authorino" Jun 15 08:02:09.713785 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.713739 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="97e8d548-af35-4628-be66-9289da80e06c" containerName="authorino" Jun 15 08:02:09.713785 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.713757 2569 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a71e675-b522-4e4f-85fa-a88c1d9e435b" containerName="manager" Jun 15 08:02:09.713785 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.713762 2569 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a71e675-b522-4e4f-85fa-a88c1d9e435b" containerName="manager" Jun 15 08:02:09.713875 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.713836 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="97e8d548-af35-4628-be66-9289da80e06c" containerName="authorino" Jun 15 08:02:09.713875 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.713852 2569 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a71e675-b522-4e4f-85fa-a88c1d9e435b" containerName="manager" Jun 15 08:02:09.717966 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.717948 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:09.721608 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.721587 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 15 08:02:09.721736 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.721670 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 15 08:02:09.721736 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.721688 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-zlv2m\"" Jun 15 08:02:09.726792 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.726769 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7d746c6-ff9sj"] Jun 15 08:02:09.789580 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.789552 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cfc1a05-2f67-4940-8901-0a420b0b2e43-webhook-cert\") pod \"maas-controller-84f7d746c6-ff9sj\" (UID: \"8cfc1a05-2f67-4940-8901-0a420b0b2e43\") " pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:09.789712 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.789628 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zh942\" (UniqueName: \"kubernetes.io/projected/8cfc1a05-2f67-4940-8901-0a420b0b2e43-kube-api-access-zh942\") pod \"maas-controller-84f7d746c6-ff9sj\" (UID: \"8cfc1a05-2f67-4940-8901-0a420b0b2e43\") " pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:09.890941 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.890914 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cfc1a05-2f67-4940-8901-0a420b0b2e43-webhook-cert\") pod \"maas-controller-84f7d746c6-ff9sj\" (UID: \"8cfc1a05-2f67-4940-8901-0a420b0b2e43\") " pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:09.891274 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.890991 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zh942\" (UniqueName: \"kubernetes.io/projected/8cfc1a05-2f67-4940-8901-0a420b0b2e43-kube-api-access-zh942\") pod \"maas-controller-84f7d746c6-ff9sj\" (UID: \"8cfc1a05-2f67-4940-8901-0a420b0b2e43\") " pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:09.893303 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.893286 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8cfc1a05-2f67-4940-8901-0a420b0b2e43-webhook-cert\") pod \"maas-controller-84f7d746c6-ff9sj\" (UID: \"8cfc1a05-2f67-4940-8901-0a420b0b2e43\") " pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:09.900162 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:09.900137 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zh942\" (UniqueName: \"kubernetes.io/projected/8cfc1a05-2f67-4940-8901-0a420b0b2e43-kube-api-access-zh942\") pod \"maas-controller-84f7d746c6-ff9sj\" (UID: \"8cfc1a05-2f67-4940-8901-0a420b0b2e43\") " pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:10.028924 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:10.028855 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:10.160606 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:10.160584 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-84f7d746c6-ff9sj"] Jun 15 08:02:10.162342 ip-10-0-143-10 kubenswrapper[2569]: W0615 08:02:10.162317 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cfc1a05_2f67_4940_8901_0a420b0b2e43.slice/crio-86f5bd118e95dc036fe5df7a0cb9e69ad208da1fb7987adc4b19a816c91f9b39 WatchSource:0}: Error finding container 86f5bd118e95dc036fe5df7a0cb9e69ad208da1fb7987adc4b19a816c91f9b39: Status 404 returned error can't find the container with id 86f5bd118e95dc036fe5df7a0cb9e69ad208da1fb7987adc4b19a816c91f9b39 Jun 15 08:02:10.871047 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:10.870973 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7d746c6-ff9sj" event={"ID":"8cfc1a05-2f67-4940-8901-0a420b0b2e43","Type":"ContainerStarted","Data":"da4875d2db57afb9ffa8e07a2bec427fe7cedd0c96db2b088f9c7682d094ffb4"} Jun 15 08:02:10.871179 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:10.871053 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-84f7d746c6-ff9sj" event={"ID":"8cfc1a05-2f67-4940-8901-0a420b0b2e43","Type":"ContainerStarted","Data":"86f5bd118e95dc036fe5df7a0cb9e69ad208da1fb7987adc4b19a816c91f9b39"} Jun 15 08:02:10.871179 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:10.871108 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:02:10.890824 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:10.890774 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-84f7d746c6-ff9sj" podStartSLOduration=1.4963351280000001 podStartE2EDuration="1.890761808s" totalImagesPullingTime="394.42668ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-15 08:02:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:02:10.889234447 +0000 UTC m=+802.410722773" watchObservedRunningTime="2026-06-15 08:02:10.890761808 +0000 UTC m=+802.412250152" Jun 15 08:02:21.881406 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:02:21.881375 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-84f7d746c6-ff9sj" Jun 15 08:03:48.978765 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:03:48.978707 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:03:48.978765 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:03:48.978712 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:08:49.008694 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:08:49.008669 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:08:49.010959 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:08:49.010934 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:13:49.053705 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:13:49.053666 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:13:49.055169 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:13:49.055145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:18:49.085796 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:18:49.085759 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:18:49.087518 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:18:49.087500 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-zcc9c_27755659-ebe8-4960-b423-0963fb3cee94/ovn-acl-logging/0.log" Jun 15 08:22:34.219334 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:34.219300 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-786b4ff79d-vb859_0e3d26e8-5a7c-4775-85b1-6a74c0023b36/authorino/0.log" Jun 15 08:22:39.322451 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:39.322420 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-666df97d49-j9db5_9d3b5628-4760-459c-a5cf-1d4eea82e966/maas-api/0.log" Jun 15 08:22:39.659538 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:39.659508 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84f7d746c6-ff9sj_8cfc1a05-2f67-4940-8901-0a420b0b2e43/manager/0.log" Jun 15 08:22:40.121274 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:40.121204 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bd64c79-nn7fx_8153214a-9b2f-4fb2-add9-f7c1c0cede96/copy-manifests/0.log" Jun 15 08:22:40.135369 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:40.135342 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bd64c79-nn7fx_8153214a-9b2f-4fb2-add9-f7c1c0cede96/manager/0.log" Jun 15 08:22:41.709722 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:41.709692 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-786b4ff79d-vb859_0e3d26e8-5a7c-4775-85b1-6a74c0023b36/authorino/0.log" Jun 15 08:22:41.973708 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:41.973630 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bcxg9_c4e33350-8901-47b2-8231-71f5128e94cf/manager/0.log" Jun 15 08:22:42.085944 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:42.085914 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mrwc4_50ca5009-d2b3-40a6-864c-74ae2d7a7cd4/kuadrant-console-plugin/0.log" Jun 15 08:22:42.572695 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:42.572662 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mhk9j_07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d/manager/0.log" Jun 15 08:22:43.274859 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:43.274831 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-867cf8bfc-rxkmd_ca014551-88ec-4daa-8ce2-a42dae6289f0/kube-auth-proxy/0.log" Jun 15 08:22:43.639084 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:43.639014 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tpz25_f251cd4d-ee40-4e12-8d14-4ca349376625/payload-processing/0.log" Jun 15 08:22:44.119124 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:44.119093 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-7v2j5_eb86e5f0-ed62-4d59-9253-22d4a6c7c71f/storage-initializer/0.log" Jun 15 08:22:44.247212 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:44.247184 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-q4z2r_1fb9a217-0c89-48e2-9fea-c12c34eb22b3/storage-initializer/0.log" Jun 15 08:22:44.256169 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:44.256145 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-q4z2r_1fb9a217-0c89-48e2-9fea-c12c34eb22b3/main/0.log" Jun 15 08:22:44.491774 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:44.491749 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt_61e696a6-cf01-4417-9158-38b2ea9918a9/storage-initializer/0.log" Jun 15 08:22:44.499564 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:44.499543 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477clz8gt_61e696a6-cf01-4417-9158-38b2ea9918a9/main/0.log" Jun 15 08:22:44.605810 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:44.605784 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-97kkr_b683be11-fdc3-44a3-8c94-11346aafbff3/storage-initializer/0.log" Jun 15 08:22:44.613395 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:44.613378 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-97kkr_b683be11-fdc3-44a3-8c94-11346aafbff3/main/0.log" Jun 15 08:22:52.248432 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:52.248402 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-wkn8j_61ef1fc1-b8e0-4e3c-a9af-f9517f336e8e/global-pull-secret-syncer/0.log" Jun 15 08:22:52.324092 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:52.324069 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-nqbjb_ec666f4a-a0a2-4825-a5b8-185bf1e17bad/konnectivity-agent/0.log" Jun 15 08:22:52.427528 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:52.427495 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-143-10.ec2.internal_80ffb4914acf337a942adb1245474e33/haproxy/0.log" Jun 15 08:22:57.155039 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:57.155013 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-786b4ff79d-vb859_0e3d26e8-5a7c-4775-85b1-6a74c0023b36/authorino/0.log" Jun 15 08:22:57.228003 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:57.227979 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-bcxg9_c4e33350-8901-47b2-8231-71f5128e94cf/manager/0.log" Jun 15 08:22:57.262481 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:57.262435 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-mrwc4_50ca5009-d2b3-40a6-864c-74ae2d7a7cd4/kuadrant-console-plugin/0.log" Jun 15 08:22:57.481768 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:57.481686 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mhk9j_07a6c7ef-009b-4a0b-bab4-e7ab8f6f6e9d/manager/0.log" Jun 15 08:22:59.302014 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.301984 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vtxtw_eb5c44e8-6c87-40d9-9f45-5782d3393c6a/kube-state-metrics/0.log" Jun 15 08:22:59.327695 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.327674 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vtxtw_eb5c44e8-6c87-40d9-9f45-5782d3393c6a/kube-rbac-proxy-main/0.log" Jun 15 08:22:59.354125 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.354106 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-vtxtw_eb5c44e8-6c87-40d9-9f45-5782d3393c6a/kube-rbac-proxy-self/0.log" Jun 15 08:22:59.382602 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.382587 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-5b4b977964-qkt95_c94c3744-a2d4-4e4d-a653-e5cd0782941e/metrics-server/0.log" Jun 15 08:22:59.410728 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.410706 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-ddxnk_6e8f199a-46fa-450c-ab64-2ad95b7979f3/monitoring-plugin/0.log" Jun 15 08:22:59.534840 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.534774 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96g9h_fab62719-b262-4f52-a896-b8662210495c/node-exporter/0.log" Jun 15 08:22:59.557861 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.557836 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96g9h_fab62719-b262-4f52-a896-b8662210495c/kube-rbac-proxy/0.log" Jun 15 08:22:59.583057 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.583040 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-96g9h_fab62719-b262-4f52-a896-b8662210495c/init-textfile/0.log" Jun 15 08:22:59.787259 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.787191 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0ef1b06-3103-48ed-8720-9e6bb1652453/prometheus/0.log" Jun 15 08:22:59.811826 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.811802 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0ef1b06-3103-48ed-8720-9e6bb1652453/config-reloader/0.log" Jun 15 08:22:59.837928 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.837907 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0ef1b06-3103-48ed-8720-9e6bb1652453/thanos-sidecar/0.log" Jun 15 08:22:59.863503 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.863479 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0ef1b06-3103-48ed-8720-9e6bb1652453/kube-rbac-proxy-web/0.log" Jun 15 08:22:59.885245 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.885224 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0ef1b06-3103-48ed-8720-9e6bb1652453/kube-rbac-proxy/0.log" Jun 15 08:22:59.908500 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.908481 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0ef1b06-3103-48ed-8720-9e6bb1652453/kube-rbac-proxy-thanos/0.log" Jun 15 08:22:59.931521 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.931500 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_c0ef1b06-3103-48ed-8720-9e6bb1652453/init-config-reloader/0.log" Jun 15 08:22:59.960405 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.960379 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-pjjk7_77b150fc-5955-4074-aba9-03bd950841cf/prometheus-operator/0.log" Jun 15 08:22:59.980774 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:22:59.980753 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-864fcfc6f9-pjjk7_77b150fc-5955-4074-aba9-03bd950841cf/kube-rbac-proxy/0.log" Jun 15 08:23:00.043172 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.043119 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55d8b596b5-zfdt7_a2f834ba-efa3-43fb-bb8f-e7dd6d742629/telemeter-client/0.log" Jun 15 08:23:00.079356 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.079337 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55d8b596b5-zfdt7_a2f834ba-efa3-43fb-bb8f-e7dd6d742629/reload/0.log" Jun 15 08:23:00.100575 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.100547 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-55d8b596b5-zfdt7_a2f834ba-efa3-43fb-bb8f-e7dd6d742629/kube-rbac-proxy/0.log" Jun 15 08:23:00.161375 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.161354 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77969c67b6-9v4g5_38e24901-27b9-4965-a4ba-519463deaa1c/thanos-query/0.log" Jun 15 08:23:00.195341 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.195317 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77969c67b6-9v4g5_38e24901-27b9-4965-a4ba-519463deaa1c/kube-rbac-proxy-web/0.log" Jun 15 08:23:00.224263 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.224239 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77969c67b6-9v4g5_38e24901-27b9-4965-a4ba-519463deaa1c/kube-rbac-proxy/0.log" Jun 15 08:23:00.262391 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.262372 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77969c67b6-9v4g5_38e24901-27b9-4965-a4ba-519463deaa1c/prom-label-proxy/0.log" Jun 15 08:23:00.300604 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.300553 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77969c67b6-9v4g5_38e24901-27b9-4965-a4ba-519463deaa1c/kube-rbac-proxy-rules/0.log" Jun 15 08:23:00.337013 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:00.336982 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-77969c67b6-9v4g5_38e24901-27b9-4965-a4ba-519463deaa1c/kube-rbac-proxy-metrics/0.log" Jun 15 08:23:03.138267 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.138194 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-694c955b9-mqc9x_390c8ea5-8cb6-44fc-81a1-4134a1c5ada3/download-server/0.log" Jun 15 08:23:03.679185 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.679150 2569 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7"] Jun 15 08:23:03.682865 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.682848 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.685276 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.685250 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rm7bb\"/\"kube-root-ca.crt\"" Jun 15 08:23:03.685390 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.685363 2569 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rm7bb\"/\"default-dockercfg-fxwmn\"" Jun 15 08:23:03.686627 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.686607 2569 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rm7bb\"/\"openshift-service-ca.crt\"" Jun 15 08:23:03.691743 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.691716 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7"] Jun 15 08:23:03.806215 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.806183 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-sys\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.806420 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.806224 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-lib-modules\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.806420 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.806269 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hh7j\" (UniqueName: \"kubernetes.io/projected/38f45381-09e5-436f-8f65-82d6ddf68a0b-kube-api-access-4hh7j\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.806420 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.806350 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-podres\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.806420 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.806393 2569 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-proc\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907616 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907581 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-sys\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907616 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907623 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-lib-modules\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907874 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907666 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hh7j\" (UniqueName: \"kubernetes.io/projected/38f45381-09e5-436f-8f65-82d6ddf68a0b-kube-api-access-4hh7j\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907874 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907697 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-podres\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907874 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907709 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-sys\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907874 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907715 2569 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-proc\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907874 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907833 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-proc\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.907874 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907847 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-lib-modules\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.908143 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.907892 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/38f45381-09e5-436f-8f65-82d6ddf68a0b-podres\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.917027 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.917003 2569 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hh7j\" (UniqueName: \"kubernetes.io/projected/38f45381-09e5-436f-8f65-82d6ddf68a0b-kube-api-access-4hh7j\") pod \"perf-node-gather-daemonset-d7pf7\" (UID: \"38f45381-09e5-436f-8f65-82d6ddf68a0b\") " pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:03.994245 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:03.994162 2569 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:04.126039 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:04.126014 2569 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7"] Jun 15 08:23:04.130759 ip-10-0-143-10 kubenswrapper[2569]: W0615 08:23:04.130726 2569 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod38f45381_09e5_436f_8f65_82d6ddf68a0b.slice/crio-eda22c3f5d963f087b03e8d7fcd2b4f4c291291fd7e709f652023fff1438b3bf WatchSource:0}: Error finding container eda22c3f5d963f087b03e8d7fcd2b4f4c291291fd7e709f652023fff1438b3bf: Status 404 returned error can't find the container with id eda22c3f5d963f087b03e8d7fcd2b4f4c291291fd7e709f652023fff1438b3bf Jun 15 08:23:04.927807 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:04.927767 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" event={"ID":"38f45381-09e5-436f-8f65-82d6ddf68a0b","Type":"ContainerStarted","Data":"35bc985b20722b77b599c344d54b9a9854c669bf2ab99e26a132182d5e915c91"} Jun 15 08:23:04.928226 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:04.927831 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:04.928226 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:04.927852 2569 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" event={"ID":"38f45381-09e5-436f-8f65-82d6ddf68a0b","Type":"ContainerStarted","Data":"eda22c3f5d963f087b03e8d7fcd2b4f4c291291fd7e709f652023fff1438b3bf"} Jun 15 08:23:04.952841 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:04.952796 2569 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" podStartSLOduration=1.952781473 podStartE2EDuration="1.952781473s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-15 08:23:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-15 08:23:04.950078964 +0000 UTC m=+2056.471567290" watchObservedRunningTime="2026-06-15 08:23:04.952781473 +0000 UTC m=+2056.474269795" Jun 15 08:23:05.201862 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:05.201763 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cf8q5_f9877a11-9555-4c5d-8744-841ba91822dc/dns/0.log" Jun 15 08:23:05.223947 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:05.223911 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cf8q5_f9877a11-9555-4c5d-8744-841ba91822dc/kube-rbac-proxy/0.log" Jun 15 08:23:05.347893 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:05.347863 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zn2b9_cca22368-c7d6-44cd-b459-e09750ca54f0/dns-node-resolver/0.log" Jun 15 08:23:05.934119 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:05.934069 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-vndmk_55fa6a13-40dd-4e8e-9535-95e8afadd6ad/node-ca/0.log" Jun 15 08:23:07.158788 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:07.158762 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-867cf8bfc-rxkmd_ca014551-88ec-4daa-8ce2-a42dae6289f0/kube-auth-proxy/0.log" Jun 15 08:23:07.334320 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:07.334278 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tpz25_f251cd4d-ee40-4e12-8d14-4ca349376625/payload-processing/0.log" Jun 15 08:23:08.039881 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:08.039842 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vlj5g_abdf1a09-d8a6-4b98-a230-02587cc16cb1/serve-healthcheck-canary/0.log" Jun 15 08:23:08.762265 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:08.762240 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xbmq2_a3dc158d-9dca-4a72-aa1d-e48a703efb05/kube-rbac-proxy/0.log" Jun 15 08:23:08.786372 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:08.786348 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xbmq2_a3dc158d-9dca-4a72-aa1d-e48a703efb05/exporter/0.log" Jun 15 08:23:08.808866 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:08.808846 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xbmq2_a3dc158d-9dca-4a72-aa1d-e48a703efb05/extractor/0.log" Jun 15 08:23:10.942000 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:10.941974 2569 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rm7bb/perf-node-gather-daemonset-d7pf7" Jun 15 08:23:11.156986 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:11.156953 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-666df97d49-j9db5_9d3b5628-4760-459c-a5cf-1d4eea82e966/maas-api/0.log" Jun 15 08:23:11.272248 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:11.272168 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-84f7d746c6-ff9sj_8cfc1a05-2f67-4940-8901-0a420b0b2e43/manager/0.log" Jun 15 08:23:11.490948 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:11.490918 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bd64c79-nn7fx_8153214a-9b2f-4fb2-add9-f7c1c0cede96/manager/0.log" Jun 15 08:23:11.529691 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:11.529626 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7f5bd64c79-nn7fx_8153214a-9b2f-4fb2-add9-f7c1c0cede96/copy-manifests/0.log" Jun 15 08:23:13.435339 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:13.435314 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6b9cb757d6-pj75m_5b3ed6f4-ac8b-4df0-80d1-bf51bdd4d830/manager/0.log" Jun 15 08:23:13.466934 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:13.466912 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-jt5vt_6bb55560-815f-4405-9fd5-811172a94cd0/openshift-lws-operator/0.log" Jun 15 08:23:17.462025 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:17.461995 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-867cf8bfc-rxkmd_ca014551-88ec-4daa-8ce2-a42dae6289f0/kube-auth-proxy/0.log" Jun 15 08:23:17.605080 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:17.605047 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tpz25_f251cd4d-ee40-4e12-8d14-4ca349376625/payload-processing/0.log" Jun 15 08:23:18.869987 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:18.869962 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-867cf8bfc-rxkmd_ca014551-88ec-4daa-8ce2-a42dae6289f0/kube-auth-proxy/0.log" Jun 15 08:23:19.018774 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:19.018746 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tpz25_f251cd4d-ee40-4e12-8d14-4ca349376625/payload-processing/0.log" Jun 15 08:23:20.444681 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.444645 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-4hpfc_ef25b266-91ad-4e31-96d5-b655f06e5ccd/kube-multus/0.log" Jun 15 08:23:20.470672 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.470650 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsk8s_2af84169-400a-4278-9c5d-bc3c83460473/kube-multus-additional-cni-plugins/0.log" Jun 15 08:23:20.492334 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.492312 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsk8s_2af84169-400a-4278-9c5d-bc3c83460473/egress-router-binary-copy/0.log" Jun 15 08:23:20.514087 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.514068 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsk8s_2af84169-400a-4278-9c5d-bc3c83460473/cni-plugins/0.log" Jun 15 08:23:20.535648 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.535629 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsk8s_2af84169-400a-4278-9c5d-bc3c83460473/bond-cni-plugin/0.log" Jun 15 08:23:20.559898 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.559881 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsk8s_2af84169-400a-4278-9c5d-bc3c83460473/routeoverride-cni/0.log" Jun 15 08:23:20.582718 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.582703 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsk8s_2af84169-400a-4278-9c5d-bc3c83460473/whereabouts-cni-bincopy/0.log" Jun 15 08:23:20.609608 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.609593 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dsk8s_2af84169-400a-4278-9c5d-bc3c83460473/whereabouts-cni/0.log" Jun 15 08:23:20.883196 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:20.883093 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-867cf8bfc-rxkmd_ca014551-88ec-4daa-8ce2-a42dae6289f0/kube-auth-proxy/0.log" Jun 15 08:23:21.008412 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:21.008384 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-tpz25_f251cd4d-ee40-4e12-8d14-4ca349376625/payload-processing/0.log" Jun 15 08:23:21.080880 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:21.080852 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gl5lq_02ffc07a-6d44-47df-90ea-c657938899b3/network-metrics-daemon/0.log" Jun 15 08:23:21.102652 ip-10-0-143-10 kubenswrapper[2569]: I0615 08:23:21.102629 2569 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-gl5lq_02ffc07a-6d44-47df-90ea-c657938899b3/kube-rbac-proxy/0.log"