Jun 10 19:59:37.619288 ip-10-0-137-191 systemd[1]: Starting Kubernetes Kubelet...
Jun 10 19:59:38.014937 ip-10-0-137-191 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 19:59:38.014937 ip-10-0-137-191 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 10 19:59:38.014937 ip-10-0-137-191 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 19:59:38.014937 ip-10-0-137-191 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 10 19:59:38.014937 ip-10-0-137-191 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 10 19:59:38.015812 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.015728    2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 10 19:59:38.020006 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.019989    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 19:59:38.020006 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020005    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020010    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020014    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020018    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020021    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020024    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020026    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020030    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020033    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020037    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020041    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020045    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020048    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020051    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020054    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020057    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020059    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020062    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020065    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 19:59:38.020072 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020067    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020070    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020073    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020075    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020078    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020081    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020084    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020088    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020091    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020094    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020097    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020102    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020105    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020108    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020111    2578 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020114    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020117    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020120    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020122    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020125    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 19:59:38.020523 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020127    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020130    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020132    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020135    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020137    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020140    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020142    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020145    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020148    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020151    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020153    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020156    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020159    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020162    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020165    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020168    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020171    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020173    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020176    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020179    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 19:59:38.021350 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020182    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020185    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020187    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020190    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020195    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020197    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020200    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020202    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020205    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020208    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020210    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020213    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020215    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020218    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020220    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020223    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020225    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020228    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020230    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020233    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 19:59:38.022092 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020235    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020238    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020241    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020243    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020247    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020250    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020252    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020255    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020258    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020262    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020265    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020268    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020271    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020273    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020276    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020279    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020282    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020285    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.020287    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 19:59:38.022581 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022359    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022371    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022375    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022378    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022381    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022384    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022387    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022390    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022393    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022396    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022399    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022401    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022404    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022407    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022409    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022412    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022415    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022418    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022420    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022422    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 19:59:38.023093 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022425    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022428    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022431    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022433    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022436    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022439    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022442    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022444    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022447    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022449    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022452    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022454    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022460    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022463    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022466    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022469    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022474    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022477    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022480    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022483    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 19:59:38.023610 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022486    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022489    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022491    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022494    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022498    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022502    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022506    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022510    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022513    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022515    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022518    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022521    2578 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022524    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022526    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022529    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022531    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022534    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022537    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022540    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 19:59:38.024142 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022543    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022546    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022548    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022551    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022554    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022557    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022560    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022563    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022565    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022568    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022571    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022574    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022577    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022579    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022582    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022585    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022587    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022594    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022597    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022600    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 19:59:38.024615 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022603    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022606    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022609    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022611    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022615    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022617    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022620    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022623    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022625    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022628    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022632    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022635    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022638    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022640    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022643    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022646    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022648    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022651    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022654    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 19:59:38.025138 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.022657    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023090    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023096    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023100    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023103    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023106    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023109    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023112    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023115    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023119    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023123    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023126    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023129    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023131    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023134    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023137    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023140    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023144    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023146    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023149    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 19:59:38.025633 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023152    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023155    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023158    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023160    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023163    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023165    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023168    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023171    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023174    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023176    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023179    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023182    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023185    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023187    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023190    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023192    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023195    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023198    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023200    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023203    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 19:59:38.026131 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023205    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023208    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023210    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023213    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023216    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023218    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023221    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023224    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023226    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023229    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023232    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023234    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023237    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023240    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023243    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023245    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023247    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023250    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023252    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023255    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 19:59:38.026613 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023257    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023261    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023265    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023268    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023271    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023274    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023276    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023279    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023283    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023285    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023288    2578 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023290    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023293    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023295    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023299    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023303    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023306    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023308    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023311    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 19:59:38.027159 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023314    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023316    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023319    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023321    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023324    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023327    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023330    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023332    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023335    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023338    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023340    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023343    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023345    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023348    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023350    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023353    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023356    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023359    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023361    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023364    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 19:59:38.027642 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.023366    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023437    2578 flags.go:64] FLAG: --address="0.0.0.0"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023444    2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023451    2578 flags.go:64] FLAG: --anonymous-auth="true"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023455    2578 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023460    2578 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023463    2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023467    2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023471    2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023474    2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023478    2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023482    2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023485    2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023488    2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023491    2578 flags.go:64] FLAG: --cgroup-root=""
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023494    2578 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023497    2578 flags.go:64] FLAG: --client-ca-file=""
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023500    2578 flags.go:64] FLAG: --cloud-provider="external"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023506    2578 flags.go:64] FLAG: --cluster-dns="[]"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023510    2578 flags.go:64] FLAG: --cluster-domain=""
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023513    2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023516    2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023520    2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023524    2578 flags.go:64] FLAG: --container-log-max-files="5"
Jun 10 19:59:38.028190 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023528    2578 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023531    2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023534    2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023537    2578 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023540    2578 flags.go:64] FLAG: --contention-profiling="false"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023543    2578 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023546    2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023549    2578 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023553    2578 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023557    2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023559    2578 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023563    2578 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023566    2578 flags.go:64] FLAG: --enable-load-reader="false"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023569    2578 flags.go:64] FLAG: --enable-server="true"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023572    2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023577    2578 flags.go:64] FLAG: --event-burst="100"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023580    2578 flags.go:64] FLAG: --event-qps="50"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023583    2578 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023586    2578 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023590    2578 flags.go:64] FLAG: --eviction-hard=""
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023593    2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023596    2578 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023599    2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023602    2578 flags.go:64] FLAG: --eviction-soft=""
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023605    2578 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 10 19:59:38.028781 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023608    2578 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023614    2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023617    2578 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023620    2578 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023623    2578 flags.go:64] FLAG: --fail-swap-on="true"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023626    2578 flags.go:64] FLAG: --feature-gates=""
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023630    2578 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023633    2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023636    2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023639    2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023642    2578 flags.go:64] FLAG: --healthz-port="10248"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023645    2578 flags.go:64] FLAG: --help="false"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023648    2578 flags.go:64] FLAG: --hostname-override="ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023651    2578 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023654    2578 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023657    2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023660    2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023664    2578 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023667    2578 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023670    2578 flags.go:64] FLAG: --image-service-endpoint=""
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023673    2578 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023676    2578 flags.go:64] FLAG: --kube-api-burst="100"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023678    2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023681    2578 flags.go:64] FLAG: --kube-api-qps="50"
Jun 10 19:59:38.029419 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023684    2578 flags.go:64] FLAG: --kube-reserved=""
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023687    2578 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023690    2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023693    2578 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023699    2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023702    2578 flags.go:64] FLAG: --lock-file=""
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023705    2578 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023708    2578 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023711    2578 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023718    2578 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023721    2578 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023724    2578 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023727    2578 flags.go:64] FLAG: --logging-format="text"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023730    2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023733    2578 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023736    2578 flags.go:64] FLAG: --manifest-url=""
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023739    2578 flags.go:64] FLAG: --manifest-url-header=""
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023743    2578 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023746    2578 flags.go:64] FLAG: --max-open-files="1000000"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023750    2578 flags.go:64] FLAG: --max-pods="110"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023754    2578 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023757    2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023760    2578 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023763    2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023766    2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 10 19:59:38.030067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023769    2578 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023772    2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023779    2578 flags.go:64] FLAG: --node-status-max-images="50"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023782    2578 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023785    2578 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023788    2578 flags.go:64] FLAG: --pod-cidr=""
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023791    2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023797    2578 flags.go:64] FLAG: --pod-manifest-path=""
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023800    2578 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023803    2578 flags.go:64] FLAG: --pods-per-core="0"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023806    2578 flags.go:64] FLAG: --port="10250"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023809    2578 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023813    2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-082da0c96917192d3"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023816    2578 flags.go:64] FLAG: --qos-reserved=""
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023819    2578 flags.go:64] FLAG: --read-only-port="10255"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023823    2578 flags.go:64] FLAG: --register-node="true"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023830    2578 flags.go:64] FLAG: --register-with-taints=""
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023834    2578 flags.go:64] FLAG: --registry-burst="10"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023837    2578 flags.go:64] FLAG: --registry-qps="5"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023840    2578 flags.go:64] FLAG: --reserved-cpus=""
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023843    2578 flags.go:64] FLAG: --reserved-memory=""
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023862    2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023866    2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023869    2578 flags.go:64] FLAG: --rotate-certificates="false"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023872    2578 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 10 19:59:38.030696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023875    2578 flags.go:64] FLAG: --runonce="false"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023878    2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023881    2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023885    2578 flags.go:64] FLAG: --seccomp-default="false"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023887    2578 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023890    2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023893    2578 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023896    2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023899    2578 flags.go:64] FLAG: --storage-driver-password="root"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023902    2578 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023905    2578 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023908    2578 flags.go:64] FLAG: --storage-driver-user="root"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023911    2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023914    2578 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023917    2578 flags.go:64] FLAG: --system-cgroups=""
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023920    2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023925    2578 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023928    2578 flags.go:64] FLAG: --tls-cert-file=""
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023931    2578 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023936    2578 flags.go:64] FLAG: --tls-min-version=""
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023939    2578 flags.go:64] FLAG: --tls-private-key-file=""
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023942    2578 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023945    2578 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023949    2578 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023952    2578 flags.go:64] FLAG: --v="2"
Jun 10 19:59:38.031362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023956    2578 flags.go:64] FLAG: --version="false"
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023960    2578 flags.go:64] FLAG: --vmodule=""
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023964    2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.023967    2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024083    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024087    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024090    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024093    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024096    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024099    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024102    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024104    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024107    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024110    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024113    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024116    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024119    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024121    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024124    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024127    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 19:59:38.031991 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024129    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024132    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024140    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024143    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024146    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024149    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024153    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024155    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024158    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024161    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024165    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024169    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024173    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024176    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024179    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024182    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024185    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024188    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024191    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 19:59:38.032582 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024194    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024196    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024199    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024203    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024206    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024209    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024212    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024215    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024217    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024220    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024223    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024226    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024228    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024231    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024234    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024236    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024239    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024242    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024244    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 19:59:38.033135 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024248    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024251    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024253    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024256    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024260    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024263    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024265    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024268    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024271    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024274    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024277    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024279    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024282    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024285    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024287    2578 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024290    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024293    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024295    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024298    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024301    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 19:59:38.033588 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024303    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024306    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024308    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024311    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024314    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024316    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024319    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024322    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024324    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024327    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024329    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024332    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024336    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024340    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024344    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024347    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024352    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024355    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024358    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024361    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 19:59:38.034098 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024364    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024366    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024370    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024372    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.024375    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.024904    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.031583    2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.031597    2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.031616    2578 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.031625    2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031684    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031689    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031692    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031696    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031699    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 19:59:38.034605 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031701    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031704    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031707    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031710    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031712    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031715    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031717    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031720    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031723    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031726    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031728    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031731    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031734    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031736    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031739    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031742    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031744    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031747    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031749    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031752    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 19:59:38.035048 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031755    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031760    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031764    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031767    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031771    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031774    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031778    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031780    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031783    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031786    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031789    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031792    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031796    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031799    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031802    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031805    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031808    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031810    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031813    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031815    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 19:59:38.035533 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031818    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031821    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031823    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031826    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031828    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031831    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031834    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031837    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031840    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031843    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031862    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031867    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031871    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031874    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031877    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031880    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031883    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031886    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031889    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 19:59:38.036034 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031892    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031895    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031897    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031900    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031903    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031906    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031908    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031911    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031913    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031916    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031919    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031922    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031925    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031927    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031930    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031933    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031935    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031938    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031940    2578 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031943    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 19:59:38.036500 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031946    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031949    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031952    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031954    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031957    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031960    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031967    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031969    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031972    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031975    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031977    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031982    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031985    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031988    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 19:59:38.037076 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.031991    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.031996    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032134    2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032139    2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032142    2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032145    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032148    2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032150    2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032153    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032156    2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032159    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032161    2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032164    2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032167    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 10 19:59:38.037416 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032169    2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032173    2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032177    2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032180    2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032183    2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032186    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032189    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032192    2578 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032194    2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032197    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032200    2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032203    2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032205    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032208    2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032212    2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032215    2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032218    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032221    2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032224    2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 10 19:59:38.037764 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032226    2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032229    2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032231    2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032234    2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032236    2578 feature_gate.go:328] unrecognized feature gate: EventTTL
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032239    2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032241    2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032244    2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032247    2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032249    2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032252    2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032254    2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032257    2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032260    2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032262    2578 feature_gate.go:328] unrecognized feature gate: Example2
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032265    2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032267    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032270    2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032273    2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032276    2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 10 19:59:38.038286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032278    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032281    2578 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032284    2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032286    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032289    2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032292    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032295    2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032297    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032300    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032303    2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032305    2578 feature_gate.go:328] unrecognized feature gate: OSStreams
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032308    2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032310    2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032313    2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032316    2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032318    2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032321    2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032323    2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032326    2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032329    2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 10 19:59:38.038780 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032331    2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032334    2578 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032336    2578 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032339    2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032341    2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032344    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032347    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032349    2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032352    2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032354    2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032357    2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032359    2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032362    2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032365    2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032368    2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032371    2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032373    2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032375    2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032379    2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032381    2578 feature_gate.go:328] unrecognized feature gate: Example
Jun 10 19:59:38.039277 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032384    2578 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032387    2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032389    2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032392    2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032395    2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032398    2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032402    2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:38.032404    2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.032409    2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.032507    2578 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.034509    2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.035817    2578 server.go:1019] "Starting client certificate rotation"
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.035918    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 19:59:38.039747 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.035950    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 10 19:59:38.040105 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.038732    2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 19:59:38.042895 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.042878    2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 10 19:59:38.052621 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.052597    2578 log.go:25] "Validated CRI v1 runtime API"
Jun 10 19:59:38.054995 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.054979    2578 log.go:25] "Validated CRI v1 image API"
Jun 10 19:59:38.057483 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.057463    2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 10 19:59:38.059728 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.059711    2578 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 a497f8df-e6ef-46d3-a66d-750b758155bc:/dev/nvme0n1p3 ce48a9d4-7e75-4173-b5d6-0fa19d341c92:/dev/nvme0n1p4]
Jun 10 19:59:38.059791 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.059728    2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 10 19:59:38.065409 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.065301    2578 manager.go:216] Machine: {Timestamp:2026-06-10 19:59:38.064155438 +0000 UTC m=+0.325125121 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100007 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec22fab0b98e989c636afbb2f2f4daac SystemUUID:ec22fab0-b98e-989c-636a-fbb2f2f4daac BootID:fb6e87ea-7bda-4198-95e4-0672ae9d2ec6 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:89:9e:59:db:2d Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:89:9e:59:db:2d Speed:0 Mtu:9001} {Name:ovs-system MacAddress:7a:09:07:11:7a:1c Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 10 19:59:38.065409 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.065407    2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 10 19:59:38.065507 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.065488    2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 10 19:59:38.067006 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.066993    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 19:59:38.068601 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.068579    2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 10 19:59:38.068739 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.068606    2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-191.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 10 19:59:38.069362 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.069353    2578 topology_manager.go:138] "Creating topology manager with none policy"
Jun 10 19:59:38.069398 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.069363    2578 container_manager_linux.go:309] "Creating device plugin manager"
Jun 10 19:59:38.069398 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.069371    2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 19:59:38.070043 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.070033    2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 10 19:59:38.070731 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.070723    2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jun 10 19:59:38.073356 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073345    2578 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 19:59:38.073466 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073457    2578 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jun 10 19:59:38.073502 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073485    2578 kubelet.go:486] "Attempting to sync node with API server"
Jun 10 19:59:38.073502 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073496    2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 10 19:59:38.073556 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073515    2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 10 19:59:38.073556 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073525    2578 kubelet.go:398] "Adding apiserver pod source"
Jun 10 19:59:38.073556 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073533    2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 10 19:59:38.073900 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073889    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 19:59:38.073947 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.073907    2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 10 19:59:38.076091 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.076075    2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jun 10 19:59:38.077376 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.077363    2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 10 19:59:38.077414 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.077392    2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jun 10 19:59:38.078026 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078014    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 10 19:59:38.078071 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078034    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 10 19:59:38.078071 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078043    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 10 19:59:38.078071 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078052    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 10 19:59:38.078071 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078063    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 10 19:59:38.078071 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078071    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 10 19:59:38.078204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078085    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 10 19:59:38.078204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078093    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 10 19:59:38.078204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078103    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 10 19:59:38.078204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078111    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 10 19:59:38.078204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078133    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 10 19:59:38.078204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078146    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 10 19:59:38.078696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078687    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 10 19:59:38.078696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.078696    2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 10 19:59:38.082242 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.082228    2578 server.go:1268] "Started kubelet"
Jun 10 19:59:38.082391 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.082321    2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 10 19:59:38.082447 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.082419    2578 server_v1.go:49] "podresources" method="list" useActivePods=true
Jun 10 19:59:38.082907 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.082876    2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 10 19:59:38.083179 ip-10-0-137-191 systemd[1]: Started Kubernetes Kubelet.
Jun 10 19:59:38.084179 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.084156    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97jgq"
Jun 10 19:59:38.084269 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.084194    2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 10 19:59:38.084702 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.084685    2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-191.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 10 19:59:38.085474 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.085423    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 10 19:59:38.086597 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.086567    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 10 19:59:38.088312 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.088295    2578 server.go:310] "Adding debug handlers to kubelet server"
Jun 10 19:59:38.090527 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.090507    2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 10 19:59:38.090933 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.090066    2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-191.ec2.internal.18b7d0a3735f74c3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-191.ec2.internal,UID:ip-10-0-137-191.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-191.ec2.internal,},FirstTimestamp:2026-06-10 19:59:38.082202819 +0000 UTC m=+0.343172503,LastTimestamp:2026-06-10 19:59:38.082202819 +0000 UTC m=+0.343172503,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-191.ec2.internal,}"
Jun 10 19:59:38.091761 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.091743    2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 10 19:59:38.091761 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.091752    2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 10 19:59:38.091947 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.091823    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.092067 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.092044    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-97jgq"
Jun 10 19:59:38.092338 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.092320    2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jun 10 19:59:38.092421 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.092322    2578 volume_manager.go:311] "The desired_state_of_world populator starts"
Jun 10 19:59:38.092421 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.092363    2578 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jun 10 19:59:38.092526 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.092458    2578 reconstruct.go:97] "Volume reconstruction finished"
Jun 10 19:59:38.092526 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.092467    2578 reconciler.go:29] "Reconciler: start to sync state"
Jun 10 19:59:38.093051 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093036    2578 factory.go:55] Registering systemd factory
Jun 10 19:59:38.093051 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093052    2578 factory.go:223] Registration of the systemd container factory successfully
Jun 10 19:59:38.093280 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093265    2578 factory.go:153] Registering CRI-O factory
Jun 10 19:59:38.093323 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093285    2578 factory.go:223] Registration of the crio container factory successfully
Jun 10 19:59:38.093365 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093336    2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 10 19:59:38.093365 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093360    2578 factory.go:103] Registering Raw factory
Jun 10 19:59:38.093431 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093374    2578 manager.go:1196] Started watching for new ooms in manager
Jun 10 19:59:38.093743 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.093710    2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-191.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 10 19:59:38.093835 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.093796    2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 10 19:59:38.093995 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.093982    2578 manager.go:349] Starting recovery of all containers
Jun 10 19:59:38.104492 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.104349    2578 manager.go:354] Recovery completed
Jun 10 19:59:38.105947 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.105921    2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jun 10 19:59:38.108748 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.108736    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 19:59:38.110650 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.110635    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 19:59:38.110694 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.110664    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 19:59:38.110694 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.110678    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientPID"
Jun 10 19:59:38.111262 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.111233    2578 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 10 19:59:38.111262 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.111249    2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 10 19:59:38.111354 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.111269    2578 state_mem.go:36] "Initialized new in-memory state store"
Jun 10 19:59:38.111354 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.111252    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 19:59:38.112281 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.112270    2578 policy_none.go:49] "None policy: Start"
Jun 10 19:59:38.112315 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.112284    2578 memory_manager.go:187] "Starting memorymanager" policy="None"
Jun 10 19:59:38.112315 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.112294    2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jun 10 19:59:38.112773 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.112758    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 19:59:38.112824 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.112783    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 19:59:38.112824 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.112795    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientPID"
Jun 10 19:59:38.113123 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.113111    2578 policy_none.go:47] "Start"
Jun 10 19:59:38.145446 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.145431    2578 manager.go:337] "Starting Device Plugin manager"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.145472    2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.145485    2578 server.go:87] "Starting device plugin registration server"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.145743    2578 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.145758    2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.145832    2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.145924    2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.145935    2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.147997    2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.148048    2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.155783    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jun 10 19:59:38.156982 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.156965    2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jun 10 19:59:38.157498 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.157005    2578 status_manager.go:244] "Starting to sync pod status with apiserver"
Jun 10 19:59:38.157498 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.157031    2578 kubelet.go:2448] "Starting kubelet main sync loop"
Jun 10 19:59:38.157498 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.157067    2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 10 19:59:38.159161 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.159141    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 19:59:38.246220 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.246195    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 19:59:38.247163 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.247147    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 19:59:38.247225 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.247179    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 19:59:38.247225 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.247195    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientPID"
Jun 10 19:59:38.247225 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.247224    2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.255629 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.255615    2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.255674 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.255637    2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-191.ec2.internal\": node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.257900 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.257883    2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal"]
Jun 10 19:59:38.257953 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.257944    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 19:59:38.258835 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.258819    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 19:59:38.258944 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.258864    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 19:59:38.258944 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.258882    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientPID"
Jun 10 19:59:38.260279 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.260263    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 19:59:38.260394 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.260378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.260459 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.260411    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 19:59:38.260995 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.260978    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 19:59:38.261069 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.261004    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 19:59:38.261069 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.261020    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientPID"
Jun 10 19:59:38.261069 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.261004    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 19:59:38.261069 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.261056    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 19:59:38.261069 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.261069    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientPID"
Jun 10 19:59:38.262389 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.262351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.262447 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.262415    2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jun 10 19:59:38.263068 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.263053    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientMemory"
Jun 10 19:59:38.263157 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.263076    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasNoDiskPressure"
Jun 10 19:59:38.263157 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.263089    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeHasSufficientPID"
Jun 10 19:59:38.270842 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.270827    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.288425 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.288406    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-191.ec2.internal\" not found" node="ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.292682 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.292662    2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-191.ec2.internal\" not found" node="ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.293705 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.293688    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac73683d94ef66a50df357decd5997e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal\" (UID: \"ac73683d94ef66a50df357decd5997e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.293755 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.293713    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128321a9fc1dae510aeba8d7ac9882bb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-191.ec2.internal\" (UID: \"128321a9fc1dae510aeba8d7ac9882bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.293755 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.293730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac73683d94ef66a50df357decd5997e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal\" (UID: \"ac73683d94ef66a50df357decd5997e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.371367 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.371346    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.393859 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.393836    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac73683d94ef66a50df357decd5997e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal\" (UID: \"ac73683d94ef66a50df357decd5997e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.393925 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.393878    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac73683d94ef66a50df357decd5997e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal\" (UID: \"ac73683d94ef66a50df357decd5997e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.393925 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.393894    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128321a9fc1dae510aeba8d7ac9882bb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-191.ec2.internal\" (UID: \"128321a9fc1dae510aeba8d7ac9882bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.393999 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.393955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ac73683d94ef66a50df357decd5997e2-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal\" (UID: \"ac73683d94ef66a50df357decd5997e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.394035 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.394007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ac73683d94ef66a50df357decd5997e2-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal\" (UID: \"ac73683d94ef66a50df357decd5997e2\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.394073 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.394038    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/128321a9fc1dae510aeba8d7ac9882bb-config\") pod \"kube-apiserver-proxy-ip-10-0-137-191.ec2.internal\" (UID: \"128321a9fc1dae510aeba8d7ac9882bb\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.472048 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.472015    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.572643 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.572557    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.592879 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.592843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.596335 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:38.596130    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:38.672642 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.672613    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.773091 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.773055    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.873633 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.873561    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:38.974110 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:38.974074    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:39.035611 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.035583    2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 10 19:59:39.036206 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.035746    2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 10 19:59:39.075007 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:39.074980    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:39.094714 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.094684    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-09 19:54:38 +0000 UTC" deadline="2028-02-25 13:07:24.466328384 +0000 UTC"
Jun 10 19:59:39.094714 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.094713    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14993h7m45.371619516s"
Jun 10 19:59:39.102826 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:39.102798    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128321a9fc1dae510aeba8d7ac9882bb.slice/crio-46b90eff108719ccaadbc600fb9566cef772399f14b45caec98c723225227385 WatchSource:0}: Error finding container 46b90eff108719ccaadbc600fb9566cef772399f14b45caec98c723225227385: Status 404 returned error can't find the container with id 46b90eff108719ccaadbc600fb9566cef772399f14b45caec98c723225227385
Jun 10 19:59:39.103327 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:39.103296    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podac73683d94ef66a50df357decd5997e2.slice/crio-3b4c68da5aabbe4928fab5649a90cfb0b10f2a1fe5c615b9c2268e04ec25446b WatchSource:0}: Error finding container 3b4c68da5aabbe4928fab5649a90cfb0b10f2a1fe5c615b9c2268e04ec25446b: Status 404 returned error can't find the container with id 3b4c68da5aabbe4928fab5649a90cfb0b10f2a1fe5c615b9c2268e04ec25446b
Jun 10 19:59:39.106783 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.106767    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 19:59:39.113417 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.113399    2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 19:59:39.160303 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.160207    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal" event={"ID":"128321a9fc1dae510aeba8d7ac9882bb","Type":"ContainerStarted","Data":"46b90eff108719ccaadbc600fb9566cef772399f14b45caec98c723225227385"}
Jun 10 19:59:39.161275 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.161253    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal" event={"ID":"ac73683d94ef66a50df357decd5997e2","Type":"ContainerStarted","Data":"3b4c68da5aabbe4928fab5649a90cfb0b10f2a1fe5c615b9c2268e04ec25446b"}
Jun 10 19:59:39.174487 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.174469    2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 19:59:39.175444 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:39.175430    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:39.275764 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:39.275732    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:39.376272 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:39.376238    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:39.476793 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:39.476716    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:39.577579 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:39.577540    2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-191.ec2.internal\" not found"
Jun 10 19:59:39.619409 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.619383    2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 19:59:39.692900 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.692652    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:39.704309 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.704194    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 19:59:39.705650 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.705485    2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal"
Jun 10 19:59:39.713696 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:39.713672    2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 10 19:59:40.074813 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.074784    2578 apiserver.go:52] "Watching apiserver"
Jun 10 19:59:40.081664 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.081628    2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 10 19:59:40.084704 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.084676    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-8jlh7","kube-system/global-pull-secret-syncer-kpdmj","kube-system/konnectivity-agent-p26p6","kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal","openshift-multus/multus-additional-cni-plugins-fp57l","openshift-multus/network-metrics-daemon-shvsb","openshift-network-operator/iptables-alerter-vq8w4","openshift-ovn-kubernetes/ovnkube-node-fz8t6","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp","openshift-cluster-node-tuning-operator/tuned-clq87","openshift-dns/node-resolver-44nqh","openshift-image-registry/node-ca-jv5hf","openshift-multus/multus-4cbtr"]
Jun 10 19:59:40.087319 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.087298    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.089454 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.089435    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.089894 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.089750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 10 19:59:40.089894 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.089770    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 10 19:59:40.089894 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.089758    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 10 19:59:40.090911 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.090891    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qn2mh\""
Jun 10 19:59:40.091652 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.091408    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 10 19:59:40.091652 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.091538    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 10 19:59:40.091783 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.091739    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-49wwh\""
Jun 10 19:59:40.091783 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.091757    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.093110 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.093025    2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 10 19:59:40.093687 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.093668    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ppp7d\""
Jun 10 19:59:40.093687 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.093680    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 10 19:59:40.093845 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.093742    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 10 19:59:40.093845 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.093745    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.095588 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.095566    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kjwng\""
Jun 10 19:59:40.095701 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.095680    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 10 19:59:40.096335 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.095944    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.096335 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.096019    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 10 19:59:40.096335 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.096035    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 10 19:59:40.096335 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.096237    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 10 19:59:40.098104 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.098086    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 10 19:59:40.098104 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.098086    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 10 19:59:40.098254 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.098114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.098254 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.098130    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 10 19:59:40.098646 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.098632    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-bw5qq\""
Jun 10 19:59:40.100170 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.100063    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 10 19:59:40.100274 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.100190    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 10 19:59:40.100274 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.100232    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5kdqz\""
Jun 10 19:59:40.100652 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.100633    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.101534 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101514    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-lib-modules\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.101633 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-var-lib-kubelet\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.101633 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88824c83-fdfd-4848-80f9-21ecefd09afc-agent-certs\") pod \"konnectivity-agent-p26p6\" (UID: \"88824c83-fdfd-4848-80f9-21ecefd09afc\") " pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.101633 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101594    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-conf-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.101824 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101649    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-daemon-config\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.101824 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101675    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysconfig\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.101824 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101719    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-systemd\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.101824 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101780    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665cd891-e040-4fd1-93de-dacf099fb8aa-tmp\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.101824 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-socket-dir-parent\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-cni-multus\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101891    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-tuned\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101951    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88824c83-fdfd-4848-80f9-21ecefd09afc-konnectivity-ca\") pod \"konnectivity-agent-p26p6\" (UID: \"88824c83-fdfd-4848-80f9-21ecefd09afc\") " pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.101975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-cni-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-k8s-cni-cncf-io\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-multus-certs\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102051    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-etc-kubernetes\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102088    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-run\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102129    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14a578da-3b6c-4aa2-b15a-1101728a92e0-cni-binary-copy\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102171    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102196    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-device-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.102216 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102217    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-hostroot\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102263    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-sys-fs\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102289    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxn9h\" (UniqueName: \"kubernetes.io/projected/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-kube-api-access-mxn9h\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102340    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-host\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102369    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dndj\" (UniqueName: \"kubernetes.io/projected/665cd891-e040-4fd1-93de-dacf099fb8aa-kube-api-access-7dndj\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102426    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-cni-bin\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102489    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-kubelet\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102529    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-socket-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.102725 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102608    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-modprobe-d\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysctl-conf\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102768    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-os-release\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102791    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-netns\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102814    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-registration-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102822    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102837    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-kubernetes\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102880    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102885    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-cnibin\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102909    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnr7w\" (UniqueName: \"kubernetes.io/projected/14a578da-3b6c-4aa2-b15a-1101728a92e0-kube-api-access-pnr7w\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102933    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-system-cni-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102955    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysctl-d\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.103002 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.102978    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-sys\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.103318 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.103027    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 10 19:59:40.103318 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.103063    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 10 19:59:40.103318 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.103150    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 10 19:59:40.103318 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.103206    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.103318 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.103214    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-72fsh\""
Jun 10 19:59:40.103455 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.103214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 10 19:59:40.105327 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.105184    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.105327 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.105263    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:40.105327 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.105307    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 10 19:59:40.105525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.105375    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-wfkxx\""
Jun 10 19:59:40.105525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.105447    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 10 19:59:40.105623 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.105522    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 10 19:59:40.106516 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.106497    2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 10 19:59:40.107563 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.107549    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:40.107651 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.107635    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:40.109843 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.109823    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:40.109949 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.109901    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:40.114619 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.114569    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.118417 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.118399    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 10 19:59:40.118482 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.118421    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 10 19:59:40.118616 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.118592    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-829fs\""
Jun 10 19:59:40.127385 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.127364    2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-ldcmj"
Jun 10 19:59:40.134505 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.134485    2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-ldcmj"
Jun 10 19:59:40.194461 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.194428    2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jun 10 19:59:40.203122 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203099    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-log-socket\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.203271 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203128    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-cni-bin\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.203271 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-system-cni-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203271 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-sys\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.203271 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203201    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88824c83-fdfd-4848-80f9-21ecefd09afc-agent-certs\") pod \"konnectivity-agent-p26p6\" (UID: \"88824c83-fdfd-4848-80f9-21ecefd09afc\") " pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.203271 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203235    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-conf-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203271 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203251    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-system-cni-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203251    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-sys\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203277    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203305    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysconfig\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203309    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-conf-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203322    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-systemd\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203338    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-socket-dir-parent\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203363    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-cni-multus\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203370    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysconfig\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203384    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-tuned\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203390    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-systemd\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203417    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-cni-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203429    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-cni-multus\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203435    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-socket-dir-parent\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203448    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-multus-certs\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203486    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-cni-netd\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203491    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-multus-certs\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203498    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-cni-dir\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.203525 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203510    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a93364a5-e951-4b4d-bb08-cd1d597fc638-kubelet-config\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203542    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-run\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203562    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203582    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a93364a5-e951-4b4d-bb08-cd1d597fc638-dbus\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203591    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-run\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203608    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203601    2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203628    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-run-ovn-kubernetes\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-env-overrides\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203662    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x5qq\" (UniqueName: \"kubernetes.io/projected/3e473320-d049-4a4a-861d-5030c95cad11-kube-api-access-4x5qq\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203677    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnkqv\" (UniqueName: \"kubernetes.io/projected/93721cdf-fcd3-43ab-9905-44589865da03-kube-api-access-xnkqv\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203691    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-kubelet-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-host-slash\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203818    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dndj\" (UniqueName: \"kubernetes.io/projected/665cd891-e040-4fd1-93de-dacf099fb8aa-kube-api-access-7dndj\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-cni-bin\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203870    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-kubelet\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203897    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovn-node-metrics-cert\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.204377 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203913    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-iptables-alerter-script\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203929    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203954    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-socket-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203978    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-modprobe-d\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-os-release\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.203982    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-cni-bin\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-run-netns\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204048    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovnkube-script-lib\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204076    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-os-release\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204002    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-var-lib-kubelet\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6trld\" (UniqueName: \"kubernetes.io/projected/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-kube-api-access-6trld\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204120    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-modprobe-d\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204135    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-socket-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204153    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64c09dc-1acf-458e-896b-19525dc2d3db-serviceca\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204160    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-os-release\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204185    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93721cdf-fcd3-43ab-9905-44589865da03-tmp-dir\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204209    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-system-cni-dir\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.205177 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204225    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cnibin\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204239    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-ovn\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204302    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysctl-d\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204374    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysctl-d\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204383    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-lib-modules\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204411    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-var-lib-kubelet\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204436    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-daemon-config\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204445    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-lib-modules\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204468    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-var-lib-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204484    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g6sj5\" (UniqueName: \"kubernetes.io/projected/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-kube-api-access-g6sj5\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204492    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-var-lib-kubelet\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665cd891-e040-4fd1-93de-dacf099fb8aa-tmp\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-kubelet\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204574    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cni-binary-copy\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204595    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204615    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8b4f5\" (UniqueName: \"kubernetes.io/projected/b64c09dc-1acf-458e-896b-19525dc2d3db-kube-api-access-8b4f5\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.205818 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204637    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88824c83-fdfd-4848-80f9-21ecefd09afc-konnectivity-ca\") pod \"konnectivity-agent-p26p6\" (UID: \"88824c83-fdfd-4848-80f9-21ecefd09afc\") " pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204692    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-k8s-cni-cncf-io\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204716    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-etc-kubernetes\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204737    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64c09dc-1acf-458e-896b-19525dc2d3db-host\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204762    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14a578da-3b6c-4aa2-b15a-1101728a92e0-cni-binary-copy\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-systemd-units\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204792    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-etc-kubernetes\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovnkube-config\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-device-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204840    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-k8s-cni-cncf-io\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-hostroot\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204914    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-etc-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204965    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-device-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.204999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-hostroot\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205027    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kqpx5\" (UniqueName: \"kubernetes.io/projected/35d8561b-5c94-4fc5-bea5-a5af2335e26e-kube-api-access-kqpx5\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205060    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.206395 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205077    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/14a578da-3b6c-4aa2-b15a-1101728a92e0-multus-daemon-config\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205089    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205126    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-sys-fs\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205151    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxn9h\" (UniqueName: \"kubernetes.io/projected/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-kube-api-access-mxn9h\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205190    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-sys-fs\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205203    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-etc-selinux\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205233    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-host\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205345    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-systemd\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205370    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-host\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205385    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/14a578da-3b6c-4aa2-b15a-1101728a92e0-cni-binary-copy\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205418    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysctl-conf\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205452    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-netns\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205504    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-slash\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205525    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-sysctl-conf\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93721cdf-fcd3-43ab-9905-44589865da03-hosts-file\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205547    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-host-run-netns\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205561    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-registration-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.207204 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205584    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-kubernetes\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205606    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-cnibin\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205629    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnr7w\" (UniqueName: \"kubernetes.io/projected/14a578da-3b6c-4aa2-b15a-1101728a92e0-kube-api-access-pnr7w\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205654    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-node-log\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205666    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-kubernetes\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205678    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205678    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/14a578da-3b6c-4aa2-b15a-1101728a92e0-cnibin\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205715    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/88824c83-fdfd-4848-80f9-21ecefd09afc-konnectivity-ca\") pod \"konnectivity-agent-p26p6\" (UID: \"88824c83-fdfd-4848-80f9-21ecefd09afc\") " pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.205768    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-registration-dir\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.206597    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/665cd891-e040-4fd1-93de-dacf099fb8aa-etc-tuned\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.206790    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/665cd891-e040-4fd1-93de-dacf099fb8aa-tmp\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.208095 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.206812    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/88824c83-fdfd-4848-80f9-21ecefd09afc-agent-certs\") pod \"konnectivity-agent-p26p6\" (UID: \"88824c83-fdfd-4848-80f9-21ecefd09afc\") " pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.210302 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.210282    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dndj\" (UniqueName: \"kubernetes.io/projected/665cd891-e040-4fd1-93de-dacf099fb8aa-kube-api-access-7dndj\") pod \"tuned-clq87\" (UID: \"665cd891-e040-4fd1-93de-dacf099fb8aa\") " pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.211644 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.211620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxn9h\" (UniqueName: \"kubernetes.io/projected/55deabcc-08f8-4acc-b4f7-f1f690bd2f43-kube-api-access-mxn9h\") pod \"aws-ebs-csi-driver-node-9hcrp\" (UID: \"55deabcc-08f8-4acc-b4f7-f1f690bd2f43\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.212429 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.212405    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnr7w\" (UniqueName: \"kubernetes.io/projected/14a578da-3b6c-4aa2-b15a-1101728a92e0-kube-api-access-pnr7w\") pod \"multus-4cbtr\" (UID: \"14a578da-3b6c-4aa2-b15a-1101728a92e0\") " pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.306938 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.306909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-run-ovn-kubernetes\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.306938 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.306943    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-env-overrides\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.306962    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x5qq\" (UniqueName: \"kubernetes.io/projected/3e473320-d049-4a4a-861d-5030c95cad11-kube-api-access-4x5qq\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.306985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnkqv\" (UniqueName: \"kubernetes.io/projected/93721cdf-fcd3-43ab-9905-44589865da03-kube-api-access-xnkqv\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307013    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-run-ovn-kubernetes\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307066    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-host-slash\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307107    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovn-node-metrics-cert\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307131    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-iptables-alerter-script\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307142    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-host-slash\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307185    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-run-netns\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovnkube-script-lib\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-os-release\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307535    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-os-release\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307559    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-env-overrides\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307605 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307564    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-run-netns\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6trld\" (UniqueName: \"kubernetes.io/projected/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-kube-api-access-6trld\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307659    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64c09dc-1acf-458e-896b-19525dc2d3db-serviceca\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307683    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93721cdf-fcd3-43ab-9905-44589865da03-tmp-dir\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307707    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-system-cni-dir\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307725    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-iptables-alerter-script\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307731    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cnibin\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307739    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovnkube-script-lib\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307764    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cnibin\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307766    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-ovn\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307799    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-var-lib-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307816    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.307869 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307824    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g6sj5\" (UniqueName: \"kubernetes.io/projected/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-kube-api-access-g6sj5\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307874    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-var-lib-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307800    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-ovn\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307844    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-system-cni-dir\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.307993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-kubelet\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308021    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/93721cdf-fcd3-43ab-9905-44589865da03-tmp-dir\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308028    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308064    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cni-binary-copy\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308066    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308088    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b64c09dc-1acf-458e-896b-19525dc2d3db-serviceca\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308097    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8b4f5\" (UniqueName: \"kubernetes.io/projected/b64c09dc-1acf-458e-896b-19525dc2d3db-kube-api-access-8b4f5\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308111    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-kubelet\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308181    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64c09dc-1acf-458e-896b-19525dc2d3db-host\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308252    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-systemd-units\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.308264    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308277    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovnkube-config\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.308426 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308280    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-tuning-conf-dir\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308304    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-etc-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308336    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-systemd-units\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.308355    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret podName:a93364a5-e951-4b4d-bb08-cd1d597fc638 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:40.808316034 +0000 UTC m=+3.069285726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret") pod "global-pull-secret-syncer-kpdmj" (UID: "a93364a5-e951-4b4d-bb08-cd1d597fc638") : object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308359    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-etc-openvswitch\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308377    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b64c09dc-1acf-458e-896b-19525dc2d3db-host\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308377    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kqpx5\" (UniqueName: \"kubernetes.io/projected/35d8561b-5c94-4fc5-bea5-a5af2335e26e-kube-api-access-kqpx5\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308422    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308454    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-systemd\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308477    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-slash\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308500    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93721cdf-fcd3-43ab-9905-44589865da03-hosts-file\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308530    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-node-log\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308556    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308572    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-run-systemd\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308580    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-log-socket\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308597    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/93721cdf-fcd3-43ab-9905-44589865da03-hosts-file\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308556    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-cni-binary-copy\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.309217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308629    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-slash\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308637    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-cni-bin\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308650    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-log-socket\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308676    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-node-log\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308677    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308690    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-cni-bin\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308723    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-cni-netd\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308749    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a93364a5-e951-4b4d-bb08-cd1d597fc638-kubelet-config\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308779    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.308797    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308807    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a93364a5-e951-4b4d-bb08-cd1d597fc638-dbus\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308834    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-cni-netd\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.308844    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:40.808827046 +0000 UTC m=+3.069796726 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308809    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovnkube-config\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308870    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/35d8561b-5c94-4fc5-bea5-a5af2335e26e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308885    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/a93364a5-e951-4b4d-bb08-cd1d597fc638-kubelet-config\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.308995    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/a93364a5-e951-4b4d-bb08-cd1d597fc638-dbus\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.309833 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.309824    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/35d8561b-5c94-4fc5-bea5-a5af2335e26e-ovn-node-metrics-cert\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.310460 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.309916    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.313972 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.313951    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 19:59:40.314086 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.313977    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 19:59:40.314086 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.313990    2578 projected.go:196] Error preparing data for projected volume kube-api-access-bfxbv for pod openshift-network-diagnostics/network-check-target-8jlh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:40.314086 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.314056    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv podName:31a5dabe-c19e-4b76-8fac-52c7efc01c27 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:40.814039684 +0000 UTC m=+3.075009369 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bfxbv" (UniqueName: "kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv") pod "network-check-target-8jlh7" (UID: "31a5dabe-c19e-4b76-8fac-52c7efc01c27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:40.315217 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.315190    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x5qq\" (UniqueName: \"kubernetes.io/projected/3e473320-d049-4a4a-861d-5030c95cad11-kube-api-access-4x5qq\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:40.315327 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.315300    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g6sj5\" (UniqueName: \"kubernetes.io/projected/f8251b5d-057b-4b59-8bc4-ae7df5cacdc6-kube-api-access-g6sj5\") pod \"iptables-alerter-vq8w4\" (UID: \"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6\") " pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.315863 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.315821    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnkqv\" (UniqueName: \"kubernetes.io/projected/93721cdf-fcd3-43ab-9905-44589865da03-kube-api-access-xnkqv\") pod \"node-resolver-44nqh\" (UID: \"93721cdf-fcd3-43ab-9905-44589865da03\") " pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.316390 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.316343    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8b4f5\" (UniqueName: \"kubernetes.io/projected/b64c09dc-1acf-458e-896b-19525dc2d3db-kube-api-access-8b4f5\") pod \"node-ca-jv5hf\" (UID: \"b64c09dc-1acf-458e-896b-19525dc2d3db\") " pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.316750 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.316729    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6trld\" (UniqueName: \"kubernetes.io/projected/53bb24bc-a3f3-4bb4-bf39-96213dcd51de-kube-api-access-6trld\") pod \"multus-additional-cni-plugins-fp57l\" (UID: \"53bb24bc-a3f3-4bb4-bf39-96213dcd51de\") " pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.316820 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.316800    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kqpx5\" (UniqueName: \"kubernetes.io/projected/35d8561b-5c94-4fc5-bea5-a5af2335e26e-kube-api-access-kqpx5\") pod \"ovnkube-node-fz8t6\" (UID: \"35d8561b-5c94-4fc5-bea5-a5af2335e26e\") " pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.397887 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.397796    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp"
Jun 10 19:59:40.405405 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.405378    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-clq87"
Jun 10 19:59:40.417944 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.417924    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-p26p6"
Jun 10 19:59:40.421543 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.421522    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-4cbtr"
Jun 10 19:59:40.428045 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.428028    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-vq8w4"
Jun 10 19:59:40.434728 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.434711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-fp57l"
Jun 10 19:59:40.441532 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.441512    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 19:59:40.448148 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.448126    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jv5hf"
Jun 10 19:59:40.453716 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.453698    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-44nqh"
Jun 10 19:59:40.535463 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.535429    2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 10 19:59:40.813094 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.813012    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:40.813094 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.813060    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:40.813308 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.813163    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:40.813308 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.813172    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:40.813308 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.813215    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:41.813200697 +0000 UTC m=+4.074170367 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:40.813308 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.813238    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret podName:a93364a5-e951-4b4d-bb08-cd1d597fc638 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:41.813222259 +0000 UTC m=+4.074191935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret") pod "global-pull-secret-syncer-kpdmj" (UID: "a93364a5-e951-4b4d-bb08-cd1d597fc638") : object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:40.900955 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.900836    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53bb24bc_a3f3_4bb4_bf39_96213dcd51de.slice/crio-cc89c22adf3d9d341515f4fc4bd15d22b03a9d6bdedca7c8d8b456017f9753d6 WatchSource:0}: Error finding container cc89c22adf3d9d341515f4fc4bd15d22b03a9d6bdedca7c8d8b456017f9753d6: Status 404 returned error can't find the container with id cc89c22adf3d9d341515f4fc4bd15d22b03a9d6bdedca7c8d8b456017f9753d6
Jun 10 19:59:40.902286 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.902248    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88824c83_fdfd_4848_80f9_21ecefd09afc.slice/crio-8129027074a9472f1b1cf3ac453278a4fe73216328ae09c56d026343ba11533b WatchSource:0}: Error finding container 8129027074a9472f1b1cf3ac453278a4fe73216328ae09c56d026343ba11533b: Status 404 returned error can't find the container with id 8129027074a9472f1b1cf3ac453278a4fe73216328ae09c56d026343ba11533b
Jun 10 19:59:40.903197 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.903176    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14a578da_3b6c_4aa2_b15a_1101728a92e0.slice/crio-088c8c13938c9366dde3cda5a73588f6c25cd4e5d6cf9cc5fb5350e99180feb4 WatchSource:0}: Error finding container 088c8c13938c9366dde3cda5a73588f6c25cd4e5d6cf9cc5fb5350e99180feb4: Status 404 returned error can't find the container with id 088c8c13938c9366dde3cda5a73588f6c25cd4e5d6cf9cc5fb5350e99180feb4
Jun 10 19:59:40.906908 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.906840    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93721cdf_fcd3_43ab_9905_44589865da03.slice/crio-670451dbf66409d399053f30098995e195e0473cfcf64494a8886af11b97d741 WatchSource:0}: Error finding container 670451dbf66409d399053f30098995e195e0473cfcf64494a8886af11b97d741: Status 404 returned error can't find the container with id 670451dbf66409d399053f30098995e195e0473cfcf64494a8886af11b97d741
Jun 10 19:59:40.907715 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.907683    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55deabcc_08f8_4acc_b4f7_f1f690bd2f43.slice/crio-884d5152a9995c9d80cfd29ed5a57235935fe666b016ed769c488d60f8bba53c WatchSource:0}: Error finding container 884d5152a9995c9d80cfd29ed5a57235935fe666b016ed769c488d60f8bba53c: Status 404 returned error can't find the container with id 884d5152a9995c9d80cfd29ed5a57235935fe666b016ed769c488d60f8bba53c
Jun 10 19:59:40.910042 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.910019    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35d8561b_5c94_4fc5_bea5_a5af2335e26e.slice/crio-7eb38808aa9349e8f0876cfd5ae50e1e6fb6aeb64583ed1f92113ec9f90a3457 WatchSource:0}: Error finding container 7eb38808aa9349e8f0876cfd5ae50e1e6fb6aeb64583ed1f92113ec9f90a3457: Status 404 returned error can't find the container with id 7eb38808aa9349e8f0876cfd5ae50e1e6fb6aeb64583ed1f92113ec9f90a3457
Jun 10 19:59:40.913524 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:40.913503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:40.913632 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.913620    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 19:59:40.913667 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.913636    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 19:59:40.913667 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.913645    2578 projected.go:196] Error preparing data for projected volume kube-api-access-bfxbv for pod openshift-network-diagnostics/network-check-target-8jlh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:40.913729 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:40.913687    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv podName:31a5dabe-c19e-4b76-8fac-52c7efc01c27 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:41.913672779 +0000 UTC m=+4.174642452 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfxbv" (UniqueName: "kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv") pod "network-check-target-8jlh7" (UID: "31a5dabe-c19e-4b76-8fac-52c7efc01c27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:40.933325 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.933299    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb64c09dc_1acf_458e_896b_19525dc2d3db.slice/crio-15db264e95802bd916c135ce232d0cf810e9168b97ccb4f3a8b5061f87933e70 WatchSource:0}: Error finding container 15db264e95802bd916c135ce232d0cf810e9168b97ccb4f3a8b5061f87933e70: Status 404 returned error can't find the container with id 15db264e95802bd916c135ce232d0cf810e9168b97ccb4f3a8b5061f87933e70
Jun 10 19:59:40.933952 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.933884    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod665cd891_e040_4fd1_93de_dacf099fb8aa.slice/crio-ce6cb5413c0c1bdb8b9f30558ecff46c3e186f511b0b4792c32d8307d9ddca44 WatchSource:0}: Error finding container ce6cb5413c0c1bdb8b9f30558ecff46c3e186f511b0b4792c32d8307d9ddca44: Status 404 returned error can't find the container with id ce6cb5413c0c1bdb8b9f30558ecff46c3e186f511b0b4792c32d8307d9ddca44
Jun 10 19:59:40.935747 ip-10-0-137-191 kubenswrapper[2578]: W0610 19:59:40.935728    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8251b5d_057b_4b59_8bc4_ae7df5cacdc6.slice/crio-0d0df5cad9205bcc438fe7ffeef2cf369fd5cfe722e6f3e60ada2aa43934aa4e WatchSource:0}: Error finding container 0d0df5cad9205bcc438fe7ffeef2cf369fd5cfe722e6f3e60ada2aa43934aa4e: Status 404 returned error can't find the container with id 0d0df5cad9205bcc438fe7ffeef2cf369fd5cfe722e6f3e60ada2aa43934aa4e
Jun 10 19:59:41.138469 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.138368    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 19:54:40 +0000 UTC" deadline="2027-11-23 09:07:29.319057539 +0000 UTC"
Jun 10 19:59:41.138469 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.138404    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12733h7m48.180658146s"
Jun 10 19:59:41.166910 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.166880    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p26p6" event={"ID":"88824c83-fdfd-4848-80f9-21ecefd09afc","Type":"ContainerStarted","Data":"8129027074a9472f1b1cf3ac453278a4fe73216328ae09c56d026343ba11533b"}
Jun 10 19:59:41.168063 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.168037    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vq8w4" event={"ID":"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6","Type":"ContainerStarted","Data":"0d0df5cad9205bcc438fe7ffeef2cf369fd5cfe722e6f3e60ada2aa43934aa4e"}
Jun 10 19:59:41.169306 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.169284    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"7eb38808aa9349e8f0876cfd5ae50e1e6fb6aeb64583ed1f92113ec9f90a3457"}
Jun 10 19:59:41.170435 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.170409    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44nqh" event={"ID":"93721cdf-fcd3-43ab-9905-44589865da03","Type":"ContainerStarted","Data":"670451dbf66409d399053f30098995e195e0473cfcf64494a8886af11b97d741"}
Jun 10 19:59:41.171648 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.171622    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4cbtr" event={"ID":"14a578da-3b6c-4aa2-b15a-1101728a92e0","Type":"ContainerStarted","Data":"088c8c13938c9366dde3cda5a73588f6c25cd4e5d6cf9cc5fb5350e99180feb4"}
Jun 10 19:59:41.172830 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.172809    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerStarted","Data":"cc89c22adf3d9d341515f4fc4bd15d22b03a9d6bdedca7c8d8b456017f9753d6"}
Jun 10 19:59:41.174760 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.174738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal" event={"ID":"128321a9fc1dae510aeba8d7ac9882bb","Type":"ContainerStarted","Data":"23662c6b6c5fef34a863ed90ff8d38677ab03414cd65610f5666dc1f8a279efc"}
Jun 10 19:59:41.175900 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.175873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-clq87" event={"ID":"665cd891-e040-4fd1-93de-dacf099fb8aa","Type":"ContainerStarted","Data":"ce6cb5413c0c1bdb8b9f30558ecff46c3e186f511b0b4792c32d8307d9ddca44"}
Jun 10 19:59:41.176813 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.176787    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv5hf" event={"ID":"b64c09dc-1acf-458e-896b-19525dc2d3db","Type":"ContainerStarted","Data":"15db264e95802bd916c135ce232d0cf810e9168b97ccb4f3a8b5061f87933e70"}
Jun 10 19:59:41.177809 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.177790    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp" event={"ID":"55deabcc-08f8-4acc-b4f7-f1f690bd2f43","Type":"ContainerStarted","Data":"884d5152a9995c9d80cfd29ed5a57235935fe666b016ed769c488d60f8bba53c"}
Jun 10 19:59:41.822406 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.822354    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:41.822596 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.822426    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:41.822596 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.822561    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:41.822596 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.822570    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:41.822756 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.822630    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:43.822610479 +0000 UTC m=+6.083580156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:41.822756 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.822650    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret podName:a93364a5-e951-4b4d-bb08-cd1d597fc638 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:43.822640518 +0000 UTC m=+6.083610189 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret") pod "global-pull-secret-syncer-kpdmj" (UID: "a93364a5-e951-4b4d-bb08-cd1d597fc638") : object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:41.923018 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:41.922979    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:41.923186 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.923143    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 19:59:41.923186 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.923161    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 19:59:41.923186 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.923174    2578 projected.go:196] Error preparing data for projected volume kube-api-access-bfxbv for pod openshift-network-diagnostics/network-check-target-8jlh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:41.923340 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:41.923233    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv podName:31a5dabe-c19e-4b76-8fac-52c7efc01c27 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:43.923214361 +0000 UTC m=+6.184184034 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfxbv" (UniqueName: "kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv") pod "network-check-target-8jlh7" (UID: "31a5dabe-c19e-4b76-8fac-52c7efc01c27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:42.139375 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.139267    2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-09 19:54:40 +0000 UTC" deadline="2028-01-05 22:40:34.304683131 +0000 UTC"
Jun 10 19:59:42.139375 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.139327    2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13778h40m52.165360106s"
Jun 10 19:59:42.159976 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.159953    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:42.160111 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:42.160068    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:42.160452 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.160434    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:42.160554 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:42.160535    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:42.160947 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.160930    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:42.161041 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:42.161022    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:42.188618 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.188590    2578 generic.go:356] "Generic (PLEG): container finished" podID="ac73683d94ef66a50df357decd5997e2" containerID="634bf803d99d74a8d8043dec41ed3f838a617dbcca1693763fd78c856a11c23e" exitCode=0
Jun 10 19:59:42.189457 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.189430    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal" event={"ID":"ac73683d94ef66a50df357decd5997e2","Type":"ContainerDied","Data":"634bf803d99d74a8d8043dec41ed3f838a617dbcca1693763fd78c856a11c23e"}
Jun 10 19:59:42.202898 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:42.202839    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-191.ec2.internal" podStartSLOduration=3.202821385 podStartE2EDuration="3.202821385s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:41.187382258 +0000 UTC m=+3.448351973" watchObservedRunningTime="2026-06-10 19:59:42.202821385 +0000 UTC m=+4.463791078"
Jun 10 19:59:43.202546 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:43.202510    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal" event={"ID":"ac73683d94ef66a50df357decd5997e2","Type":"ContainerStarted","Data":"fef8d0fd5780841a1995923544be869fcdba4ef0b49f330da14d82407da5053d"}
Jun 10 19:59:43.220891 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:43.220821    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-191.ec2.internal" podStartSLOduration=4.220802378 podStartE2EDuration="4.220802378s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 19:59:43.220193851 +0000 UTC m=+5.481163542" watchObservedRunningTime="2026-06-10 19:59:43.220802378 +0000 UTC m=+5.481772067"
Jun 10 19:59:43.840161 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:43.840119    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:43.840340 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:43.840178    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:43.840340 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.840293    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:43.840435 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.840354    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:47.840334482 +0000 UTC m=+10.101304154 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:43.840742 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.840722    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:43.840804 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.840776    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret podName:a93364a5-e951-4b4d-bb08-cd1d597fc638 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:47.840761279 +0000 UTC m=+10.101730955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret") pod "global-pull-secret-syncer-kpdmj" (UID: "a93364a5-e951-4b4d-bb08-cd1d597fc638") : object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:43.940832 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:43.940789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:43.941011 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.940962    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 19:59:43.941011 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.940984    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 19:59:43.941011 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.940996    2578 projected.go:196] Error preparing data for projected volume kube-api-access-bfxbv for pod openshift-network-diagnostics/network-check-target-8jlh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:43.941141 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:43.941054    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv podName:31a5dabe-c19e-4b76-8fac-52c7efc01c27 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:47.941035635 +0000 UTC m=+10.202005322 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfxbv" (UniqueName: "kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv") pod "network-check-target-8jlh7" (UID: "31a5dabe-c19e-4b76-8fac-52c7efc01c27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:44.157457 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:44.157377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:44.157611 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:44.157525    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:44.157923 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:44.157903    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:44.158020 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:44.158001    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:44.158139 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:44.158125    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:44.158233 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:44.158214    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:46.158345 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:46.158311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:46.158777 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:46.158448    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:46.158901 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:46.158882    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:46.159006 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:46.158985    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:46.159328 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:46.159151    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:46.159328 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:46.159262    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:47.873141 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:47.873095    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:47.873560 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:47.873165    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:47.873560 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.873268    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:47.873560 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.873271    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:47.873560 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.873336    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:55.87331724 +0000 UTC m=+18.134286918 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:47.873560 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.873356    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret podName:a93364a5-e951-4b4d-bb08-cd1d597fc638 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:55.873347283 +0000 UTC m=+18.134316956 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret") pod "global-pull-secret-syncer-kpdmj" (UID: "a93364a5-e951-4b4d-bb08-cd1d597fc638") : object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:47.974185 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:47.974140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:47.974366 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.974273    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 19:59:47.974366 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.974287    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 19:59:47.974366 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.974296    2578 projected.go:196] Error preparing data for projected volume kube-api-access-bfxbv for pod openshift-network-diagnostics/network-check-target-8jlh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:47.974366 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:47.974341    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv podName:31a5dabe-c19e-4b76-8fac-52c7efc01c27 nodeName:}" failed. No retries permitted until 2026-06-10 19:59:55.974328496 +0000 UTC m=+18.235298166 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfxbv" (UniqueName: "kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv") pod "network-check-target-8jlh7" (UID: "31a5dabe-c19e-4b76-8fac-52c7efc01c27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:48.161006 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:48.160928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:48.161154 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:48.161025    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:48.161154 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:48.161084    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:48.161154 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:48.161142    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:48.161329 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:48.161182    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:48.161329 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:48.161255    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:50.158289 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:50.157779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:50.158289 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:50.157779    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:50.158289 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:50.157922    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:50.158289 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:50.157934    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:50.158289 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:50.158018    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:50.158289 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:50.158097    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:52.157363 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:52.157316    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:52.157363 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:52.157352    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:52.157939 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:52.157323    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:52.157939 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:52.157448    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:52.157939 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:52.157550    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:52.157939 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:52.157650    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:54.157257 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:54.157213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:54.157257 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:54.157258    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:54.157844 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:54.157341    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:54.157844 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:54.157361    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:54.157844 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:54.157446    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:54.157844 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:54.157528    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:55.934947 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:55.934866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:55.934947 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:55.934932    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:55.935424 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:55.934960    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:55.935424 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:55.935020    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret podName:a93364a5-e951-4b4d-bb08-cd1d597fc638 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:11.935002309 +0000 UTC m=+34.195971995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret") pod "global-pull-secret-syncer-kpdmj" (UID: "a93364a5-e951-4b4d-bb08-cd1d597fc638") : object "kube-system"/"original-pull-secret" not registered
Jun 10 19:59:55.935424 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:55.935061    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:55.935424 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:55.935108    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:11.935087635 +0000 UTC m=+34.196057318 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 19:59:56.035355 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:56.035324    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:56.035527 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:56.035464    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 19:59:56.035527 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:56.035481    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 19:59:56.035527 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:56.035493    2578 projected.go:196] Error preparing data for projected volume kube-api-access-bfxbv for pod openshift-network-diagnostics/network-check-target-8jlh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:56.035699 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:56.035558    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv podName:31a5dabe-c19e-4b76-8fac-52c7efc01c27 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:12.035540185 +0000 UTC m=+34.296509881 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfxbv" (UniqueName: "kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv") pod "network-check-target-8jlh7" (UID: "31a5dabe-c19e-4b76-8fac-52c7efc01c27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 19:59:56.157596 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:56.157554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:56.157779 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:56.157554    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:56.157779 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:56.157689    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 19:59:56.157779 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:56.157573    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:56.157978 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:56.157768    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:56.157978 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:56.157883    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:58.159034 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:58.159003    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 19:59:58.159034 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:58.159026    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 19:59:58.159542 ip-10-0-137-191 kubenswrapper[2578]: I0610 19:59:58.159099    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 19:59:58.159542 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:58.159172    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 19:59:58.159542 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:58.159359    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 19:59:58.159542 ip-10-0-137-191 kubenswrapper[2578]: E0610 19:59:58.159402    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:00.157451 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.157318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:00.158122 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.157318    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:00.158122 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.157377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:00.158122 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:00.157562    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 20:00:00.158122 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:00.157668    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:00.158122 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:00.157744    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:00.237423 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.237393    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jv5hf" event={"ID":"b64c09dc-1acf-458e-896b-19525dc2d3db","Type":"ContainerStarted","Data":"3770f41048c7805aa532dbd7c1e6c7b811a089ff7f08b8b5bc8e2d1bee74e5c2"}
Jun 10 20:00:00.238964 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.238938    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp" event={"ID":"55deabcc-08f8-4acc-b4f7-f1f690bd2f43","Type":"ContainerStarted","Data":"f93c5458b5aafc21597d349da1bad72a019ff79360def274336f4836cbc0a1e0"}
Jun 10 20:00:00.240677 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.240650    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-p26p6" event={"ID":"88824c83-fdfd-4848-80f9-21ecefd09afc","Type":"ContainerStarted","Data":"a6d3ffd5f679dbeeaf960ba6fd8dfb225859469c94e18a8733fed59f1fbbb9c9"}
Jun 10 20:00:00.245662 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.245642    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:00:00.245993 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.245971    2578 generic.go:356] "Generic (PLEG): container finished" podID="35d8561b-5c94-4fc5-bea5-a5af2335e26e" containerID="4cd44c9c81c0e3ca2096db5f7d7f62f82d846b00f75ccca196e50aa4dceb4253" exitCode=1
Jun 10 20:00:00.246079 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.246040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"aa77cfba4112007a58089379be4e7e8152bc78d652105e54712ce0033816c908"}
Jun 10 20:00:00.246152 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.246138    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"abc8c2e13d7bc85a99d85f8487b19219c12957b24a39349a6bd3c7d07a66438a"}
Jun 10 20:00:00.246209 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.246176    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"995cc6ad16b22eee1c6eb82659072ac4556f96f1dff33f4cadb6856ae017d471"}
Jun 10 20:00:00.246257 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.246210    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerDied","Data":"4cd44c9c81c0e3ca2096db5f7d7f62f82d846b00f75ccca196e50aa4dceb4253"}
Jun 10 20:00:00.246257 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.246241    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"eb560c501e14c72af5ae0033c7cfe0848ba074c5724fa148902ae94f433cd16c"}
Jun 10 20:00:00.247455 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.247429    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-44nqh" event={"ID":"93721cdf-fcd3-43ab-9905-44589865da03","Type":"ContainerStarted","Data":"aade48699c3916a134ad878be021ce927580d11396e9ff8685338ee1d3ea1616"}
Jun 10 20:00:00.248777 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.248751    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-4cbtr" event={"ID":"14a578da-3b6c-4aa2-b15a-1101728a92e0","Type":"ContainerStarted","Data":"e8db00891e22351565e90d957e62d690f456994331b26677ec60f9f551e461b9"}
Jun 10 20:00:00.250281 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.250115    2578 generic.go:356] "Generic (PLEG): container finished" podID="53bb24bc-a3f3-4bb4-bf39-96213dcd51de" containerID="5175d850bffc4b0d588726db822b107a6c9f406421f7fae903eed228b1193108" exitCode=0
Jun 10 20:00:00.250281 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.250192    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerDied","Data":"5175d850bffc4b0d588726db822b107a6c9f406421f7fae903eed228b1193108"}
Jun 10 20:00:00.251654 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.251627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-clq87" event={"ID":"665cd891-e040-4fd1-93de-dacf099fb8aa","Type":"ContainerStarted","Data":"ab3f076db1393363448ece9f54f006fe668ae793df904643e1c12a9b9509deb1"}
Jun 10 20:00:00.252015 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.251982    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jv5hf" podStartSLOduration=3.556119765 podStartE2EDuration="22.251970592s" totalImagesPullingTime="18.695850827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:00.251203697 +0000 UTC m=+22.512173389" watchObservedRunningTime="2026-06-10 20:00:00.251970592 +0000 UTC m=+22.512940317"
Jun 10 20:00:00.264811 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.264776    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-44nqh" podStartSLOduration=3.542953494 podStartE2EDuration="22.264765252s" totalImagesPullingTime="18.721811758s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:00.26436499 +0000 UTC m=+22.525334684" watchObservedRunningTime="2026-06-10 20:00:00.264765252 +0000 UTC m=+22.525734943"
Jun 10 20:00:00.278094 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.278061    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-p26p6" podStartSLOduration=7.725604647 podStartE2EDuration="22.278048592s" totalImagesPullingTime="14.552443945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:00.277825908 +0000 UTC m=+22.538795602" watchObservedRunningTime="2026-06-10 20:00:00.278048592 +0000 UTC m=+22.539018280"
Jun 10 20:00:00.295100 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.295062    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-4cbtr" podStartSLOduration=3.520339384 podStartE2EDuration="22.295048631s" totalImagesPullingTime="18.774709247s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:00.294666737 +0000 UTC m=+22.555636428" watchObservedRunningTime="2026-06-10 20:00:00.295048631 +0000 UTC m=+22.556018323"
Jun 10 20:00:00.331846 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:00.331790    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-clq87" podStartSLOduration=3.636031767 podStartE2EDuration="22.331775296s" totalImagesPullingTime="18.695743529s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:00.331353451 +0000 UTC m=+22.592323142" watchObservedRunningTime="2026-06-10 20:00:00.331775296 +0000 UTC m=+22.592744989"
Jun 10 20:00:01.134667 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.134637    2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 10 20:00:01.158540 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.158443    2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-10T20:00:01.134660249Z","UUID":"4cb10a43-7f86-427d-b6aa-9aad13f9ddc6","Handler":null,"Name":"","Endpoint":""}
Jun 10 20:00:01.160233 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.160212    2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 10 20:00:01.160337 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.160252    2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 10 20:00:01.256419 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.256329    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp" event={"ID":"55deabcc-08f8-4acc-b4f7-f1f690bd2f43","Type":"ContainerStarted","Data":"92d3f4dc253f1e7039caa78cf704fe3dfb07c35f2afcf982c43efcd3db0b427b"}
Jun 10 20:00:01.257903 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.257876    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-vq8w4" event={"ID":"f8251b5d-057b-4b59-8bc4-ae7df5cacdc6","Type":"ContainerStarted","Data":"24333a31d75b2ac039f1121fc897d41b0d25c362891d085f6b2a69c891ec42cc"}
Jun 10 20:00:01.261058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.261035    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:00:01.261521 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.261494    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"06fabe88c25d217d7476f6a5ac20e6ddcdfac4a9a717e857c0ee30daf1a8d0e5"}
Jun 10 20:00:01.271480 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:01.271431    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-vq8w4" podStartSLOduration=4.5792391630000004 podStartE2EDuration="23.271411715s" totalImagesPullingTime="18.692172552s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:01.271081401 +0000 UTC m=+23.532051092" watchObservedRunningTime="2026-06-10 20:00:01.271411715 +0000 UTC m=+23.532381408"
Jun 10 20:00:02.157540 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:02.157508    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:02.157692 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:02.157544    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:02.157692 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:02.157522    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:02.157692 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:02.157615    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 20:00:02.157811 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:02.157693    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:02.157811 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:02.157763    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:03.213347 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.213315    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-p26p6"
Jun 10 20:00:03.213979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.213959    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-p26p6"
Jun 10 20:00:03.269055 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.269017    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp" event={"ID":"55deabcc-08f8-4acc-b4f7-f1f690bd2f43","Type":"ContainerStarted","Data":"488c273ba837022b3598f346da611f5c68eda4cb96dadedb021a20ad263879b5"}
Jun 10 20:00:03.272449 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.272429    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:00:03.272879 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.272826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"740602103aced9d19013ca7bcc84de34623bd8e216427c0cd3407c1ce0a82ad9"}
Jun 10 20:00:03.273107 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.273084    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-p26p6"
Jun 10 20:00:03.273536 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.273521    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-p26p6"
Jun 10 20:00:03.305391 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:03.305341    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-9hcrp" podStartSLOduration=4.428303768 podStartE2EDuration="25.305324711s" totalImagesPullingTime="20.877020943s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:03.287095028 +0000 UTC m=+25.548064719" watchObservedRunningTime="2026-06-10 20:00:03.305324711 +0000 UTC m=+25.566294402"
Jun 10 20:00:04.158346 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:04.158116    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:04.158525 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:04.158116    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:04.158525 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:04.158454    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:04.158525 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:04.158148    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:04.158525 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:04.158509    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:04.158724 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:04.158585    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 20:00:05.281420 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.281164    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:00:05.282210 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.281713    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"693a8043604da8c24c6cb7d4812e74f622ed706a8416e98bc1106b3914d8dd7e"}
Jun 10 20:00:05.282210 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.281981    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 20:00:05.282210 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.282051    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 20:00:05.282328 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.282243    2578 scope.go:117] "RemoveContainer" containerID="4cd44c9c81c0e3ca2096db5f7d7f62f82d846b00f75ccca196e50aa4dceb4253"
Jun 10 20:00:05.283680 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.283656    2578 generic.go:356] "Generic (PLEG): container finished" podID="53bb24bc-a3f3-4bb4-bf39-96213dcd51de" containerID="0ee5db08b17dd7114a6b05b3f3faf45f96dd625158581a685aa49e4ca0aa64a2" exitCode=0
Jun 10 20:00:05.283792 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.283761    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerDied","Data":"0ee5db08b17dd7114a6b05b3f3faf45f96dd625158581a685aa49e4ca0aa64a2"}
Jun 10 20:00:05.298826 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:05.298801    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 20:00:06.160624 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.160588    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:06.160795 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.160688    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:06.160795 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:06.160696    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:06.160795 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.160717    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:06.160969 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:06.160808    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:06.160969 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:06.160917    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 20:00:06.292728 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.292658    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:00:06.293142 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.293079    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" event={"ID":"35d8561b-5c94-4fc5-bea5-a5af2335e26e","Type":"ContainerStarted","Data":"1af199ec4c95114258ca80aecc6f761e666d511135cc796f0b04db0f87ed38d9"}
Jun 10 20:00:06.293374 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.293354    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 20:00:06.295393 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.295371    2578 generic.go:356] "Generic (PLEG): container finished" podID="53bb24bc-a3f3-4bb4-bf39-96213dcd51de" containerID="40f38b97e1464b1205ca5b1c0238a99bc52e012173a320ba328925697fcf896c" exitCode=0
Jun 10 20:00:06.295501 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.295400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerDied","Data":"40f38b97e1464b1205ca5b1c0238a99bc52e012173a320ba328925697fcf896c"}
Jun 10 20:00:06.308840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.308818    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 20:00:06.321296 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.321252    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6" podStartSLOduration=9.587276059 podStartE2EDuration="28.321234538s" totalImagesPullingTime="18.733958479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:06.319721574 +0000 UTC m=+28.580691267" watchObservedRunningTime="2026-06-10 20:00:06.321234538 +0000 UTC m=+28.582204259"
Jun 10 20:00:06.818246 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.818213    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8jlh7"]
Jun 10 20:00:06.818403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.818351    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:06.818514 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:06.818485    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:06.819767 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.819739    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpdmj"]
Jun 10 20:00:06.819909 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.819863    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:06.820005 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:06.819970    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 20:00:06.820587 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.820568    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shvsb"]
Jun 10 20:00:06.820684 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:06.820664    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:06.820784 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:06.820761    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:07.299831 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:07.299800    2578 generic.go:356] "Generic (PLEG): container finished" podID="53bb24bc-a3f3-4bb4-bf39-96213dcd51de" containerID="08c00847d990738a4634c70f1bd5045da54dfa18457ae5ac1831052feca138b7" exitCode=0
Jun 10 20:00:07.300214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:07.299895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerDied","Data":"08c00847d990738a4634c70f1bd5045da54dfa18457ae5ac1831052feca138b7"}
Jun 10 20:00:08.158178 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:08.158147    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:08.158353 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:08.158260    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:09.157925 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:09.157884    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:09.158424 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:09.157939    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:09.158424 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:09.158010    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:09.158424 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:09.158145    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 20:00:10.161085 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:10.160835    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:10.161448 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:10.161196    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:11.158079 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:11.158029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:11.158243 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:11.158148    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8jlh7" podUID="31a5dabe-c19e-4b76-8fac-52c7efc01c27"
Jun 10 20:00:11.158243 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:11.158199    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:11.158324 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:11.158290    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-kpdmj" podUID="a93364a5-e951-4b4d-bb08-cd1d597fc638"
Jun 10 20:00:11.953020 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:11.952929    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:11.953020 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:11.952984    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:11.953613 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:11.953074    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 20:00:11.953613 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:11.953082    2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jun 10 20:00:11.953613 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:11.953130    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:43.953115914 +0000 UTC m=+66.214085589 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 10 20:00:11.953613 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:11.953144    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret podName:a93364a5-e951-4b4d-bb08-cd1d597fc638 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:43.953137834 +0000 UTC m=+66.214107504 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret") pod "global-pull-secret-syncer-kpdmj" (UID: "a93364a5-e951-4b4d-bb08-cd1d597fc638") : object "kube-system"/"original-pull-secret" not registered
Jun 10 20:00:12.053762 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.053726    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:12.053936 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:12.053911    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 10 20:00:12.053936 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:12.053930    2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 10 20:00:12.054009 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:12.053939    2578 projected.go:196] Error preparing data for projected volume kube-api-access-bfxbv for pod openshift-network-diagnostics/network-check-target-8jlh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 20:00:12.054009 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:12.053993    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv podName:31a5dabe-c19e-4b76-8fac-52c7efc01c27 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:44.053976384 +0000 UTC m=+66.314946056 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bfxbv" (UniqueName: "kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv") pod "network-check-target-8jlh7" (UID: "31a5dabe-c19e-4b76-8fac-52c7efc01c27") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 10 20:00:12.158171 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.158145    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:12.167233 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:12.167204    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:00:12.317600 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.317559    2578 generic.go:356] "Generic (PLEG): container finished" podID="53bb24bc-a3f3-4bb4-bf39-96213dcd51de" containerID="6b144bf8dcca6d75120656e8c63851e4890cdfa71132c0ad4ae8129868517362" exitCode=0
Jun 10 20:00:12.317600 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.317597    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerDied","Data":"6b144bf8dcca6d75120656e8c63851e4890cdfa71132c0ad4ae8129868517362"}
Jun 10 20:00:12.595196 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.595171    2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-191.ec2.internal" event="NodeReady"
Jun 10 20:00:12.595365 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.595276    2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jun 10 20:00:12.673186 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.673160    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-hvwvn"]
Jun 10 20:00:12.685763 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.685744    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mlp2j"]
Jun 10 20:00:12.685913 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.685895    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.688949 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.688929    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jb7fp\""
Jun 10 20:00:12.689164 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.689146    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 10 20:00:12.689164 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.689161    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 10 20:00:12.698223 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.698192    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvwvn"]
Jun 10 20:00:12.698395 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.698292    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:12.699565 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.699540    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mlp2j"]
Jun 10 20:00:12.702548 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.702528    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 10 20:00:12.702668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.702588    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 10 20:00:12.702668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.702627    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hfchf\""
Jun 10 20:00:12.702778 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.702534    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 10 20:00:12.760477 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.760454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d6bf961-4890-45a4-9703-9f6afad50e86-config-volume\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.760591 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.760498    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.760591 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.760527    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8mdz\" (UniqueName: \"kubernetes.io/projected/1d6bf961-4890-45a4-9703-9f6afad50e86-kube-api-access-v8mdz\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.760669 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.760592    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d6bf961-4890-45a4-9703-9f6afad50e86-tmp-dir\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.861290 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861219    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8mdz\" (UniqueName: \"kubernetes.io/projected/1d6bf961-4890-45a4-9703-9f6afad50e86-kube-api-access-v8mdz\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.861290 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861267    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g2fdl\" (UniqueName: \"kubernetes.io/projected/eb1ff4e1-c35f-4c37-a044-53198f153956-kube-api-access-g2fdl\") pod \"ingress-canary-mlp2j\" (UID: \"eb1ff4e1-c35f-4c37-a044-53198f153956\") " pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:12.861482 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861391    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d6bf961-4890-45a4-9703-9f6afad50e86-tmp-dir\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.861482 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861439    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb1ff4e1-c35f-4c37-a044-53198f153956-cert\") pod \"ingress-canary-mlp2j\" (UID: \"eb1ff4e1-c35f-4c37-a044-53198f153956\") " pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:12.861482 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d6bf961-4890-45a4-9703-9f6afad50e86-config-volume\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.861614 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861503    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.861614 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:12.861594    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:00:12.861686 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:12.861642    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:13.361628419 +0000 UTC m=+35.622598089 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:00:12.861737 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861717    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1d6bf961-4890-45a4-9703-9f6afad50e86-tmp-dir\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.861961 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.861944    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1d6bf961-4890-45a4-9703-9f6afad50e86-config-volume\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.871567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.871549    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8mdz\" (UniqueName: \"kubernetes.io/projected/1d6bf961-4890-45a4-9703-9f6afad50e86-kube-api-access-v8mdz\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:12.962140 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.962115    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb1ff4e1-c35f-4c37-a044-53198f153956-cert\") pod \"ingress-canary-mlp2j\" (UID: \"eb1ff4e1-c35f-4c37-a044-53198f153956\") " pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:12.962545 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.962182    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g2fdl\" (UniqueName: \"kubernetes.io/projected/eb1ff4e1-c35f-4c37-a044-53198f153956-kube-api-access-g2fdl\") pod \"ingress-canary-mlp2j\" (UID: \"eb1ff4e1-c35f-4c37-a044-53198f153956\") " pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:12.964487 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.964469    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/eb1ff4e1-c35f-4c37-a044-53198f153956-cert\") pod \"ingress-canary-mlp2j\" (UID: \"eb1ff4e1-c35f-4c37-a044-53198f153956\") " pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:12.970190 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:12.970171    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g2fdl\" (UniqueName: \"kubernetes.io/projected/eb1ff4e1-c35f-4c37-a044-53198f153956-kube-api-access-g2fdl\") pod \"ingress-canary-mlp2j\" (UID: \"eb1ff4e1-c35f-4c37-a044-53198f153956\") " pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:13.007250 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.007231    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mlp2j"
Jun 10 20:00:13.158042 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.157872    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:13.158183 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.157933    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:13.160663 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.160640    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 20:00:13.162087 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.160646    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 20:00:13.162087 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.161032    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 20:00:13.162087 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.161675    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqgjk\""
Jun 10 20:00:13.178574 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.178551    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mlp2j"]
Jun 10 20:00:13.182195 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:00:13.182175    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb1ff4e1_c35f_4c37_a044_53198f153956.slice/crio-2d88666a5a8e83a54f6de1440aa3ded1de43f03edabe1117b12dde41e90422c2 WatchSource:0}: Error finding container 2d88666a5a8e83a54f6de1440aa3ded1de43f03edabe1117b12dde41e90422c2: Status 404 returned error can't find the container with id 2d88666a5a8e83a54f6de1440aa3ded1de43f03edabe1117b12dde41e90422c2
Jun 10 20:00:13.322808 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.322769    2578 generic.go:356] "Generic (PLEG): container finished" podID="53bb24bc-a3f3-4bb4-bf39-96213dcd51de" containerID="4b17d8e2400c5ee5a0021f17eb440e55e9b87b5483539525aa9d14e5b5a862f7" exitCode=0
Jun 10 20:00:13.323017 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.322868    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerDied","Data":"4b17d8e2400c5ee5a0021f17eb440e55e9b87b5483539525aa9d14e5b5a862f7"}
Jun 10 20:00:13.326084 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.326055    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mlp2j" event={"ID":"eb1ff4e1-c35f-4c37-a044-53198f153956","Type":"ContainerStarted","Data":"2d88666a5a8e83a54f6de1440aa3ded1de43f03edabe1117b12dde41e90422c2"}
Jun 10 20:00:13.365070 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:13.365036    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:13.365269 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:13.365217    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:00:13.365379 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:13.365290    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:14.36527386 +0000 UTC m=+36.626243535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:00:14.157602 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:14.157571    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:14.160297 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:14.160028    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5ggwg\""
Jun 10 20:00:14.160297 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:14.160026    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 20:00:14.333308 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:14.333240    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-fp57l" event={"ID":"53bb24bc-a3f3-4bb4-bf39-96213dcd51de","Type":"ContainerStarted","Data":"adc88247f91dfd358f38fb8cfcdcd9d6b8d721b125d581f35422c67a8b30998f"}
Jun 10 20:00:14.358253 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:14.358199    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-fp57l" podStartSLOduration=7.496833187 podStartE2EDuration="36.358180867s" totalImagesPullingTime="28.86134768s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:14.357378966 +0000 UTC m=+36.618348659" watchObservedRunningTime="2026-06-10 20:00:14.358180867 +0000 UTC m=+36.619150559"
Jun 10 20:00:14.372673 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:14.372640    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:14.372802 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:14.372744    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:00:14.372802 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:14.372796    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:16.372780751 +0000 UTC m=+38.633750421 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:00:15.337536 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:15.337490    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mlp2j" event={"ID":"eb1ff4e1-c35f-4c37-a044-53198f153956","Type":"ContainerStarted","Data":"926528f7b5abe059f7b4fd4d0e97734c9d3c1affb08be77b4fd62644a9f88c74"}
Jun 10 20:00:15.352811 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:15.352762    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mlp2j" podStartSLOduration=1.421086211 podStartE2EDuration="3.352746249s" totalImagesPullingTime="1.931660038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:15.351961759 +0000 UTC m=+37.612931452" watchObservedRunningTime="2026-06-10 20:00:15.352746249 +0000 UTC m=+37.613715941"
Jun 10 20:00:16.388714 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:16.388538    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:16.388714 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:16.388704    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:00:16.389107 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:16.388780    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:20.388757777 +0000 UTC m=+42.649727461 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:00:19.911049 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.911018    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"]
Jun 10 20:00:19.919103 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.919074    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:19.921749 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.921723    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jun 10 20:00:19.921902 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.921750    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jun 10 20:00:19.921902 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.921750    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jun 10 20:00:19.922682 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.922659    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-m5784\""
Jun 10 20:00:19.922796 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.922781    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jun 10 20:00:19.923683 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:19.923665    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"]
Jun 10 20:00:20.002289 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.002264    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"]
Jun 10 20:00:20.012749 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.012730    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnvh4\" (UniqueName: \"kubernetes.io/projected/daef2cb7-6983-4f31-96b8-d5831a884415-kube-api-access-mnvh4\") pod \"managed-serviceaccount-addon-agent-7f59648f88-pk6wc\" (UID: \"daef2cb7-6983-4f31-96b8-d5831a884415\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:20.012869 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.012777    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/daef2cb7-6983-4f31-96b8-d5831a884415-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f59648f88-pk6wc\" (UID: \"daef2cb7-6983-4f31-96b8-d5831a884415\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:20.016549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.016530    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"]
Jun 10 20:00:20.016635 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.016579    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.018899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.018881    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jun 10 20:00:20.113306 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.113282    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/daef2cb7-6983-4f31-96b8-d5831a884415-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f59648f88-pk6wc\" (UID: \"daef2cb7-6983-4f31-96b8-d5831a884415\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:20.113440 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.113323    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ce390345-db7a-48b8-b6cb-39966e914b04-klusterlet-config\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.113440 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.113356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5h62\" (UniqueName: \"kubernetes.io/projected/ce390345-db7a-48b8-b6cb-39966e914b04-kube-api-access-w5h62\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.113440 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.113397    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnvh4\" (UniqueName: \"kubernetes.io/projected/daef2cb7-6983-4f31-96b8-d5831a884415-kube-api-access-mnvh4\") pod \"managed-serviceaccount-addon-agent-7f59648f88-pk6wc\" (UID: \"daef2cb7-6983-4f31-96b8-d5831a884415\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:20.113440 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.113424    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce390345-db7a-48b8-b6cb-39966e914b04-tmp\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.121353 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.121329    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/daef2cb7-6983-4f31-96b8-d5831a884415-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-7f59648f88-pk6wc\" (UID: \"daef2cb7-6983-4f31-96b8-d5831a884415\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:20.134124 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.132165    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnvh4\" (UniqueName: \"kubernetes.io/projected/daef2cb7-6983-4f31-96b8-d5831a884415-kube-api-access-mnvh4\") pod \"managed-serviceaccount-addon-agent-7f59648f88-pk6wc\" (UID: \"daef2cb7-6983-4f31-96b8-d5831a884415\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:20.214327 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.214255    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ce390345-db7a-48b8-b6cb-39966e914b04-klusterlet-config\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.214327 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.214313    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5h62\" (UniqueName: \"kubernetes.io/projected/ce390345-db7a-48b8-b6cb-39966e914b04-kube-api-access-w5h62\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.214508 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.214360    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce390345-db7a-48b8-b6cb-39966e914b04-tmp\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.214759 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.214743    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ce390345-db7a-48b8-b6cb-39966e914b04-tmp\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.216763 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.216744    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/ce390345-db7a-48b8-b6cb-39966e914b04-klusterlet-config\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.223195 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.223168    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5h62\" (UniqueName: \"kubernetes.io/projected/ce390345-db7a-48b8-b6cb-39966e914b04-kube-api-access-w5h62\") pod \"klusterlet-addon-workmgr-c8f65fcfd-z9gvv\" (UID: \"ce390345-db7a-48b8-b6cb-39966e914b04\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.240952 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.240928    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:00:20.324928 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.324899    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:20.373712 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.373682    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"]
Jun 10 20:00:20.376813 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:00:20.376779    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddaef2cb7_6983_4f31_96b8_d5831a884415.slice/crio-5cdd55e38ae92dc30eb9c919c1da5dc8b12922cef1ab1ca961dc4f95ae7eebba WatchSource:0}: Error finding container 5cdd55e38ae92dc30eb9c919c1da5dc8b12922cef1ab1ca961dc4f95ae7eebba: Status 404 returned error can't find the container with id 5cdd55e38ae92dc30eb9c919c1da5dc8b12922cef1ab1ca961dc4f95ae7eebba
Jun 10 20:00:20.417044 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.416510    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:20.417044 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:20.416666    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:00:20.417044 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:20.416731    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:28.416709928 +0000 UTC m=+50.677679618 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:00:20.501225 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:20.501150    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"]
Jun 10 20:00:20.504536 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:00:20.504500    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce390345_db7a_48b8_b6cb_39966e914b04.slice/crio-3db8296aa1a131b1473c22acadc820e17f013d6dae0c972b8c5351b463ca34df WatchSource:0}: Error finding container 3db8296aa1a131b1473c22acadc820e17f013d6dae0c972b8c5351b463ca34df: Status 404 returned error can't find the container with id 3db8296aa1a131b1473c22acadc820e17f013d6dae0c972b8c5351b463ca34df
Jun 10 20:00:21.355268 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:21.355230    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" event={"ID":"ce390345-db7a-48b8-b6cb-39966e914b04","Type":"ContainerStarted","Data":"3db8296aa1a131b1473c22acadc820e17f013d6dae0c972b8c5351b463ca34df"}
Jun 10 20:00:21.356359 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:21.356337    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" event={"ID":"daef2cb7-6983-4f31-96b8-d5831a884415","Type":"ContainerStarted","Data":"5cdd55e38ae92dc30eb9c919c1da5dc8b12922cef1ab1ca961dc4f95ae7eebba"}
Jun 10 20:00:28.378738 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:28.378701    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" event={"ID":"ce390345-db7a-48b8-b6cb-39966e914b04","Type":"ContainerStarted","Data":"9c310175afc8926154caf5febb3d3626a917ecbadd897a64705a269b4e49a42e"}
Jun 10 20:00:28.379217 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:28.378894    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:28.380290 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:28.380259    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" event={"ID":"daef2cb7-6983-4f31-96b8-d5831a884415","Type":"ContainerStarted","Data":"a95a215a15c0c8a6228b0695cc60fa6c8979a3b644a72584029452569ae3280a"}
Jun 10 20:00:28.380511 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:28.380495    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:00:28.397137 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:28.397079    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" podStartSLOduration=2.375083597 podStartE2EDuration="9.39706235s" totalImagesPullingTime="7.021978753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:28.39633146 +0000 UTC m=+50.657301153" watchObservedRunningTime="2026-06-10 20:00:28.39706235 +0000 UTC m=+50.658032043"
Jun 10 20:00:28.412151 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:28.412103    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" podStartSLOduration=2.276839687 podStartE2EDuration="9.412087401s" totalImagesPullingTime="7.135247714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:28.411408439 +0000 UTC m=+50.672378133" watchObservedRunningTime="2026-06-10 20:00:28.412087401 +0000 UTC m=+50.673057120"
Jun 10 20:00:28.477985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:28.477942    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:28.478175 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:28.478060    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:00:28.478175 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:28.478119    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:00:44.478102058 +0000 UTC m=+66.739071727 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:00:38.312634 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:38.312607    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-fz8t6"
Jun 10 20:00:43.978461 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:43.978427    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:43.978876 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:43.978480    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:00:43.981209 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:43.981190    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 10 20:00:43.981253 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:43.981216    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 10 20:00:43.989059 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:43.989042    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 10 20:00:43.989115 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:43.989100    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 20:01:47.989080797 +0000 UTC m=+130.250050467 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : secret "metrics-daemon-secret" not found
Jun 10 20:00:43.991117 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:43.991102    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/a93364a5-e951-4b4d-bb08-cd1d597fc638-original-pull-secret\") pod \"global-pull-secret-syncer-kpdmj\" (UID: \"a93364a5-e951-4b4d-bb08-cd1d597fc638\") " pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:44.070954 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.070919    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-kpdmj"
Jun 10 20:00:44.079897 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.079846    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:44.082370 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.082337    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 10 20:00:44.092679 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.092658    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 10 20:00:44.104034 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.104007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bfxbv\" (UniqueName: \"kubernetes.io/projected/31a5dabe-c19e-4b76-8fac-52c7efc01c27-kube-api-access-bfxbv\") pod \"network-check-target-8jlh7\" (UID: \"31a5dabe-c19e-4b76-8fac-52c7efc01c27\") " pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:44.186992 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.186961    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-kpdmj"]
Jun 10 20:00:44.190026 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:00:44.189999    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93364a5_e951_4b4d_bb08_cd1d597fc638.slice/crio-6f2fad148e38e5b123fcb0fa0c1c2c781493b7d58fca8892cbdd39edbf6ea14e WatchSource:0}: Error finding container 6f2fad148e38e5b123fcb0fa0c1c2c781493b7d58fca8892cbdd39edbf6ea14e: Status 404 returned error can't find the container with id 6f2fad148e38e5b123fcb0fa0c1c2c781493b7d58fca8892cbdd39edbf6ea14e
Jun 10 20:00:44.378590 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.378561    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dqgjk\""
Jun 10 20:00:44.386558 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.386523    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:44.419231 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.419201    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpdmj" event={"ID":"a93364a5-e951-4b4d-bb08-cd1d597fc638","Type":"ContainerStarted","Data":"6f2fad148e38e5b123fcb0fa0c1c2c781493b7d58fca8892cbdd39edbf6ea14e"}
Jun 10 20:00:44.483608 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.483576    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:00:44.483733 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:44.483718    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:00:44.483801 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:00:44.483789    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:01:16.483769595 +0000 UTC m=+98.744739268 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:00:44.506304 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:44.506275    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8jlh7"]
Jun 10 20:00:44.509940 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:00:44.509918    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31a5dabe_c19e_4b76_8fac_52c7efc01c27.slice/crio-e6a220ab89daa06537d4b32ce6850dfba5b69ec2af7ec3066715063854988f04 WatchSource:0}: Error finding container e6a220ab89daa06537d4b32ce6850dfba5b69ec2af7ec3066715063854988f04: Status 404 returned error can't find the container with id e6a220ab89daa06537d4b32ce6850dfba5b69ec2af7ec3066715063854988f04
Jun 10 20:00:45.423476 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:45.423428    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8jlh7" event={"ID":"31a5dabe-c19e-4b76-8fac-52c7efc01c27","Type":"ContainerStarted","Data":"e6a220ab89daa06537d4b32ce6850dfba5b69ec2af7ec3066715063854988f04"}
Jun 10 20:00:49.437651 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:49.437613    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-kpdmj" event={"ID":"a93364a5-e951-4b4d-bb08-cd1d597fc638","Type":"ContainerStarted","Data":"eafe39cfd57ba6aa7eb1f42a878fcd9c2177851bb8bdbaab1e148b5cd62450cc"}
Jun 10 20:00:49.439080 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:49.439059    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8jlh7" event={"ID":"31a5dabe-c19e-4b76-8fac-52c7efc01c27","Type":"ContainerStarted","Data":"ce955ea96e954d3efd622dcad8283dca22e7ea4d44119691a0d4d297c816baff"}
Jun 10 20:00:49.439194 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:49.439182    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:00:49.466676 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:49.466635    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8jlh7" podStartSLOduration=67.34907599 podStartE2EDuration="1m11.466620567s" totalImagesPullingTime="4.117544577s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:49.466598038 +0000 UTC m=+71.727567728" watchObservedRunningTime="2026-06-10 20:00:49.466620567 +0000 UTC m=+71.727590261"
Jun 10 20:00:49.466881 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:00:49.466829    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-kpdmj" podStartSLOduration=67.027108045 podStartE2EDuration="1m11.466811642s" totalImagesPullingTime="4.439703597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:00:49.452620638 +0000 UTC m=+71.713590324" watchObservedRunningTime="2026-06-10 20:00:49.466811642 +0000 UTC m=+71.727781335"
Jun 10 20:01:16.504518 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:01:16.504476    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:01:16.504932 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:01:16.504621    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:01:16.504932 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:01:16.504685    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:02:20.504670474 +0000 UTC m=+162.765640144 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:01:20.443989 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:01:20.443955    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8jlh7"
Jun 10 20:01:48.018616 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:01:48.018571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:01:48.019116 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:01:48.018689    2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 10 20:01:48.019116 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:01:48.018754    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs podName:3e473320-d049-4a4a-861d-5030c95cad11 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:50.018739426 +0000 UTC m=+252.279709099 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs") pod "network-metrics-daemon-shvsb" (UID: "3e473320-d049-4a4a-861d-5030c95cad11") : secret "metrics-daemon-secret" not found
Jun 10 20:02:15.695236 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:02:15.695196    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hvwvn" podUID="1d6bf961-4890-45a4-9703-9f6afad50e86"
Jun 10 20:02:16.692952 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:16.692873    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:02:17.166981 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:02:17.166945    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-shvsb" podUID="3e473320-d049-4a4a-861d-5030c95cad11"
Jun 10 20:02:20.549598 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:20.549562    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:02:20.550199 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:02:20.549734    2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 10 20:02:20.550199 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:02:20.549830    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls podName:1d6bf961-4890-45a4-9703-9f6afad50e86 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:22.549807107 +0000 UTC m=+284.810776782 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls") pod "dns-default-hvwvn" (UID: "1d6bf961-4890-45a4-9703-9f6afad50e86") : secret "dns-default-metrics-tls" not found
Jun 10 20:02:27.724396 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:27.724359    2578 generic.go:356] "Generic (PLEG): container finished" podID="daef2cb7-6983-4f31-96b8-d5831a884415" containerID="a95a215a15c0c8a6228b0695cc60fa6c8979a3b644a72584029452569ae3280a" exitCode=255
Jun 10 20:02:27.724790 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:27.724400    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" event={"ID":"daef2cb7-6983-4f31-96b8-d5831a884415","Type":"ContainerDied","Data":"a95a215a15c0c8a6228b0695cc60fa6c8979a3b644a72584029452569ae3280a"}
Jun 10 20:02:27.724790 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:27.724690    2578 scope.go:117] "RemoveContainer" containerID="a95a215a15c0c8a6228b0695cc60fa6c8979a3b644a72584029452569ae3280a"
Jun 10 20:02:28.379695 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:28.379652    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" podUID="ce390345-db7a-48b8-b6cb-39966e914b04" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused"
Jun 10 20:02:28.728705 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:28.728621    2578 generic.go:356] "Generic (PLEG): container finished" podID="ce390345-db7a-48b8-b6cb-39966e914b04" containerID="9c310175afc8926154caf5febb3d3626a917ecbadd897a64705a269b4e49a42e" exitCode=1
Jun 10 20:02:28.728705 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:28.728691    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" event={"ID":"ce390345-db7a-48b8-b6cb-39966e914b04","Type":"ContainerDied","Data":"9c310175afc8926154caf5febb3d3626a917ecbadd897a64705a269b4e49a42e"}
Jun 10 20:02:28.729196 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:28.729019    2578 scope.go:117] "RemoveContainer" containerID="9c310175afc8926154caf5febb3d3626a917ecbadd897a64705a269b4e49a42e"
Jun 10 20:02:28.730572 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:28.730554    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" event={"ID":"daef2cb7-6983-4f31-96b8-d5831a884415","Type":"ContainerStarted","Data":"7ab57d81f8cce8df637a68e0e65f4289c8a17312b6d929557d7976da324a29c2"}
Jun 10 20:02:29.735238 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:29.735205    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" event={"ID":"ce390345-db7a-48b8-b6cb-39966e914b04","Type":"ContainerStarted","Data":"c0b87a1a6861955ac858fc6d83d6880b878468ca815b59c9cbab2f38ef828cc3"}
Jun 10 20:02:29.735624 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:29.735492    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:02:29.736056 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:29.736038    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:02:31.157505 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:02:31.157459    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:03:28.468017 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.467984    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-fc4ff65ff-bhxqw"]
Jun 10 20:03:28.469874 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.469843    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.473039 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.473018    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 10 20:03:28.473461 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.473446    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 10 20:03:28.473549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.473528    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mxn4f\""
Jun 10 20:03:28.474153 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.474138    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 10 20:03:28.478175 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.478155    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 10 20:03:28.489257 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.489238    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-fc4ff65ff-bhxqw"]
Jun 10 20:03:28.597745 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597721    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29555e99-e58d-45b1-8a60-402e71ab7853-ca-trust-extracted\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.597896 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597761    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-bound-sa-token\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.597896 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597792    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-installation-pull-secrets\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.597896 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597832    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-image-registry-private-configuration\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.597896 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597863    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-trusted-ca\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.597896 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kd5xh\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-kube-api-access-kd5xh\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.598076 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597943    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-registry-certificates\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.598076 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.597975    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699106 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699067    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29555e99-e58d-45b1-8a60-402e71ab7853-ca-trust-extracted\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699261 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699118    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-bound-sa-token\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699261 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699169    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-installation-pull-secrets\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699261 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699207    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-image-registry-private-configuration\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699261 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699232    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-trusted-ca\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699261 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699254    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kd5xh\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-kube-api-access-kd5xh\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699501 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-registry-certificates\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699501 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699602 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:28.699553    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 20:03:28.699602 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:28.699569    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc4ff65ff-bhxqw: secret "image-registry-tls" not found
Jun 10 20:03:28.699700 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.699671    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29555e99-e58d-45b1-8a60-402e71ab7853-ca-trust-extracted\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.699755 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:28.699680    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls podName:29555e99-e58d-45b1-8a60-402e71ab7853 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:29.199656617 +0000 UTC m=+231.460626288 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls") pod "image-registry-fc4ff65ff-bhxqw" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853") : secret "image-registry-tls" not found
Jun 10 20:03:28.700092 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.700066    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-registry-certificates\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.700337 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.700315    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-trusted-ca\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.701692 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.701669    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-image-registry-private-configuration\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.701771 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.701706    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-installation-pull-secrets\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.710674 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.710646    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-bound-sa-token\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:28.711248 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:28.711228    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kd5xh\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-kube-api-access-kd5xh\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:29.204431 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:29.204396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:29.204600 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:29.204522    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 20:03:29.204600 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:29.204535    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc4ff65ff-bhxqw: secret "image-registry-tls" not found
Jun 10 20:03:29.204600 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:29.204595    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls podName:29555e99-e58d-45b1-8a60-402e71ab7853 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:30.204578138 +0000 UTC m=+232.465547826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls") pod "image-registry-fc4ff65ff-bhxqw" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853") : secret "image-registry-tls" not found
Jun 10 20:03:30.212767 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:30.212735    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:30.213132 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:30.212825    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 20:03:30.213132 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:30.212835    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc4ff65ff-bhxqw: secret "image-registry-tls" not found
Jun 10 20:03:30.213132 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:30.212902    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls podName:29555e99-e58d-45b1-8a60-402e71ab7853 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:32.212887486 +0000 UTC m=+234.473857156 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls") pod "image-registry-fc4ff65ff-bhxqw" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853") : secret "image-registry-tls" not found
Jun 10 20:03:32.229180 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:32.229132    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:32.229555 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:32.229289    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 20:03:32.229555 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:32.229307    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc4ff65ff-bhxqw: secret "image-registry-tls" not found
Jun 10 20:03:32.229555 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:32.229458    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls podName:29555e99-e58d-45b1-8a60-402e71ab7853 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:36.229436726 +0000 UTC m=+238.490406407 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls") pod "image-registry-fc4ff65ff-bhxqw" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853") : secret "image-registry-tls" not found
Jun 10 20:03:34.976093 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:34.976068    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44nqh_93721cdf-fcd3-43ab-9905-44589865da03/dns-node-resolver/0.log"
Jun 10 20:03:35.249884 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.249801    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"]
Jun 10 20:03:35.253027 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.253009    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"
Jun 10 20:03:35.255442 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.255412    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 10 20:03:35.255561 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.255493    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-x7kcj\""
Jun 10 20:03:35.255628 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.255493    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 10 20:03:35.262382 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.262361    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"]
Jun 10 20:03:35.352901 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.352867    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhmll\" (UniqueName: \"kubernetes.io/projected/d198a1d9-56f3-444e-a545-88e2473852b2-kube-api-access-dhmll\") pod \"migrator-955ffdf5f-rr2vb\" (UID: \"d198a1d9-56f3-444e-a545-88e2473852b2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"
Jun 10 20:03:35.453332 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.453294    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhmll\" (UniqueName: \"kubernetes.io/projected/d198a1d9-56f3-444e-a545-88e2473852b2-kube-api-access-dhmll\") pod \"migrator-955ffdf5f-rr2vb\" (UID: \"d198a1d9-56f3-444e-a545-88e2473852b2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"
Jun 10 20:03:35.460675 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.460643    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhmll\" (UniqueName: \"kubernetes.io/projected/d198a1d9-56f3-444e-a545-88e2473852b2-kube-api-access-dhmll\") pod \"migrator-955ffdf5f-rr2vb\" (UID: \"d198a1d9-56f3-444e-a545-88e2473852b2\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"
Jun 10 20:03:35.561146 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.561118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"
Jun 10 20:03:35.674937 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.674905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb"]
Jun 10 20:03:35.677918 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:03:35.677882    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd198a1d9_56f3_444e_a545_88e2473852b2.slice/crio-002a923a741bd25142d6e35f99d772eeb32db3696d4aff5a8625d413754a6800 WatchSource:0}: Error finding container 002a923a741bd25142d6e35f99d772eeb32db3696d4aff5a8625d413754a6800: Status 404 returned error can't find the container with id 002a923a741bd25142d6e35f99d772eeb32db3696d4aff5a8625d413754a6800
Jun 10 20:03:35.919335 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:35.919252    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb" event={"ID":"d198a1d9-56f3-444e-a545-88e2473852b2","Type":"ContainerStarted","Data":"002a923a741bd25142d6e35f99d772eeb32db3696d4aff5a8625d413754a6800"}
Jun 10 20:03:36.259263 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:36.259184    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:36.259603 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:36.259351    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 20:03:36.259603 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:36.259369    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc4ff65ff-bhxqw: secret "image-registry-tls" not found
Jun 10 20:03:36.259603 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:36.259421    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls podName:29555e99-e58d-45b1-8a60-402e71ab7853 nodeName:}" failed. No retries permitted until 2026-06-10 20:03:44.259406567 +0000 UTC m=+246.520376238 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls") pod "image-registry-fc4ff65ff-bhxqw" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853") : secret "image-registry-tls" not found
Jun 10 20:03:36.376886 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:36.376842    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv5hf_b64c09dc-1acf-458e-896b-19525dc2d3db/node-ca/0.log"
Jun 10 20:03:36.978494 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:36.978464    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mlp2j_eb1ff4e1-c35f-4c37-a044-53198f153956/serve-healthcheck-canary/0.log"
Jun 10 20:03:37.925955 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:37.925923    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb" event={"ID":"d198a1d9-56f3-444e-a545-88e2473852b2","Type":"ContainerStarted","Data":"3a478e0f23dc378e0fba3cb79e96b67e8255c4c4375183e196274cfcf3a931cd"}
Jun 10 20:03:37.926316 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:37.925996    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb" event={"ID":"d198a1d9-56f3-444e-a545-88e2473852b2","Type":"ContainerStarted","Data":"46078130529ca080be02f97e6fc3f5324c17614bdd61f8a2b9d0eecf96de0df8"}
Jun 10 20:03:37.940949 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:37.940899    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-rr2vb" podStartSLOduration=1.504356881 podStartE2EDuration="2.940885066s" totalImagesPullingTime="1.436528185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:03:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:37.939354335 +0000 UTC m=+240.200324026" watchObservedRunningTime="2026-06-10 20:03:37.940885066 +0000 UTC m=+240.201854757"
Jun 10 20:03:44.315115 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:44.315076    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") pod \"image-registry-fc4ff65ff-bhxqw\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") " pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:44.315570 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:44.315188    2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 10 20:03:44.315570 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:44.315199    2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-fc4ff65ff-bhxqw: secret "image-registry-tls" not found
Jun 10 20:03:44.315570 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:44.315256    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls podName:29555e99-e58d-45b1-8a60-402e71ab7853 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:00.315242599 +0000 UTC m=+262.576212269 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls") pod "image-registry-fc4ff65ff-bhxqw" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853") : secret "image-registry-tls" not found
Jun 10 20:03:50.058410 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:50.058370    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:03:50.060649 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:50.060627    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3e473320-d049-4a4a-861d-5030c95cad11-metrics-certs\") pod \"network-metrics-daemon-shvsb\" (UID: \"3e473320-d049-4a4a-861d-5030c95cad11\") " pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:03:50.360289 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:50.360221    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-5ggwg\""
Jun 10 20:03:50.368126 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:50.368103    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-shvsb"
Jun 10 20:03:50.485429 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:50.485400    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-shvsb"]
Jun 10 20:03:50.488654 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:03:50.488624    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e473320_d049_4a4a_861d_5030c95cad11.slice/crio-31bab7d8604c37a5ff6beaa44dc66cde56efc8e6ba318f17d7be047725b1790c WatchSource:0}: Error finding container 31bab7d8604c37a5ff6beaa44dc66cde56efc8e6ba318f17d7be047725b1790c: Status 404 returned error can't find the container with id 31bab7d8604c37a5ff6beaa44dc66cde56efc8e6ba318f17d7be047725b1790c
Jun 10 20:03:50.963708 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:50.963675    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shvsb" event={"ID":"3e473320-d049-4a4a-861d-5030c95cad11","Type":"ContainerStarted","Data":"31bab7d8604c37a5ff6beaa44dc66cde56efc8e6ba318f17d7be047725b1790c"}
Jun 10 20:03:51.970748 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:51.970667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shvsb" event={"ID":"3e473320-d049-4a4a-861d-5030c95cad11","Type":"ContainerStarted","Data":"c7396051b36ec34c77701cad645dfab527a0925d91813a65ac1575c53ce601b9"}
Jun 10 20:03:51.970748 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:51.970728    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-shvsb" event={"ID":"3e473320-d049-4a4a-861d-5030c95cad11","Type":"ContainerStarted","Data":"75a6ca80f561015d1e14a3a6ca1d0ec9cb847e5a554dabee7b206eb6c8648a83"}
Jun 10 20:03:51.986991 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:51.986939    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-shvsb" podStartSLOduration=252.875267597 podStartE2EDuration="4m13.986921706s" totalImagesPullingTime="1.111654109s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 19:59:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:03:51.985985264 +0000 UTC m=+254.246954957" watchObservedRunningTime="2026-06-10 20:03:51.986921706 +0000 UTC m=+254.247891397"
Jun 10 20:03:58.729981 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.729949    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-57mwl"]
Jun 10 20:03:58.732952 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.732934    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.735164 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.735136    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 10 20:03:58.735272 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.735198    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 10 20:03:58.736246 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.736228    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 10 20:03:58.736297 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.736266    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 10 20:03:58.736347 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.736314    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-hf687\""
Jun 10 20:03:58.757445 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.757426    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57mwl"]
Jun 10 20:03:58.779836 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.779813    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc4ff65ff-bhxqw"]
Jun 10 20:03:58.780032 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:03:58.780012    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw" podUID="29555e99-e58d-45b1-8a60-402e71ab7853"
Jun 10 20:03:58.819228 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.819206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2dd4d927-a461-45c8-ac0e-239cc295107a-crio-socket\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.819331 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.819249    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dd4d927-a461-45c8-ac0e-239cc295107a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.819331 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.819271    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2qh87\" (UniqueName: \"kubernetes.io/projected/2dd4d927-a461-45c8-ac0e-239cc295107a-kube-api-access-2qh87\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.819331 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.819326    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd4d927-a461-45c8-ac0e-239cc295107a-data-volume\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.819460 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.819357    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2dd4d927-a461-45c8-ac0e-239cc295107a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.919778 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.919753    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd4d927-a461-45c8-ac0e-239cc295107a-data-volume\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.919884 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.919783    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2dd4d927-a461-45c8-ac0e-239cc295107a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.919922 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.919910    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2dd4d927-a461-45c8-ac0e-239cc295107a-crio-socket\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.919981 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.919958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dd4d927-a461-45c8-ac0e-239cc295107a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.920021 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.919992    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2qh87\" (UniqueName: \"kubernetes.io/projected/2dd4d927-a461-45c8-ac0e-239cc295107a-kube-api-access-2qh87\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.920057 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.920030    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2dd4d927-a461-45c8-ac0e-239cc295107a-crio-socket\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.920139 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.920125    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2dd4d927-a461-45c8-ac0e-239cc295107a-data-volume\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.920369 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.920352    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2dd4d927-a461-45c8-ac0e-239cc295107a-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.922183 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.922163    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2dd4d927-a461-45c8-ac0e-239cc295107a-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.933020 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.932990    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2qh87\" (UniqueName: \"kubernetes.io/projected/2dd4d927-a461-45c8-ac0e-239cc295107a-kube-api-access-2qh87\") pod \"insights-runtime-extractor-57mwl\" (UID: \"2dd4d927-a461-45c8-ac0e-239cc295107a\") " pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:58.990582 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.990499    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:58.997299 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:58.997271    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:59.020642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.020618    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-bound-sa-token\") pod \"29555e99-e58d-45b1-8a60-402e71ab7853\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") "
Jun 10 20:03:59.020642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.020646    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kd5xh\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-kube-api-access-kd5xh\") pod \"29555e99-e58d-45b1-8a60-402e71ab7853\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") "
Jun 10 20:03:59.020840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.020668    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-installation-pull-secrets\") pod \"29555e99-e58d-45b1-8a60-402e71ab7853\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") "
Jun 10 20:03:59.020840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.020696    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-registry-certificates\") pod \"29555e99-e58d-45b1-8a60-402e71ab7853\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") "
Jun 10 20:03:59.020840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.020724    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29555e99-e58d-45b1-8a60-402e71ab7853-ca-trust-extracted\") pod \"29555e99-e58d-45b1-8a60-402e71ab7853\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") "
Jun 10 20:03:59.020840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.020753    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-image-registry-private-configuration\") pod \"29555e99-e58d-45b1-8a60-402e71ab7853\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") "
Jun 10 20:03:59.020840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.020802    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-trusted-ca\") pod \"29555e99-e58d-45b1-8a60-402e71ab7853\" (UID: \"29555e99-e58d-45b1-8a60-402e71ab7853\") "
Jun 10 20:03:59.021142 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.021120    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29555e99-e58d-45b1-8a60-402e71ab7853-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "29555e99-e58d-45b1-8a60-402e71ab7853" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:03:59.021214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.021116    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "29555e99-e58d-45b1-8a60-402e71ab7853" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:03:59.021281 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.021254    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "29555e99-e58d-45b1-8a60-402e71ab7853" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:03:59.023005 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.022979    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "29555e99-e58d-45b1-8a60-402e71ab7853" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:03:59.023104 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.022983    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-kube-api-access-kd5xh" (OuterVolumeSpecName: "kube-api-access-kd5xh") pod "29555e99-e58d-45b1-8a60-402e71ab7853" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853"). InnerVolumeSpecName "kube-api-access-kd5xh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:03:59.023104 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.023040    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "29555e99-e58d-45b1-8a60-402e71ab7853" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:03:59.023104 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.023040    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "29555e99-e58d-45b1-8a60-402e71ab7853" (UID: "29555e99-e58d-45b1-8a60-402e71ab7853"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:03:59.041315 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.041296    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-57mwl"
Jun 10 20:03:59.121650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.121625    2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-trusted-ca\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:03:59.121650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.121649    2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-bound-sa-token\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:03:59.121813 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.121658    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kd5xh\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-kube-api-access-kd5xh\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:03:59.121813 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.121668    2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-installation-pull-secrets\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:03:59.121813 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.121677    2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/29555e99-e58d-45b1-8a60-402e71ab7853-registry-certificates\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:03:59.121813 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.121685    2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/29555e99-e58d-45b1-8a60-402e71ab7853-ca-trust-extracted\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:03:59.121813 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.121693    2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/29555e99-e58d-45b1-8a60-402e71ab7853-image-registry-private-configuration\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:03:59.163157 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.163124    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-57mwl"]
Jun 10 20:03:59.166737 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:03:59.166713    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dd4d927_a461_45c8_ac0e_239cc295107a.slice/crio-86ef0ccd754989b4eed8bae7f04461ad1969a9d943c99bb0946c92381d4fb579 WatchSource:0}: Error finding container 86ef0ccd754989b4eed8bae7f04461ad1969a9d943c99bb0946c92381d4fb579: Status 404 returned error can't find the container with id 86ef0ccd754989b4eed8bae7f04461ad1969a9d943c99bb0946c92381d4fb579
Jun 10 20:03:59.995403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.995374    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57mwl" event={"ID":"2dd4d927-a461-45c8-ac0e-239cc295107a","Type":"ContainerStarted","Data":"1a245180efbf5844d88782b7c934bc900eeb7f997100186306a71effdf5a2c43"}
Jun 10 20:03:59.995403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.995395    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-fc4ff65ff-bhxqw"
Jun 10 20:03:59.995891 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.995427    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57mwl" event={"ID":"2dd4d927-a461-45c8-ac0e-239cc295107a","Type":"ContainerStarted","Data":"721deb1217bd2445df0985ecf4ad579776ea8c29a557152e2719f18681a6070b"}
Jun 10 20:03:59.995891 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:03:59.995447    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57mwl" event={"ID":"2dd4d927-a461-45c8-ac0e-239cc295107a","Type":"ContainerStarted","Data":"86ef0ccd754989b4eed8bae7f04461ad1969a9d943c99bb0946c92381d4fb579"}
Jun 10 20:04:00.027799 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:00.027771    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-fc4ff65ff-bhxqw"]
Jun 10 20:04:00.032113 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:00.032091    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-fc4ff65ff-bhxqw"]
Jun 10 20:04:00.130085 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:00.130007    2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/29555e99-e58d-45b1-8a60-402e71ab7853-registry-tls\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:04:00.165734 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:00.165700    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29555e99-e58d-45b1-8a60-402e71ab7853" path="/var/lib/kubelet/pods/29555e99-e58d-45b1-8a60-402e71ab7853/volumes"
Jun 10 20:04:02.003572 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:02.003474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-57mwl" event={"ID":"2dd4d927-a461-45c8-ac0e-239cc295107a","Type":"ContainerStarted","Data":"4bf80312aff52ced344b2bf6949714da036de92544561b8ca18c6f159b706fef"}
Jun 10 20:04:06.975299 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.975255    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-57mwl" podStartSLOduration=6.6769629550000005 podStartE2EDuration="8.975237981s" totalImagesPullingTime="2.298275026s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:03:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:02.023072386 +0000 UTC m=+264.284042090" watchObservedRunningTime="2026-06-10 20:04:06.975237981 +0000 UTC m=+269.236207671"
Jun 10 20:04:06.975671 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.975646    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"]
Jun 10 20:04:06.978799 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.978780    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:06.981175 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.981156    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 10 20:04:06.982217 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.982196    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jun 10 20:04:06.982302 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.982215    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-bn77c\""
Jun 10 20:04:06.982302 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.982244    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jun 10 20:04:06.982420 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.982322    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 10 20:04:06.982420 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.982323    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 10 20:04:06.987994 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:06.987967    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"]
Jun 10 20:04:07.076887 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.076836    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406112be-ecc8-4930-a00b-b99e1b0e873e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.077044 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.076894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vv2sd\" (UniqueName: \"kubernetes.io/projected/406112be-ecc8-4930-a00b-b99e1b0e873e-kube-api-access-vv2sd\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.077044 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.076983    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/406112be-ecc8-4930-a00b-b99e1b0e873e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.077044 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.077029    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406112be-ecc8-4930-a00b-b99e1b0e873e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.177956 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.177928    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vv2sd\" (UniqueName: \"kubernetes.io/projected/406112be-ecc8-4930-a00b-b99e1b0e873e-kube-api-access-vv2sd\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.178102 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.177963    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/406112be-ecc8-4930-a00b-b99e1b0e873e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.178102 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.177993    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406112be-ecc8-4930-a00b-b99e1b0e873e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.178102 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.178020    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406112be-ecc8-4930-a00b-b99e1b0e873e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.178643 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.178621    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/406112be-ecc8-4930-a00b-b99e1b0e873e-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.180249 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.180227    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/406112be-ecc8-4930-a00b-b99e1b0e873e-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.180347 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.180325    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/406112be-ecc8-4930-a00b-b99e1b0e873e-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.187025 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.187007    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vv2sd\" (UniqueName: \"kubernetes.io/projected/406112be-ecc8-4930-a00b-b99e1b0e873e-kube-api-access-vv2sd\") pod \"prometheus-operator-7f7d445d84-xvbpz\" (UID: \"406112be-ecc8-4930-a00b-b99e1b0e873e\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.287694 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.287665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"
Jun 10 20:04:07.408718 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:07.408688    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz"]
Jun 10 20:04:07.411363 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:07.411343    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod406112be_ecc8_4930_a00b_b99e1b0e873e.slice/crio-514932d73684b1771f38cdacb819bae710f9a9ad61f4e55e39a5bc3a4ab74486 WatchSource:0}: Error finding container 514932d73684b1771f38cdacb819bae710f9a9ad61f4e55e39a5bc3a4ab74486: Status 404 returned error can't find the container with id 514932d73684b1771f38cdacb819bae710f9a9ad61f4e55e39a5bc3a4ab74486
Jun 10 20:04:08.021735 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:08.021699    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz" event={"ID":"406112be-ecc8-4930-a00b-b99e1b0e873e","Type":"ContainerStarted","Data":"514932d73684b1771f38cdacb819bae710f9a9ad61f4e55e39a5bc3a4ab74486"}
Jun 10 20:04:09.027347 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:09.027317    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz" event={"ID":"406112be-ecc8-4930-a00b-b99e1b0e873e","Type":"ContainerStarted","Data":"4c0dfa56a4aec736ed4b1ca940c300230a6bfde4392899de1823eb8cb54a0867"}
Jun 10 20:04:10.031692 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.031656    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz" event={"ID":"406112be-ecc8-4930-a00b-b99e1b0e873e","Type":"ContainerStarted","Data":"154ad47491e2430243a29568c0ac7f3819a4b97574eb9d77eaa29b64e8e5c4e3"}
Jun 10 20:04:10.050099 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.050056    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-xvbpz" podStartSLOduration=2.546432272 podStartE2EDuration="4.050041719s" totalImagesPullingTime="1.503609447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:10.048394682 +0000 UTC m=+272.309364371" watchObservedRunningTime="2026-06-10 20:04:10.050041719 +0000 UTC m=+272.311011411"
Jun 10 20:04:10.621828 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.621799    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79cddfcdd4-62l4g"]
Jun 10 20:04:10.624768 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.624751    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.627392 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.627368    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 10 20:04:10.627392 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.627389    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 10 20:04:10.628525 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.628461    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 10 20:04:10.628525 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.628483    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l9mnf\""
Jun 10 20:04:10.628696 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.628530    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 10 20:04:10.628696 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.628465    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 10 20:04:10.628696 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.628590    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 10 20:04:10.628874 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.628784    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 10 20:04:10.634273 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.634254    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cddfcdd4-62l4g"]
Jun 10 20:04:10.701560 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.701533    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-oauth-serving-cert\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.701688 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.701577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-service-ca\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.701688 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.701596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rktv6\" (UniqueName: \"kubernetes.io/projected/a2be0226-3d5c-4627-9469-cbae8686ec24-kube-api-access-rktv6\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.701688 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.701663    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-serving-cert\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.701688 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.701685    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-console-config\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.701824 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.701716    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-oauth-config\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.802617 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.802588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-service-ca\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.802617 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.802620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rktv6\" (UniqueName: \"kubernetes.io/projected/a2be0226-3d5c-4627-9469-cbae8686ec24-kube-api-access-rktv6\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.802763 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.802656    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-serving-cert\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.802763 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.802682    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-console-config\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.802763 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.802699    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-oauth-config\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.802763 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.802725    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-oauth-serving-cert\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.803370 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.803341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-service-ca\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.803466 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.803420    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-oauth-serving-cert\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.803466 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.803430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-console-config\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.805043 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.805023    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-oauth-config\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.805142 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.805118    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-serving-cert\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.811322 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.811297    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rktv6\" (UniqueName: \"kubernetes.io/projected/a2be0226-3d5c-4627-9469-cbae8686ec24-kube-api-access-rktv6\") pod \"console-79cddfcdd4-62l4g\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") " pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:10.933905 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:10.933830    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:11.066825 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:11.066792    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79cddfcdd4-62l4g"]
Jun 10 20:04:11.069959 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:11.069931    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2be0226_3d5c_4627_9469_cbae8686ec24.slice/crio-96fe7645f6048f26db394b04c22f9fa851906547a1530b503831fd044253b8b7 WatchSource:0}: Error finding container 96fe7645f6048f26db394b04c22f9fa851906547a1530b503831fd044253b8b7: Status 404 returned error can't find the container with id 96fe7645f6048f26db394b04c22f9fa851906547a1530b503831fd044253b8b7
Jun 10 20:04:12.041870 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.041819    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cddfcdd4-62l4g" event={"ID":"a2be0226-3d5c-4627-9469-cbae8686ec24","Type":"ContainerStarted","Data":"96fe7645f6048f26db394b04c22f9fa851906547a1530b503831fd044253b8b7"}
Jun 10 20:04:12.349919 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.349822    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"]
Jun 10 20:04:12.353824 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.353802    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8g7bd"]
Jun 10 20:04:12.353979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.353950    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.356829 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.356799    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 10 20:04:12.356977 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.356879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 10 20:04:12.357713 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.357665    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.357713 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.357702    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5bdkr\""
Jun 10 20:04:12.357898 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.357707    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 10 20:04:12.359934 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.359896    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 10 20:04:12.360417 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.360395    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 10 20:04:12.360897 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.360869    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 10 20:04:12.361187 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.361169    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-r5p2r\""
Jun 10 20:04:12.376442 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.376417    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"]
Jun 10 20:04:12.414367 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414336    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-sys\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414372    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-root\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414393    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04bb9f4-e510-4788-94dd-9a6ab854e108-metrics-client-ca\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414419    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.414526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414454    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-wtmp\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414554    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8r4hf\" (UniqueName: \"kubernetes.io/projected/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-api-access-8r4hf\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.414690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414579    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xhxrr\" (UniqueName: \"kubernetes.io/projected/e04bb9f4-e510-4788-94dd-9a6ab854e108-kube-api-access-xhxrr\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-tls\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414621    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.414690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414646    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-accelerators-collector-config\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.414899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414695    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.414899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414740    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.414899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.414899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.414810    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-textfile\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.515890 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.515837    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8r4hf\" (UniqueName: \"kubernetes.io/projected/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-api-access-8r4hf\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.516066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.515911    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xhxrr\" (UniqueName: \"kubernetes.io/projected/e04bb9f4-e510-4788-94dd-9a6ab854e108-kube-api-access-xhxrr\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.516066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.515936    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-tls\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.516066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.515964    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.516227 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:12.516072    2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 10 20:04:12.516227 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516072    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-accelerators-collector-config\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.516227 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:12.516139    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-tls podName:e04bb9f4-e510-4788-94dd-9a6ab854e108 nodeName:}" failed. No retries permitted until 2026-06-10 20:04:13.016117906 +0000 UTC m=+275.277087586 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-tls") pod "node-exporter-8g7bd" (UID: "e04bb9f4-e510-4788-94dd-9a6ab854e108") : secret "node-exporter-tls" not found
Jun 10 20:04:12.516227 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516196    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.516430 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516234    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.516430 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516270    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.516430 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516297    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.516725 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516700    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-accelerators-collector-config\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.516824 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516787    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-textfile\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.516957 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516887    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-sys\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.516957 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516930    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-root\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.517058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516957    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04bb9f4-e510-4788-94dd-9a6ab854e108-metrics-client-ca\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.517058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516985    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.517058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516989    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.517058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.517011    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-wtmp\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.517058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.517042    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-root\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.517058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.516981    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.517342 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.517181    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-wtmp\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.517342 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.517227    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e04bb9f4-e510-4788-94dd-9a6ab854e108-sys\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.517342 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.517273    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.517342 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.517291    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-textfile\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.517664 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.517646    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e04bb9f4-e510-4788-94dd-9a6ab854e108-metrics-client-ca\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.518734 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.518711    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.519014 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.518990    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.519116 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.519098    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.524020 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.523995    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8r4hf\" (UniqueName: \"kubernetes.io/projected/8d1541b5-6cb3-45fa-9b9f-15873f5044bd-kube-api-access-8r4hf\") pod \"kube-state-metrics-57bbf8bfb5-5mmnl\" (UID: \"8d1541b5-6cb3-45fa-9b9f-15873f5044bd\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.524157 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.524083    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xhxrr\" (UniqueName: \"kubernetes.io/projected/e04bb9f4-e510-4788-94dd-9a6ab854e108-kube-api-access-xhxrr\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:12.666968 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.666881    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"
Jun 10 20:04:12.802079 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:12.802051    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl"]
Jun 10 20:04:12.804809 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:12.804785    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d1541b5_6cb3_45fa_9b9f_15873f5044bd.slice/crio-09c405dc2b748793666d813cda17b2382ea928c18ec96edcd72645fda73200f4 WatchSource:0}: Error finding container 09c405dc2b748793666d813cda17b2382ea928c18ec96edcd72645fda73200f4: Status 404 returned error can't find the container with id 09c405dc2b748793666d813cda17b2382ea928c18ec96edcd72645fda73200f4
Jun 10 20:04:13.020982 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:13.020952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-tls\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:13.023398 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:13.023375    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e04bb9f4-e510-4788-94dd-9a6ab854e108-node-exporter-tls\") pod \"node-exporter-8g7bd\" (UID: \"e04bb9f4-e510-4788-94dd-9a6ab854e108\") " pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:13.046430 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:13.046397    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl" event={"ID":"8d1541b5-6cb3-45fa-9b9f-15873f5044bd","Type":"ContainerStarted","Data":"09c405dc2b748793666d813cda17b2382ea928c18ec96edcd72645fda73200f4"}
Jun 10 20:04:13.271901 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:13.271830    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8g7bd"
Jun 10 20:04:13.284037 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:13.283998    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode04bb9f4_e510_4788_94dd_9a6ab854e108.slice/crio-1887d5c4f632dfd5f5532f55eee3f0eb10a5c23e9b8318a4562cb77fca30c482 WatchSource:0}: Error finding container 1887d5c4f632dfd5f5532f55eee3f0eb10a5c23e9b8318a4562cb77fca30c482: Status 404 returned error can't find the container with id 1887d5c4f632dfd5f5532f55eee3f0eb10a5c23e9b8318a4562cb77fca30c482
Jun 10 20:04:14.053637 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:14.053589    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8g7bd" event={"ID":"e04bb9f4-e510-4788-94dd-9a6ab854e108","Type":"ContainerStarted","Data":"1887d5c4f632dfd5f5532f55eee3f0eb10a5c23e9b8318a4562cb77fca30c482"}
Jun 10 20:04:15.329258 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.329222    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"]
Jun 10 20:04:15.338557 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.338537    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.341222 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.341202    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 10 20:04:15.341683 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.341626    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 10 20:04:15.342007 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.341989    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-lljvx\""
Jun 10 20:04:15.342118 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.342009    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 10 20:04:15.342519 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.342201    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-c1goo8ja4spln\""
Jun 10 20:04:15.342519 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.342307    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 10 20:04:15.342519 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.342339    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 10 20:04:15.342776 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.342757    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"]
Jun 10 20:04:15.441955 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.441921    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.442098 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.441968    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-tls\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.442098 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.441991    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.442098 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.442046    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.442251 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.442135    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-metrics-client-ca\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.442251 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.442216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-grpc-tls\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.442340 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.442269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.442340 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.442298    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sdjn6\" (UniqueName: \"kubernetes.io/projected/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-kube-api-access-sdjn6\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.544930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.543871    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.544930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.543958    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-tls\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.544930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.544003    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.544930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.544040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.544930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.544075    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-metrics-client-ca\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.544930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.544872    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-metrics-client-ca\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.545367 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.545037    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-grpc-tls\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.545367 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.545117    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.545367 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.545161    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sdjn6\" (UniqueName: \"kubernetes.io/projected/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-kube-api-access-sdjn6\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.550562 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.550536    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.550764 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.550573    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-grpc-tls\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.550879 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.550754    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-tls\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.552271 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.552217    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.552525 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.552481    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.552622 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.552533    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.554091 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.554073    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sdjn6\" (UniqueName: \"kubernetes.io/projected/6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe-kube-api-access-sdjn6\") pod \"thanos-querier-5cc996d8d5-d52rh\" (UID: \"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe\") " pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.648977 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.648958    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:15.814884 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:15.814430    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"]
Jun 10 20:04:15.822244 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:15.822209    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b29a40f_cb2b_4e69_a4b0_c6ab26ecdafe.slice/crio-3877a410582fa2078d7d33e86c9378eefd4e10b50b41a0a93621efab5291012d WatchSource:0}: Error finding container 3877a410582fa2078d7d33e86c9378eefd4e10b50b41a0a93621efab5291012d: Status 404 returned error can't find the container with id 3877a410582fa2078d7d33e86c9378eefd4e10b50b41a0a93621efab5291012d
Jun 10 20:04:16.062655 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.062614    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" event={"ID":"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe","Type":"ContainerStarted","Data":"3877a410582fa2078d7d33e86c9378eefd4e10b50b41a0a93621efab5291012d"}
Jun 10 20:04:16.064214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.064185    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cddfcdd4-62l4g" event={"ID":"a2be0226-3d5c-4627-9469-cbae8686ec24","Type":"ContainerStarted","Data":"4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d"}
Jun 10 20:04:16.066306 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.066274    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl" event={"ID":"8d1541b5-6cb3-45fa-9b9f-15873f5044bd","Type":"ContainerStarted","Data":"0f36c2329a2c14abf3eb9a3862f434835f07837088387cd21b9fa18bc080b829"}
Jun 10 20:04:16.066439 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.066333    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl" event={"ID":"8d1541b5-6cb3-45fa-9b9f-15873f5044bd","Type":"ContainerStarted","Data":"842b60019950bf6a2b937adcac04732745a894c4485c55da667d6c9e60d66b13"}
Jun 10 20:04:16.066439 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.066354    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl" event={"ID":"8d1541b5-6cb3-45fa-9b9f-15873f5044bd","Type":"ContainerStarted","Data":"a5ee48db63e854756ad4fb72e54066ba280be2eaab80a0ff52ead3a2d1e79de0"}
Jun 10 20:04:16.067837 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.067815    2578 generic.go:356] "Generic (PLEG): container finished" podID="e04bb9f4-e510-4788-94dd-9a6ab854e108" containerID="f9c583384a82a03e36f03409cc7e3405c273c13eec249644125a557cfe977f6e" exitCode=0
Jun 10 20:04:16.067942 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.067867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8g7bd" event={"ID":"e04bb9f4-e510-4788-94dd-9a6ab854e108","Type":"ContainerDied","Data":"f9c583384a82a03e36f03409cc7e3405c273c13eec249644125a557cfe977f6e"}
Jun 10 20:04:16.081531 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.081481    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79cddfcdd4-62l4g" podStartSLOduration=1.505809251 podStartE2EDuration="6.081460842s" totalImagesPullingTime="4.575651591s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:16.080286539 +0000 UTC m=+278.341256232" watchObservedRunningTime="2026-06-10 20:04:16.081460842 +0000 UTC m=+278.342430534"
Jun 10 20:04:16.097830 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:16.097775    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-5mmnl" podStartSLOduration=1.260304463 podStartE2EDuration="4.097757426s" totalImagesPullingTime="2.837452963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:16.096890739 +0000 UTC m=+278.357860428" watchObservedRunningTime="2026-06-10 20:04:16.097757426 +0000 UTC m=+278.358727119"
Jun 10 20:04:17.073782 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.073738    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8g7bd" event={"ID":"e04bb9f4-e510-4788-94dd-9a6ab854e108","Type":"ContainerStarted","Data":"00b73b1f926753ebc17e71a435f6c6e4c00c8abe106f70a4179d59ebb7889cab"}
Jun 10 20:04:17.074290 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.073814    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8g7bd" event={"ID":"e04bb9f4-e510-4788-94dd-9a6ab854e108","Type":"ContainerStarted","Data":"7e70973126ecf24e7b00128f5ee02544eeff894d2a6b0b14ea81ba3d744dd403"}
Jun 10 20:04:17.096493 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.096442    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8g7bd" podStartSLOduration=2.641845054 podStartE2EDuration="5.096424549s" totalImagesPullingTime="2.360769236s" totalInitContainerRuntime="93.810259ms" isStatefulPod=true podCreationTimestamp="2026-06-10 20:04:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:17.094525008 +0000 UTC m=+279.355494701" watchObservedRunningTime="2026-06-10 20:04:17.096424549 +0000 UTC m=+279.357394241"
Jun 10 20:04:17.138023 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.137278    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"]
Jun 10 20:04:17.139674 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.139654    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.142242 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.142222    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 10 20:04:17.142339 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.142223    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-rfq5l\""
Jun 10 20:04:17.148540 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.148513    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"]
Jun 10 20:04:17.261602 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.261568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wfvx\" (UniqueName: \"kubernetes.io/projected/f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb-kube-api-access-9wfvx\") pod \"monitoring-plugin-76b68cc874-fsx79\" (UID: \"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.261807 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.261619    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fsx79\" (UID: \"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.362705 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.362612    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wfvx\" (UniqueName: \"kubernetes.io/projected/f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb-kube-api-access-9wfvx\") pod \"monitoring-plugin-76b68cc874-fsx79\" (UID: \"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.362705 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.362676    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fsx79\" (UID: \"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.365242 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.365217    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb-monitoring-plugin-cert\") pod \"monitoring-plugin-76b68cc874-fsx79\" (UID: \"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.369929 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.369902    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wfvx\" (UniqueName: \"kubernetes.io/projected/f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb-kube-api-access-9wfvx\") pod \"monitoring-plugin-76b68cc874-fsx79\" (UID: \"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb\") " pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.417953 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.417929    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"]
Jun 10 20:04:17.420789 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.420764    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.423060 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.423037    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\""
Jun 10 20:04:17.423214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.423185    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-mlpp8\""
Jun 10 20:04:17.423314 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.423297    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\""
Jun 10 20:04:17.423404 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.423301    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\""
Jun 10 20:04:17.423404 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.423369    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\""
Jun 10 20:04:17.423597 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.423577    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\""
Jun 10 20:04:17.434059 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.434033    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\""
Jun 10 20:04:17.434473 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.434450    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"]
Jun 10 20:04:17.449746 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.449719    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:17.463841 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.463816    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-federate-client-tls\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.463959 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.463882    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.463959 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.463944    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-metrics-client-ca\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.464082 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.463989    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-secret-telemeter-client\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.464082 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.464014    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.464082 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.464038    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-telemeter-client-tls\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.464192 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.464103    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6mct\" (UniqueName: \"kubernetes.io/projected/be9bc895-d40c-4f95-ad6a-1d019469b8ee-kube-api-access-x6mct\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.464192 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.464149    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-serving-certs-ca-bundle\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.564673 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564632    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-serving-certs-ca-bundle\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.564829 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564693    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-federate-client-tls\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.564829 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564732    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.564829 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564777    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-metrics-client-ca\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.564829 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-secret-telemeter-client\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.565067 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564835    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.565067 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564875    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-telemeter-client-tls\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.565067 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.564925    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6mct\" (UniqueName: \"kubernetes.io/projected/be9bc895-d40c-4f95-ad6a-1d019469b8ee-kube-api-access-x6mct\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.565786 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.565561    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-serving-certs-ca-bundle\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.566103 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.566081    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.566243 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.566206    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/be9bc895-d40c-4f95-ad6a-1d019469b8ee-metrics-client-ca\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.567685 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.567659    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.567803 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.567760    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-federate-client-tls\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.567926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.567902    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-secret-telemeter-client\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.568123 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.568102    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/be9bc895-d40c-4f95-ad6a-1d019469b8ee-telemeter-client-tls\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.572623 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.572601    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6mct\" (UniqueName: \"kubernetes.io/projected/be9bc895-d40c-4f95-ad6a-1d019469b8ee-kube-api-access-x6mct\") pod \"telemeter-client-5b6cc6968c-6bzfd\" (UID: \"be9bc895-d40c-4f95-ad6a-1d019469b8ee\") " pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.734604 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.734525    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"
Jun 10 20:04:17.974767 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.974680    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd"]
Jun 10 20:04:17.984812 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:17.984744    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"]
Jun 10 20:04:17.991045 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:17.991018    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf45e64ec_2cb3_40c6_b2bc_897d8eb6dadb.slice/crio-cd5ea37ee8e95f96a01ae389639e4525943740a0af7fa33780dffe57cc016de4 WatchSource:0}: Error finding container cd5ea37ee8e95f96a01ae389639e4525943740a0af7fa33780dffe57cc016de4: Status 404 returned error can't find the container with id cd5ea37ee8e95f96a01ae389639e4525943740a0af7fa33780dffe57cc016de4
Jun 10 20:04:17.991219 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:17.991195    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe9bc895_d40c_4f95_ad6a_1d019469b8ee.slice/crio-de72fd3f3c4eb43098b108745d11698648e66db7f1c95ac1226fcf09c1315cd1 WatchSource:0}: Error finding container de72fd3f3c4eb43098b108745d11698648e66db7f1c95ac1226fcf09c1315cd1: Status 404 returned error can't find the container with id de72fd3f3c4eb43098b108745d11698648e66db7f1c95ac1226fcf09c1315cd1
Jun 10 20:04:18.079795 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.079766    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" event={"ID":"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe","Type":"ContainerStarted","Data":"5b51a5f614ed659d7900a0943bc52d3fd102212e28bad1198e5469d7783c8a0a"}
Jun 10 20:04:18.080160 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.079842    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" event={"ID":"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe","Type":"ContainerStarted","Data":"6f4273c5bba83b609108fd1469a9db464129ab17b47c60f5d529d2305c1af751"}
Jun 10 20:04:18.080160 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.079894    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" event={"ID":"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe","Type":"ContainerStarted","Data":"1c00872d9f83df8112e8d66fae523b6d3198485c2303b278798cf41020d0da0a"}
Jun 10 20:04:18.081066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.081040    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd" event={"ID":"be9bc895-d40c-4f95-ad6a-1d019469b8ee","Type":"ContainerStarted","Data":"de72fd3f3c4eb43098b108745d11698648e66db7f1c95ac1226fcf09c1315cd1"}
Jun 10 20:04:18.082244 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.082219    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79" event={"ID":"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb","Type":"ContainerStarted","Data":"cd5ea37ee8e95f96a01ae389639e4525943740a0af7fa33780dffe57cc016de4"}
Jun 10 20:04:18.526595 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.526551    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:04:18.532226 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.531122    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.534157 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.533948    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 10 20:04:18.535574 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.534830    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 10 20:04:18.535574 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.535195    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 10 20:04:18.535574 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.535376    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 10 20:04:18.535574 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.535559    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 10 20:04:18.535965 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.535911    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 10 20:04:18.536751 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.536130    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3jr6pmjd6ttti\""
Jun 10 20:04:18.536751 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.536214    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 10 20:04:18.536751 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.536359    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 10 20:04:18.536751 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.536365    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 10 20:04:18.536751 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.536506    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 10 20:04:18.536751 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.536641    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m8xrr\""
Jun 10 20:04:18.538017 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.537160    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 10 20:04:18.538017 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.537226    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 10 20:04:18.540581 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.540556    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 10 20:04:18.542757 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.542735    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 10 20:04:18.543701 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.543678    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 10 20:04:18.545583 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.545558    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:04:18.576307 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576224    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576307 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576275    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576307 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576302    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576328    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576366    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576391    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576414    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576444    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576467    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-kube-api-access-9s97v\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576523    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.576567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576545    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576571    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576611    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576639    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576673    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576699    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576731    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576786    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.577024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.576812    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.677862 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.677823    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678054 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.677897    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678054 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.677926    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678054 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.677952    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678054 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.677991    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678054 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678018    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678054 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678099    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-kube-api-access-9s97v\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678116    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678140    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678157    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678176    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678204    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678222    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678245    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678261    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678281    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678312    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.678360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.678329    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.680250 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.679678    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.680250 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.679822    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.680250 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.679821    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.680545 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.680516    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.681212 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.681060    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.687809 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.685599    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.687809 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.686612    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.687809 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.687467    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.688550 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.688309    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.688550 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.688352    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.690764 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.688712    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.690764 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.689089    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.690764 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.690146    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.691515 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.691315    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.692874 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.692652    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.695381 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.693232    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.702029 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.701931    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config-out\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.702270 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.702225    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-web-config\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.703349 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.703297    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.704030 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.704004    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-kube-api-access-9s97v\") pod \"prometheus-k8s-0\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:18.849037 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:18.849010    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:19.051654 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:19.051620    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:04:19.090755 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:19.090724    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" event={"ID":"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe","Type":"ContainerStarted","Data":"61f112959008ec5cba61ca8d8bfb32bace815ecaef99841a88bbd446a8276a71"}
Jun 10 20:04:19.091111 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:19.090801    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" event={"ID":"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe","Type":"ContainerStarted","Data":"99a4c068a92a005207a7d1b33da1cf5d2d5f37778ebf32ec0335bc9b41842146"}
Jun 10 20:04:19.092236 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:19.092181    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerStarted","Data":"bb5dcc8aa92bf552e452bf8b6bb9af7c6039ba9584a4f86707b84922daee9448"}
Jun 10 20:04:19.693809 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:19.693771    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-hvwvn" podUID="1d6bf961-4890-45a4-9703-9f6afad50e86"
Jun 10 20:04:20.099185 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.099145    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79" event={"ID":"f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb","Type":"ContainerStarted","Data":"5dc38c29f2fc7bbcdcb5701a7514bc832cba1376e3651696b4d33b52cad63302"}
Jun 10 20:04:20.099655 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.099217    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:20.103336 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.103311    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:04:20.103444 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.103365    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" event={"ID":"6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe","Type":"ContainerStarted","Data":"0020706b44dd9b37c9d1b943f8ce6ecc795c5206d933214e7ecaf712182ea39f"}
Jun 10 20:04:20.103690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.103611    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:20.105418 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.105399    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79"
Jun 10 20:04:20.115033 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.114989    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-76b68cc874-fsx79" podStartSLOduration=1.5062238749999999 podStartE2EDuration="3.114977243s" totalImagesPullingTime="1.608753368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:20.113951893 +0000 UTC m=+282.374921585" watchObservedRunningTime="2026-06-10 20:04:20.114977243 +0000 UTC m=+282.375946938"
Jun 10 20:04:20.136322 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.136279    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh" podStartSLOduration=2.327419472 podStartE2EDuration="5.136261737s" totalImagesPullingTime="2.808842265s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:15 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:20.133784958 +0000 UTC m=+282.394754677" watchObservedRunningTime="2026-06-10 20:04:20.136261737 +0000 UTC m=+282.397231431"
Jun 10 20:04:20.934444 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.934420    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:20.934549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.934508    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:20.935789 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.935768    2578 patch_prober.go:28] interesting pod/console-79cddfcdd4-62l4g container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body=
Jun 10 20:04:20.935888 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:20.935809    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-79cddfcdd4-62l4g" podUID="a2be0226-3d5c-4627-9469-cbae8686ec24" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused"
Jun 10 20:04:21.109699 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:21.109663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd" event={"ID":"be9bc895-d40c-4f95-ad6a-1d019469b8ee","Type":"ContainerStarted","Data":"e76717abf0bbec783234abb747d008f6d48a607f6c98ac7c0c839cb316bf6b98"}
Jun 10 20:04:21.110143 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:21.109736    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd" event={"ID":"be9bc895-d40c-4f95-ad6a-1d019469b8ee","Type":"ContainerStarted","Data":"8d8035d5450f5eee083c9aa38a6504d88478ffd6739e931d84a179766f867adc"}
Jun 10 20:04:21.110143 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:21.109767    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd" event={"ID":"be9bc895-d40c-4f95-ad6a-1d019469b8ee","Type":"ContainerStarted","Data":"11b0203bf98cf47db44d65f9c032aa12547ea527aebf13b324bd1de45535f3b2"}
Jun 10 20:04:21.111158 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:21.111133    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae" exitCode=0
Jun 10 20:04:21.111261 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:21.111217    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"}
Jun 10 20:04:21.130913 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:21.130846    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b6cc6968c-6bzfd" podStartSLOduration=1.406645156 podStartE2EDuration="4.130828706s" totalImagesPullingTime="2.72418355s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:21.129047708 +0000 UTC m=+283.390017410" watchObservedRunningTime="2026-06-10 20:04:21.130828706 +0000 UTC m=+283.391798400"
Jun 10 20:04:22.618190 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:22.618153    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:04:22.620363 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:22.620339    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1d6bf961-4890-45a4-9703-9f6afad50e86-metrics-tls\") pod \"dns-default-hvwvn\" (UID: \"1d6bf961-4890-45a4-9703-9f6afad50e86\") " pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:04:22.806758 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:22.806730    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jb7fp\""
Jun 10 20:04:22.814512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:22.814485    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:04:22.941383 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:22.941215    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-hvwvn"]
Jun 10 20:04:22.944513 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:04:22.944487    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d6bf961_4890_45a4_9703_9f6afad50e86.slice/crio-4943ec76899231a7381f25587e2d91bd9d84fcb858f27b948d7b1bb3f0996152 WatchSource:0}: Error finding container 4943ec76899231a7381f25587e2d91bd9d84fcb858f27b948d7b1bb3f0996152: Status 404 returned error can't find the container with id 4943ec76899231a7381f25587e2d91bd9d84fcb858f27b948d7b1bb3f0996152
Jun 10 20:04:23.121865 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:23.121826    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvwvn" event={"ID":"1d6bf961-4890-45a4-9703-9f6afad50e86","Type":"ContainerStarted","Data":"4943ec76899231a7381f25587e2d91bd9d84fcb858f27b948d7b1bb3f0996152"}
Jun 10 20:04:24.238695 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:24.238659    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cddfcdd4-62l4g"]
Jun 10 20:04:26.117028 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.116997    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-5cc996d8d5-d52rh"
Jun 10 20:04:26.137748 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.137722    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvwvn" event={"ID":"1d6bf961-4890-45a4-9703-9f6afad50e86","Type":"ContainerStarted","Data":"7be3dbf775bf88c20968e8a32a2f90278bf17e64c38e36d92c3dcfb4bba833fc"}
Jun 10 20:04:26.137918 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.137771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:04:26.137918 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.137795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-hvwvn" event={"ID":"1d6bf961-4890-45a4-9703-9f6afad50e86","Type":"ContainerStarted","Data":"29a9566716151a240149a12d65e50b7be690e26382982bf4a80efd41fff3ad91"}
Jun 10 20:04:26.140713 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.140688    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerStarted","Data":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"}
Jun 10 20:04:26.140823 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.140753    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerStarted","Data":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"}
Jun 10 20:04:26.140823 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.140795    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerStarted","Data":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"}
Jun 10 20:04:26.140941 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.140834    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerStarted","Data":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"}
Jun 10 20:04:26.140941 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.140886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerStarted","Data":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"}
Jun 10 20:04:26.140941 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.140911    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerStarted","Data":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"}
Jun 10 20:04:26.165307 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.165264    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-hvwvn" podStartSLOduration=251.780018337 podStartE2EDuration="4m14.165249399s" totalImagesPullingTime="2.385231062s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:00:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:26.163763357 +0000 UTC m=+288.424733077" watchObservedRunningTime="2026-06-10 20:04:26.165249399 +0000 UTC m=+288.426219108"
Jun 10 20:04:26.189231 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:26.189181    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.301184185 podStartE2EDuration="8.189159734s" totalImagesPullingTime="5.868231524s" totalInitContainerRuntime="19.744025ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:04:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:04:26.187677749 +0000 UTC m=+288.448647466" watchObservedRunningTime="2026-06-10 20:04:26.189159734 +0000 UTC m=+288.450129428"
Jun 10 20:04:28.149837 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:28.149752    2578 generic.go:356] "Generic (PLEG): container finished" podID="daef2cb7-6983-4f31-96b8-d5831a884415" containerID="7ab57d81f8cce8df637a68e0e65f4289c8a17312b6d929557d7976da324a29c2" exitCode=255
Jun 10 20:04:28.149837 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:28.149825    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" event={"ID":"daef2cb7-6983-4f31-96b8-d5831a884415","Type":"ContainerDied","Data":"7ab57d81f8cce8df637a68e0e65f4289c8a17312b6d929557d7976da324a29c2"}
Jun 10 20:04:28.150351 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:28.149891    2578 scope.go:117] "RemoveContainer" containerID="a95a215a15c0c8a6228b0695cc60fa6c8979a3b644a72584029452569ae3280a"
Jun 10 20:04:28.156163 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:28.156145    2578 scope.go:117] "RemoveContainer" containerID="7ab57d81f8cce8df637a68e0e65f4289c8a17312b6d929557d7976da324a29c2"
Jun 10 20:04:28.156343 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:28.156326    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f59648f88-pk6wc_open-cluster-management-agent-addon(daef2cb7-6983-4f31-96b8-d5831a884415)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" podUID="daef2cb7-6983-4f31-96b8-d5831a884415"
Jun 10 20:04:28.849827 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:28.849800    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:04:29.156676 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:29.156588    2578 generic.go:356] "Generic (PLEG): container finished" podID="ce390345-db7a-48b8-b6cb-39966e914b04" containerID="c0b87a1a6861955ac858fc6d83d6880b878468ca815b59c9cbab2f38ef828cc3" exitCode=1
Jun 10 20:04:29.156676 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:29.156633    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" event={"ID":"ce390345-db7a-48b8-b6cb-39966e914b04","Type":"ContainerDied","Data":"c0b87a1a6861955ac858fc6d83d6880b878468ca815b59c9cbab2f38ef828cc3"}
Jun 10 20:04:29.156676 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:29.156676    2578 scope.go:117] "RemoveContainer" containerID="9c310175afc8926154caf5febb3d3626a917ecbadd897a64705a269b4e49a42e"
Jun 10 20:04:29.157162 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:29.157132    2578 scope.go:117] "RemoveContainer" containerID="c0b87a1a6861955ac858fc6d83d6880b878468ca815b59c9cbab2f38ef828cc3"
Jun 10 20:04:29.157382 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:29.157353    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-c8f65fcfd-z9gvv_open-cluster-management-agent-addon(ce390345-db7a-48b8-b6cb-39966e914b04)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" podUID="ce390345-db7a-48b8-b6cb-39966e914b04"
Jun 10 20:04:29.735623 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:29.735592    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:04:30.166127 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:30.166099    2578 scope.go:117] "RemoveContainer" containerID="c0b87a1a6861955ac858fc6d83d6880b878468ca815b59c9cbab2f38ef828cc3"
Jun 10 20:04:30.166571 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:30.166286    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-c8f65fcfd-z9gvv_open-cluster-management-agent-addon(ce390345-db7a-48b8-b6cb-39966e914b04)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" podUID="ce390345-db7a-48b8-b6cb-39966e914b04"
Jun 10 20:04:30.241301 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:30.241275    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc"
Jun 10 20:04:30.241549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:30.241535    2578 scope.go:117] "RemoveContainer" containerID="7ab57d81f8cce8df637a68e0e65f4289c8a17312b6d929557d7976da324a29c2"
Jun 10 20:04:30.241681 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:30.241663    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-7f59648f88-pk6wc_open-cluster-management-agent-addon(daef2cb7-6983-4f31-96b8-d5831a884415)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" podUID="daef2cb7-6983-4f31-96b8-d5831a884415"
Jun 10 20:04:30.325473 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:30.325447    2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:04:31.170217 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:31.170187    2578 scope.go:117] "RemoveContainer" containerID="c0b87a1a6861955ac858fc6d83d6880b878468ca815b59c9cbab2f38ef828cc3"
Jun 10 20:04:31.170581 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:31.170349    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-c8f65fcfd-z9gvv_open-cluster-management-agent-addon(ce390345-db7a-48b8-b6cb-39966e914b04)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" podUID="ce390345-db7a-48b8-b6cb-39966e914b04"
Jun 10 20:04:36.145996 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:36.145966    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-hvwvn"
Jun 10 20:04:38.122728 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:38.122701    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:04:38.123863 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:38.123825    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:04:38.128982 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:38.128966    2578 kubelet.go:1648] "Image garbage collection succeeded"
Jun 10 20:04:41.164047 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:41.164024    2578 scope.go:117] "RemoveContainer" containerID="7ab57d81f8cce8df637a68e0e65f4289c8a17312b6d929557d7976da324a29c2"
Jun 10 20:04:42.158612 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:42.158578    2578 scope.go:117] "RemoveContainer" containerID="c0b87a1a6861955ac858fc6d83d6880b878468ca815b59c9cbab2f38ef828cc3"
Jun 10 20:04:42.212030 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:42.212007    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" event={"ID":"ce390345-db7a-48b8-b6cb-39966e914b04","Type":"ContainerStarted","Data":"896aae5be321b15883d384935cd4ec87f42e9868dc7ca519d5703df43f40c282"}
Jun 10 20:04:42.212392 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:42.212373    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:04:42.213174 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:42.213145    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv" podUID="ce390345-db7a-48b8-b6cb-39966e914b04" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused"
Jun 10 20:04:42.213918 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:42.213900    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-7f59648f88-pk6wc" event={"ID":"daef2cb7-6983-4f31-96b8-d5831a884415","Type":"ContainerStarted","Data":"44a4942af2c55a7a7f3ddf5858bc2c9abd1efd9187ba1be4bd79bb8243044b4e"}
Jun 10 20:04:43.219474 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:43.219448    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-c8f65fcfd-z9gvv"
Jun 10 20:04:44.504465 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:44.504440    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvwvn_1d6bf961-4890-45a4-9703-9f6afad50e86/dns/0.log"
Jun 10 20:04:44.705363 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:44.705337    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvwvn_1d6bf961-4890-45a4-9703-9f6afad50e86/kube-rbac-proxy/0.log"
Jun 10 20:04:45.305221 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:45.305197    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44nqh_93721cdf-fcd3-43ab-9905-44589865da03/dns-node-resolver/0.log"
Jun 10 20:04:46.304958 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:46.304931    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mlp2j_eb1ff4e1-c35f-4c37-a044-53198f153956/serve-healthcheck-canary/0.log"
Jun 10 20:04:49.260296 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.260254    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-79cddfcdd4-62l4g" podUID="a2be0226-3d5c-4627-9469-cbae8686ec24" containerName="console" containerID="cri-o://4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d" gracePeriod=15
Jun 10 20:04:49.558564 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.558536    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:49.756222 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756186    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rktv6\" (UniqueName: \"kubernetes.io/projected/a2be0226-3d5c-4627-9469-cbae8686ec24-kube-api-access-rktv6\") pod \"a2be0226-3d5c-4627-9469-cbae8686ec24\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") "
Jun 10 20:04:49.756222 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756225    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-serving-cert\") pod \"a2be0226-3d5c-4627-9469-cbae8686ec24\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") "
Jun 10 20:04:49.756457 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756246    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-oauth-config\") pod \"a2be0226-3d5c-4627-9469-cbae8686ec24\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") "
Jun 10 20:04:49.756457 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756277    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-service-ca\") pod \"a2be0226-3d5c-4627-9469-cbae8686ec24\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") "
Jun 10 20:04:49.756457 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756319    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-oauth-serving-cert\") pod \"a2be0226-3d5c-4627-9469-cbae8686ec24\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") "
Jun 10 20:04:49.756457 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756364    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-console-config\") pod \"a2be0226-3d5c-4627-9469-cbae8686ec24\" (UID: \"a2be0226-3d5c-4627-9469-cbae8686ec24\") "
Jun 10 20:04:49.756837 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756801    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-service-ca" (OuterVolumeSpecName: "service-ca") pod "a2be0226-3d5c-4627-9469-cbae8686ec24" (UID: "a2be0226-3d5c-4627-9469-cbae8686ec24"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:04:49.756994 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756883    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-console-config" (OuterVolumeSpecName: "console-config") pod "a2be0226-3d5c-4627-9469-cbae8686ec24" (UID: "a2be0226-3d5c-4627-9469-cbae8686ec24"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:04:49.756994 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.756810    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a2be0226-3d5c-4627-9469-cbae8686ec24" (UID: "a2be0226-3d5c-4627-9469-cbae8686ec24"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:04:49.758516 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.758494    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a2be0226-3d5c-4627-9469-cbae8686ec24" (UID: "a2be0226-3d5c-4627-9469-cbae8686ec24"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:04:49.758809 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.758785    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a2be0226-3d5c-4627-9469-cbae8686ec24" (UID: "a2be0226-3d5c-4627-9469-cbae8686ec24"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:04:49.758918 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.758807    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2be0226-3d5c-4627-9469-cbae8686ec24-kube-api-access-rktv6" (OuterVolumeSpecName: "kube-api-access-rktv6") pod "a2be0226-3d5c-4627-9469-cbae8686ec24" (UID: "a2be0226-3d5c-4627-9469-cbae8686ec24"). InnerVolumeSpecName "kube-api-access-rktv6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:04:49.858059 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.857980    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rktv6\" (UniqueName: \"kubernetes.io/projected/a2be0226-3d5c-4627-9469-cbae8686ec24-kube-api-access-rktv6\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:04:49.858059 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.858009    2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-serving-cert\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:04:49.858059 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.858018    2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a2be0226-3d5c-4627-9469-cbae8686ec24-console-oauth-config\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:04:49.858059 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.858027    2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-service-ca\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:04:49.858059 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.858035    2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-oauth-serving-cert\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:04:49.858059 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:49.858044    2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a2be0226-3d5c-4627-9469-cbae8686ec24-console-config\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:04:50.245110 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.245073    2578 generic.go:356] "Generic (PLEG): container finished" podID="a2be0226-3d5c-4627-9469-cbae8686ec24" containerID="4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d" exitCode=0
Jun 10 20:04:50.245110 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.245111    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79cddfcdd4-62l4g"
Jun 10 20:04:50.245331 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.245155    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cddfcdd4-62l4g" event={"ID":"a2be0226-3d5c-4627-9469-cbae8686ec24","Type":"ContainerDied","Data":"4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d"}
Jun 10 20:04:50.245331 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.245214    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79cddfcdd4-62l4g" event={"ID":"a2be0226-3d5c-4627-9469-cbae8686ec24","Type":"ContainerDied","Data":"96fe7645f6048f26db394b04c22f9fa851906547a1530b503831fd044253b8b7"}
Jun 10 20:04:50.245331 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.245241    2578 scope.go:117] "RemoveContainer" containerID="4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d"
Jun 10 20:04:50.253319 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.253298    2578 scope.go:117] "RemoveContainer" containerID="4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d"
Jun 10 20:04:50.253583 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:04:50.253560    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d\": container with ID starting with 4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d not found: ID does not exist" containerID="4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d"
Jun 10 20:04:50.253669 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.253591    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d"} err="failed to get container status \"4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d\": rpc error: code = NotFound desc = could not find container \"4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d\": container with ID starting with 4ea2d1cb6ed8fd88f7da0f60bb55835c5d2ca94f7afd25d4f42223c1246a5e4d not found: ID does not exist"
Jun 10 20:04:50.260654 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.260632    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79cddfcdd4-62l4g"]
Jun 10 20:04:50.264402 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:50.264383    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79cddfcdd4-62l4g"]
Jun 10 20:04:52.163280 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:04:52.163249    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2be0226-3d5c-4627-9469-cbae8686ec24" path="/var/lib/kubelet/pods/a2be0226-3d5c-4627-9469-cbae8686ec24/volumes"
Jun 10 20:05:18.850138 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:18.850101    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:18.869599 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:18.869576    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:19.369565 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:19.369533    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:36.922124 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:36.922024    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:05:36.922716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:36.922333    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="prometheus" containerID="cri-o://e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592" gracePeriod=600
Jun 10 20:05:36.922716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:36.922358    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy" containerID="cri-o://71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf" gracePeriod=600
Jun 10 20:05:36.922716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:36.922388    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-web" containerID="cri-o://faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132" gracePeriod=600
Jun 10 20:05:36.922716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:36.922396    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="thanos-sidecar" containerID="cri-o://c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275" gracePeriod=600
Jun 10 20:05:36.922716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:36.922411    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="config-reloader" containerID="cri-o://f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a" gracePeriod=600
Jun 10 20:05:36.922716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:36.922473    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-thanos" containerID="cri-o://f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1" gracePeriod=600
Jun 10 20:05:37.189626 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.189601    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.254394 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254362    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-db\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254564 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254456    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-tls-assets\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254564 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254497    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-grpc-tls\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254564 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254534    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254700 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254563    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-serving-certs-ca-bundle\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254757 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254717    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-kube-rbac-proxy\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254810 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254764    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-0\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254810 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254797    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254940 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254822    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-2\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254940 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254877    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-web-config\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254940 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254910    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.254940 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254923    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:05:37.255140 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.254944    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-metrics-client-ca\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.255586 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255274    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255766    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-kube-api-access-9s97v\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255781    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255810    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config-out\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255919    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-kubelet-serving-ca-bundle\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255947    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-thanos-prometheus-http-client-file\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255949    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.255993    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-tls\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256030    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-metrics-client-certs\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256059    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-trusted-ca-bundle\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256238    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256339    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256358    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256374    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-metrics-client-ca\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256390    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-db\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256406    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256628    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:05:37.257000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.256647    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:05:37.258508 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.257267    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.258508 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.258035    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:05:37.258508 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.258106    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.258508 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.258243    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config" (OuterVolumeSpecName: "config") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.259078 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.259034    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.259829 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.259807    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-kube-api-access-9s97v" (OuterVolumeSpecName: "kube-api-access-9s97v") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "kube-api-access-9s97v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:05:37.259977 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.259949    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config-out" (OuterVolumeSpecName: "config-out") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:05:37.260060 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.260039    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.260112 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.260072    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.260759 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.260740    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.260844 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.260825    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.272791 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.272761    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-web-config" (OuterVolumeSpecName: "web-config") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:05:37.357335 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357292    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-1\") pod \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\" (UID: \"4fd0c014-8609-4d26-85e3-aebd2035b1b3\") "
Jun 10 20:05:37.357539 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357502    2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357539 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357522    2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357539 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357535    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357549    2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-metrics-client-certs\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357562    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357576    2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-tls-assets\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357591    2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-grpc-tls\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357604    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357619    2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-kube-rbac-proxy\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357633    2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357636    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "4fd0c014-8609-4d26-85e3-aebd2035b1b3" (UID: "4fd0c014-8609-4d26-85e3-aebd2035b1b3"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357646    2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-web-config\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.357697 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357691    2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4fd0c014-8609-4d26-85e3-aebd2035b1b3-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.358023 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357702    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9s97v\" (UniqueName: \"kubernetes.io/projected/4fd0c014-8609-4d26-85e3-aebd2035b1b3-kube-api-access-9s97v\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.358023 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.357716    2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4fd0c014-8609-4d26-85e3-aebd2035b1b3-config-out\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.429159 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429123    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1" exitCode=0
Jun 10 20:05:37.429159 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429147    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf" exitCode=0
Jun 10 20:05:37.429159 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429156    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132" exitCode=0
Jun 10 20:05:37.429159 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429163    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275" exitCode=0
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429172    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a" exitCode=0
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429179    2578 generic.go:356] "Generic (PLEG): container finished" podID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592" exitCode=0
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429196    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429198    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"}
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429267    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"}
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"}
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"}
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429341    2578 scope.go:117] "RemoveContainer" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429344    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"}
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429444    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"}
Jun 10 20:05:37.429490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.429474    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4fd0c014-8609-4d26-85e3-aebd2035b1b3","Type":"ContainerDied","Data":"bb5dcc8aa92bf552e452bf8b6bb9af7c6039ba9584a4f86707b84922daee9448"}
Jun 10 20:05:37.437812 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.437680    2578 scope.go:117] "RemoveContainer" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.445031 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.445015    2578 scope.go:117] "RemoveContainer" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.452748 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.452727    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:05:37.452810 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.452731    2578 scope.go:117] "RemoveContainer" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.457135 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.457113    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:05:37.459066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.459044    2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4fd0c014-8609-4d26-85e3-aebd2035b1b3-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:05:37.460480 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.460463    2578 scope.go:117] "RemoveContainer" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.466901 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.466887    2578 scope.go:117] "RemoveContainer" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.474255 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.474237    2578 scope.go:117] "RemoveContainer" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.481596 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.481460    2578 scope.go:117] "RemoveContainer" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.482017 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:05:37.481995    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": container with ID starting with f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1 not found: ID does not exist" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.482119 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482031    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"} err="failed to get container status \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": rpc error: code = NotFound desc = could not find container \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": container with ID starting with f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1 not found: ID does not exist"
Jun 10 20:05:37.482119 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482052    2578 scope.go:117] "RemoveContainer" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.482297 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:05:37.482279    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": container with ID starting with 71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf not found: ID does not exist" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.482343 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482303    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"} err="failed to get container status \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": rpc error: code = NotFound desc = could not find container \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": container with ID starting with 71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf not found: ID does not exist"
Jun 10 20:05:37.482381 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482348    2578 scope.go:117] "RemoveContainer" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.482582 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:05:37.482563    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": container with ID starting with faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132 not found: ID does not exist" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.482663 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482585    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"} err="failed to get container status \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": rpc error: code = NotFound desc = could not find container \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": container with ID starting with faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132 not found: ID does not exist"
Jun 10 20:05:37.482663 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482597    2578 scope.go:117] "RemoveContainer" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.482876 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:05:37.482845    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": container with ID starting with c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275 not found: ID does not exist" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.482921 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482880    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"} err="failed to get container status \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": rpc error: code = NotFound desc = could not find container \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": container with ID starting with c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275 not found: ID does not exist"
Jun 10 20:05:37.482921 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.482891    2578 scope.go:117] "RemoveContainer" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.483076 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483060    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:05:37.483118 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:05:37.483093    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": container with ID starting with f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a not found: ID does not exist" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.483118 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483112    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"} err="failed to get container status \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": rpc error: code = NotFound desc = could not find container \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": container with ID starting with f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a not found: ID does not exist"
Jun 10 20:05:37.483201 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483124    2578 scope.go:117] "RemoveContainer" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.483330 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:05:37.483315    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": container with ID starting with e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592 not found: ID does not exist" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.483371 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483334    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"} err="failed to get container status \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": rpc error: code = NotFound desc = could not find container \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": container with ID starting with e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592 not found: ID does not exist"
Jun 10 20:05:37.483371 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483348    2578 scope.go:117] "RemoveContainer" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.483371 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483354    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="prometheus"
Jun 10 20:05:37.483371 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483366    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="prometheus"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483374    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483380    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483388    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-web"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483394    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-web"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483405    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="init-config-reloader"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483411    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="init-config-reloader"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483422    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="thanos-sidecar"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483430    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="thanos-sidecar"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483445    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-thanos"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483453    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-thanos"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483460    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="config-reloader"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483467    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="config-reloader"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483480    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2be0226-3d5c-4627-9469-cbae8686ec24" containerName="console"
Jun 10 20:05:37.483526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483488    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2be0226-3d5c-4627-9469-cbae8686ec24" containerName="console"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:05:37.483528    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": container with ID starting with 037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae not found: ID does not exist" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483537    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2be0226-3d5c-4627-9469-cbae8686ec24" containerName="console"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483547    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="prometheus"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483555    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483562    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-web"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483566    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="kube-rbac-proxy-thanos"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483572    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="config-reloader"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483577    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" containerName="thanos-sidecar"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483543    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"} err="failed to get container status \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": rpc error: code = NotFound desc = could not find container \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": container with ID starting with 037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae not found: ID does not exist"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483646    2578 scope.go:117] "RemoveContainer" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483846    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"} err="failed to get container status \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": rpc error: code = NotFound desc = could not find container \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": container with ID starting with f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1 not found: ID does not exist"
Jun 10 20:05:37.483985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.483887    2578 scope.go:117] "RemoveContainer" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.484569 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.484289    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"} err="failed to get container status \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": rpc error: code = NotFound desc = could not find container \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": container with ID starting with 71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf not found: ID does not exist"
Jun 10 20:05:37.484569 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.484310    2578 scope.go:117] "RemoveContainer" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.484648 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.484608    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"} err="failed to get container status \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": rpc error: code = NotFound desc = could not find container \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": container with ID starting with faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132 not found: ID does not exist"
Jun 10 20:05:37.484648 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.484623    2578 scope.go:117] "RemoveContainer" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.484890 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.484867    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"} err="failed to get container status \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": rpc error: code = NotFound desc = could not find container \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": container with ID starting with c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275 not found: ID does not exist"
Jun 10 20:05:37.484978 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.484892    2578 scope.go:117] "RemoveContainer" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.485151 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485128    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"} err="failed to get container status \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": rpc error: code = NotFound desc = could not find container \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": container with ID starting with f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a not found: ID does not exist"
Jun 10 20:05:37.485151 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485150    2578 scope.go:117] "RemoveContainer" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.485392 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485366    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"} err="failed to get container status \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": rpc error: code = NotFound desc = could not find container \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": container with ID starting with e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592 not found: ID does not exist"
Jun 10 20:05:37.485392 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485391    2578 scope.go:117] "RemoveContainer" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.485677 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485643    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"} err="failed to get container status \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": rpc error: code = NotFound desc = could not find container \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": container with ID starting with 037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae not found: ID does not exist"
Jun 10 20:05:37.485677 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485668    2578 scope.go:117] "RemoveContainer" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.485938 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485910    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"} err="failed to get container status \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": rpc error: code = NotFound desc = could not find container \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": container with ID starting with f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1 not found: ID does not exist"
Jun 10 20:05:37.485938 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.485936    2578 scope.go:117] "RemoveContainer" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.486245 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486140    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"} err="failed to get container status \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": rpc error: code = NotFound desc = could not find container \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": container with ID starting with 71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf not found: ID does not exist"
Jun 10 20:05:37.486245 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486159    2578 scope.go:117] "RemoveContainer" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.486385 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486340    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"} err="failed to get container status \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": rpc error: code = NotFound desc = could not find container \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": container with ID starting with faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132 not found: ID does not exist"
Jun 10 20:05:37.486385 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486358    2578 scope.go:117] "RemoveContainer" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486536    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"} err="failed to get container status \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": rpc error: code = NotFound desc = could not find container \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": container with ID starting with c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275 not found: ID does not exist"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486555    2578 scope.go:117] "RemoveContainer" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486723    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"} err="failed to get container status \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": rpc error: code = NotFound desc = could not find container \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": container with ID starting with f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a not found: ID does not exist"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486744    2578 scope.go:117] "RemoveContainer" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.486997    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"} err="failed to get container status \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": rpc error: code = NotFound desc = could not find container \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": container with ID starting with e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592 not found: ID does not exist"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.487016    2578 scope.go:117] "RemoveContainer" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.487191    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"} err="failed to get container status \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": rpc error: code = NotFound desc = could not find container \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": container with ID starting with 037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae not found: ID does not exist"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.487288    2578 scope.go:117] "RemoveContainer" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.487517    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"} err="failed to get container status \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": rpc error: code = NotFound desc = could not find container \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": container with ID starting with f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1 not found: ID does not exist"
Jun 10 20:05:37.487650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.487537    2578 scope.go:117] "RemoveContainer" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.488214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.487753    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"} err="failed to get container status \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": rpc error: code = NotFound desc = could not find container \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": container with ID starting with 71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf not found: ID does not exist"
Jun 10 20:05:37.488214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.487776    2578 scope.go:117] "RemoveContainer" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.488214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488035    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"} err="failed to get container status \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": rpc error: code = NotFound desc = could not find container \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": container with ID starting with faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132 not found: ID does not exist"
Jun 10 20:05:37.488214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488058    2578 scope.go:117] "RemoveContainer" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.488360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488288    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"} err="failed to get container status \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": rpc error: code = NotFound desc = could not find container \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": container with ID starting with c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275 not found: ID does not exist"
Jun 10 20:05:37.488360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488303    2578 scope.go:117] "RemoveContainer" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.488550 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488533    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"} err="failed to get container status \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": rpc error: code = NotFound desc = could not find container \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": container with ID starting with f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a not found: ID does not exist"
Jun 10 20:05:37.488596 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488551    2578 scope.go:117] "RemoveContainer" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.488752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488737    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"} err="failed to get container status \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": rpc error: code = NotFound desc = could not find container \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": container with ID starting with e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592 not found: ID does not exist"
Jun 10 20:05:37.488791 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488752    2578 scope.go:117] "RemoveContainer" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.488955 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488940    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"} err="failed to get container status \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": rpc error: code = NotFound desc = could not find container \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": container with ID starting with 037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae not found: ID does not exist"
Jun 10 20:05:37.488955 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.488955    2578 scope.go:117] "RemoveContainer" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.489171 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.489155    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"} err="failed to get container status \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": rpc error: code = NotFound desc = could not find container \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": container with ID starting with f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1 not found: ID does not exist"
Jun 10 20:05:37.489255 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.489172    2578 scope.go:117] "RemoveContainer" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.489306 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.489274    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.489653 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.489456    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"} err="failed to get container status \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": rpc error: code = NotFound desc = could not find container \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": container with ID starting with 71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf not found: ID does not exist"
Jun 10 20:05:37.489653 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.489483    2578 scope.go:117] "RemoveContainer" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.489901 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.489874    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"} err="failed to get container status \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": rpc error: code = NotFound desc = could not find container \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": container with ID starting with faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132 not found: ID does not exist"
Jun 10 20:05:37.489955 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.489905    2578 scope.go:117] "RemoveContainer" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.490297 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.490192    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"} err="failed to get container status \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": rpc error: code = NotFound desc = could not find container \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": container with ID starting with c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275 not found: ID does not exist"
Jun 10 20:05:37.490297 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.490225    2578 scope.go:117] "RemoveContainer" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.490486 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.490462    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"} err="failed to get container status \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": rpc error: code = NotFound desc = could not find container \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": container with ID starting with f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a not found: ID does not exist"
Jun 10 20:05:37.490556 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.490491    2578 scope.go:117] "RemoveContainer" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.490752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.490732    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"} err="failed to get container status \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": rpc error: code = NotFound desc = could not find container \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": container with ID starting with e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592 not found: ID does not exist"
Jun 10 20:05:37.490752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.490750    2578 scope.go:117] "RemoveContainer" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.491026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491007    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"} err="failed to get container status \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": rpc error: code = NotFound desc = could not find container \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": container with ID starting with 037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae not found: ID does not exist"
Jun 10 20:05:37.491107 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491028    2578 scope.go:117] "RemoveContainer" containerID="f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"
Jun 10 20:05:37.491239 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491223    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1"} err="failed to get container status \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": rpc error: code = NotFound desc = could not find container \"f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1\": container with ID starting with f085e99a2748dc577662a18d04782d9c8e59abf9e10f16c3c57ecc4b85e6c5f1 not found: ID does not exist"
Jun 10 20:05:37.491311 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491242    2578 scope.go:117] "RemoveContainer" containerID="71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"
Jun 10 20:05:37.491505 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491487    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf"} err="failed to get container status \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": rpc error: code = NotFound desc = could not find container \"71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf\": container with ID starting with 71e3d6c3a0073c06085fd4da049631a19691d088e29742f2a29c4eb1523eb3bf not found: ID does not exist"
Jun 10 20:05:37.491552 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491507    2578 scope.go:117] "RemoveContainer" containerID="faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"
Jun 10 20:05:37.491679 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491661    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 10 20:05:37.491795 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491662    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 10 20:05:37.491930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491863    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132"} err="failed to get container status \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": rpc error: code = NotFound desc = could not find container \"faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132\": container with ID starting with faf11e73d71f79eac63be65639024a63a2306b0cc4be04b64b6671a9e7f7d132 not found: ID does not exist"
Jun 10 20:05:37.491930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.491909    2578 scope.go:117] "RemoveContainer" containerID="c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"
Jun 10 20:05:37.492109 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492044    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 10 20:05:37.492109 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492053    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 10 20:05:37.492109 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492062    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 10 20:05:37.492109 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492056    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 10 20:05:37.492329 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492267    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jun 10 20:05:37.492471 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492454    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3jr6pmjd6ttti\""
Jun 10 20:05:37.492556 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492503    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275"} err="failed to get container status \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": rpc error: code = NotFound desc = could not find container \"c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275\": container with ID starting with c40a35a01d440b9d3a7f5207b41a19419cf46e11b756db345241022daf077275 not found: ID does not exist"
Jun 10 20:05:37.492643 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492569    2578 scope.go:117] "RemoveContainer" containerID="f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"
Jun 10 20:05:37.492723 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492646    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 10 20:05:37.492788 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492736    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 10 20:05:37.492788 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492765    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 10 20:05:37.492979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492910    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a"} err="failed to get container status \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": rpc error: code = NotFound desc = could not find container \"f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a\": container with ID starting with f07d82f10f0bf2b6402efa6975048e88b6068b5af404a16a9e22639c420a129a not found: ID does not exist"
Jun 10 20:05:37.492979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492926    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-m8xrr\""
Jun 10 20:05:37.492979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492933    2578 scope.go:117] "RemoveContainer" containerID="e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"
Jun 10 20:05:37.492979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492937    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jun 10 20:05:37.493198 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.492983    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 10 20:05:37.493305 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.493268    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592"} err="failed to get container status \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": rpc error: code = NotFound desc = could not find container \"e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592\": container with ID starting with e528c2242afef2fb0c68ba094f189a373b81917c613d5f0c32eb494740ff7592 not found: ID does not exist"
Jun 10 20:05:37.493305 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.493305    2578 scope.go:117] "RemoveContainer" containerID="037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"
Jun 10 20:05:37.493493 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.493363    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 10 20:05:37.493733 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.493706    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae"} err="failed to get container status \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": rpc error: code = NotFound desc = could not find container \"037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae\": container with ID starting with 037827c8986d4d6f7ee5b3dda90d570f744b441878e1efa470d1608955d3f2ae not found: ID does not exist"
Jun 10 20:05:37.494497 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.494480    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 10 20:05:37.498089 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.498069    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 10 20:05:37.504784 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.504765    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:05:37.559700 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559666    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559700 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559700    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9wt6f\" (UniqueName: \"kubernetes.io/projected/103f5324-9a35-4326-ba59-aa451f7f0bc1-kube-api-access-9wt6f\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559728    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559747    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559769    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559800    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103f5324-9a35-4326-ba59-aa451f7f0bc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559823    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.559926 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559924    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103f5324-9a35-4326-ba59-aa451f7f0bc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559945    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559963    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.559992    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560032    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560086    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560143    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-config\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560372 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560160    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560372 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560189    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.560372 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.560206    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661194 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661146    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661194 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9wt6f\" (UniqueName: \"kubernetes.io/projected/103f5324-9a35-4326-ba59-aa451f7f0bc1-kube-api-access-9wt6f\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661213    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661237    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661267    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661291    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103f5324-9a35-4326-ba59-aa451f7f0bc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661315    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661341    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661403 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661396    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103f5324-9a35-4326-ba59-aa451f7f0bc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661424    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661453    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661518    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661544    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.661752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661566    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.662105 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.661919    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.662164 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.662126    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.662780 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.662440    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664406 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664379    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-config\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664491    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664524    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664539    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/103f5324-9a35-4326-ba59-aa451f7f0bc1-config-out\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664554    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664566    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-web-config\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664609    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664642    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.664668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.664652    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.665217 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.665194    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.665296 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.665217    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.665296 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.665221    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.665296 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.665275    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.665637 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.665619    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.665807 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.665785    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.666644 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.666624    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/103f5324-9a35-4326-ba59-aa451f7f0bc1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.667053 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.667034    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.667169 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.667148    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/103f5324-9a35-4326-ba59-aa451f7f0bc1-config\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.668116 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.668100    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/103f5324-9a35-4326-ba59-aa451f7f0bc1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.668629 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.668610    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9wt6f\" (UniqueName: \"kubernetes.io/projected/103f5324-9a35-4326-ba59-aa451f7f0bc1-kube-api-access-9wt6f\") pod \"prometheus-k8s-0\" (UID: \"103f5324-9a35-4326-ba59-aa451f7f0bc1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.799526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.799492    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:05:37.934633 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:37.934597    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 10 20:05:37.938076 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:05:37.938046    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod103f5324_9a35_4326_ba59_aa451f7f0bc1.slice/crio-429f03fe815bbbaa9eabb17b9393dadfe779765e4f33dfd756969755c112f9b1 WatchSource:0}: Error finding container 429f03fe815bbbaa9eabb17b9393dadfe779765e4f33dfd756969755c112f9b1: Status 404 returned error can't find the container with id 429f03fe815bbbaa9eabb17b9393dadfe779765e4f33dfd756969755c112f9b1
Jun 10 20:05:38.161973 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:38.161945    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4fd0c014-8609-4d26-85e3-aebd2035b1b3" path="/var/lib/kubelet/pods/4fd0c014-8609-4d26-85e3-aebd2035b1b3/volumes"
Jun 10 20:05:38.435189 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:38.435099    2578 generic.go:356] "Generic (PLEG): container finished" podID="103f5324-9a35-4326-ba59-aa451f7f0bc1" containerID="97b7b2a01a5fc2cf5022c5e39540be1e13ff1ae4bde0391e4b2ea435531b9157" exitCode=0
Jun 10 20:05:38.435329 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:38.435190    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerDied","Data":"97b7b2a01a5fc2cf5022c5e39540be1e13ff1ae4bde0391e4b2ea435531b9157"}
Jun 10 20:05:38.435329 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:38.435256    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerStarted","Data":"429f03fe815bbbaa9eabb17b9393dadfe779765e4f33dfd756969755c112f9b1"}
Jun 10 20:05:39.442328 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:39.442293    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerStarted","Data":"a705bcc74c2c3de91f20898bbdc54414908dcf0e0700c7bf60bc9ab364e263ab"}
Jun 10 20:05:39.442772 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:39.442368    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerStarted","Data":"17ff17e94e698e2805452fac20b6c5b60c42d16560f91882597360680fcede3b"}
Jun 10 20:05:39.442915 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:39.442886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerStarted","Data":"a565c3b7455c428037a14c7d68af64f11a5cc58f81da9b6dbf0dae5140f1efe0"}
Jun 10 20:05:39.443006 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:39.442972    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerStarted","Data":"e9cc690ad3b1fa2d2642e4cb9635dd711a8c9270a34d9201df538684489a3b07"}
Jun 10 20:05:39.443067 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:39.443034    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerStarted","Data":"5dcba08082a8599a35306a7f6c90b491d930dd566976a90ba58d5d97a19a2be9"}
Jun 10 20:05:39.443121 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:39.443096    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"103f5324-9a35-4326-ba59-aa451f7f0bc1","Type":"ContainerStarted","Data":"4e8525f99e483151f443271474c09f5229f9f3eef848701a5905cd5d3c5c08dd"}
Jun 10 20:05:39.470970 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:39.470908    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.44923035 podStartE2EDuration="2.47089206s" totalImagesPullingTime="0s" totalInitContainerRuntime="21.66171ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:05:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:05:39.469398095 +0000 UTC m=+361.730367787" watchObservedRunningTime="2026-06-10 20:05:39.47089206 +0000 UTC m=+361.731861751"
Jun 10 20:05:42.799936 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:05:42.799896    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:06:37.799663 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:06:37.799631    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:06:37.814788 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:06:37.814764    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:06:38.678311 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:06:38.678282    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 10 20:07:14.786147 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.786111    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"]
Jun 10 20:07:14.789399 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.789377    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:14.792171 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.792146    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 10 20:07:14.792291 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.792200    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 10 20:07:14.793251 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.793235    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-qdbjq\""
Jun 10 20:07:14.798301 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.798279    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"]
Jun 10 20:07:14.939363 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.939333    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66882691-5c43-43cb-9636-29a4c327ab51-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xjr88\" (UID: \"66882691-5c43-43cb-9636-29a4c327ab51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:14.939544 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:14.939398    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mrrrb\" (UniqueName: \"kubernetes.io/projected/66882691-5c43-43cb-9636-29a4c327ab51-kube-api-access-mrrrb\") pod \"openshift-lws-operator-fd8ccff4c-xjr88\" (UID: \"66882691-5c43-43cb-9636-29a4c327ab51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:15.040536 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.040464    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mrrrb\" (UniqueName: \"kubernetes.io/projected/66882691-5c43-43cb-9636-29a4c327ab51-kube-api-access-mrrrb\") pod \"openshift-lws-operator-fd8ccff4c-xjr88\" (UID: \"66882691-5c43-43cb-9636-29a4c327ab51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:15.040536 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.040517    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66882691-5c43-43cb-9636-29a4c327ab51-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xjr88\" (UID: \"66882691-5c43-43cb-9636-29a4c327ab51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:15.040945 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.040928    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/66882691-5c43-43cb-9636-29a4c327ab51-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xjr88\" (UID: \"66882691-5c43-43cb-9636-29a4c327ab51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:15.048061 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.048039    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mrrrb\" (UniqueName: \"kubernetes.io/projected/66882691-5c43-43cb-9636-29a4c327ab51-kube-api-access-mrrrb\") pod \"openshift-lws-operator-fd8ccff4c-xjr88\" (UID: \"66882691-5c43-43cb-9636-29a4c327ab51\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:15.099023 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.099001    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"
Jun 10 20:07:15.230986 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.230905    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88"]
Jun 10 20:07:15.233771 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:07:15.233742    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod66882691_5c43_43cb_9636_29a4c327ab51.slice/crio-202727854a60b051079412d6baa2933877fbc04a0dd87a5190d27e643768f94f WatchSource:0}: Error finding container 202727854a60b051079412d6baa2933877fbc04a0dd87a5190d27e643768f94f: Status 404 returned error can't find the container with id 202727854a60b051079412d6baa2933877fbc04a0dd87a5190d27e643768f94f
Jun 10 20:07:15.235690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.235669    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 20:07:15.800258 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:15.800226    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88" event={"ID":"66882691-5c43-43cb-9636-29a4c327ab51","Type":"ContainerStarted","Data":"202727854a60b051079412d6baa2933877fbc04a0dd87a5190d27e643768f94f"}
Jun 10 20:07:18.814410 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:18.814371    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88" event={"ID":"66882691-5c43-43cb-9636-29a4c327ab51","Type":"ContainerStarted","Data":"801c800b5ad79ceb3771db904a49de6a53f00330bd3dae6b8a57aa7864f00ed2"}
Jun 10 20:07:18.832424 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:18.832188    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xjr88" podStartSLOduration=2.222324329 podStartE2EDuration="4.832169744s" totalImagesPullingTime="2.609845415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:07:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:18.832131472 +0000 UTC m=+461.093101164" watchObservedRunningTime="2026-06-10 20:07:18.832169744 +0000 UTC m=+461.093139436"
Jun 10 20:07:33.900378 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.900343    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"]
Jun 10 20:07:33.903803 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.903781    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:33.908006 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.907984    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 10 20:07:33.908006 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.907999    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 10 20:07:33.908196 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.908009    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-x75b9\""
Jun 10 20:07:33.908262 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.908245    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 10 20:07:33.908701 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.908685    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 10 20:07:33.920820 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:33.920794    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"]
Jun 10 20:07:34.102306 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.102268    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cceb920-8829-4f39-8ef2-f9aefadeeb63-webhook-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.102306 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.102309    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cceb920-8829-4f39-8ef2-f9aefadeeb63-tmp\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.102513 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.102329    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2cceb920-8829-4f39-8ef2-f9aefadeeb63-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.102513 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.102411    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2cceb920-8829-4f39-8ef2-f9aefadeeb63-manifests\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.102513 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.102464    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-csp8f\" (UniqueName: \"kubernetes.io/projected/2cceb920-8829-4f39-8ef2-f9aefadeeb63-kube-api-access-csp8f\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.203912 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.203804    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2cceb920-8829-4f39-8ef2-f9aefadeeb63-manifests\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.203912 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.203890    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-csp8f\" (UniqueName: \"kubernetes.io/projected/2cceb920-8829-4f39-8ef2-f9aefadeeb63-kube-api-access-csp8f\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.204124 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.204005    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cceb920-8829-4f39-8ef2-f9aefadeeb63-webhook-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.204124 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.204040    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cceb920-8829-4f39-8ef2-f9aefadeeb63-tmp\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.204124 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.204069    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2cceb920-8829-4f39-8ef2-f9aefadeeb63-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.204274 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.204245    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/2cceb920-8829-4f39-8ef2-f9aefadeeb63-manifests\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.206409 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.206382    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2cceb920-8829-4f39-8ef2-f9aefadeeb63-tmp\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.206516 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.206414    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/2cceb920-8829-4f39-8ef2-f9aefadeeb63-webhook-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.206555 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.206541    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/2cceb920-8829-4f39-8ef2-f9aefadeeb63-apiservice-cert\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.211203 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.211186    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-csp8f\" (UniqueName: \"kubernetes.io/projected/2cceb920-8829-4f39-8ef2-f9aefadeeb63-kube-api-access-csp8f\") pod \"opendatahub-operator-controller-manager-74b5876657-blgbv\" (UID: \"2cceb920-8829-4f39-8ef2-f9aefadeeb63\") " pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.214037 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.214022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:34.347040 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.347006    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"]
Jun 10 20:07:34.350669 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:07:34.350646    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cceb920_8829_4f39_8ef2_f9aefadeeb63.slice/crio-3c934742622b0e5e155276d573e9037237ea36c2be56519f48458ee21e3ed1f3 WatchSource:0}: Error finding container 3c934742622b0e5e155276d573e9037237ea36c2be56519f48458ee21e3ed1f3: Status 404 returned error can't find the container with id 3c934742622b0e5e155276d573e9037237ea36c2be56519f48458ee21e3ed1f3
Jun 10 20:07:34.883938 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:34.883895    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv" event={"ID":"2cceb920-8829-4f39-8ef2-f9aefadeeb63","Type":"ContainerStarted","Data":"3c934742622b0e5e155276d573e9037237ea36c2be56519f48458ee21e3ed1f3"}
Jun 10 20:07:37.900542 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:37.900508    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv" event={"ID":"2cceb920-8829-4f39-8ef2-f9aefadeeb63","Type":"ContainerStarted","Data":"08734b8e52276ea19a7bd248d17447876797b838cf566494b3c70038638ca2df"}
Jun 10 20:07:38.905741 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:38.905704    2578 generic.go:356] "Generic (PLEG): container finished" podID="2cceb920-8829-4f39-8ef2-f9aefadeeb63" containerID="08734b8e52276ea19a7bd248d17447876797b838cf566494b3c70038638ca2df" exitCode=0
Jun 10 20:07:38.906148 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:38.905789    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv" event={"ID":"2cceb920-8829-4f39-8ef2-f9aefadeeb63","Type":"ContainerDied","Data":"08734b8e52276ea19a7bd248d17447876797b838cf566494b3c70038638ca2df"}
Jun 10 20:07:39.911934 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:39.911898    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv" event={"ID":"2cceb920-8829-4f39-8ef2-f9aefadeeb63","Type":"ContainerStarted","Data":"e2ff72d8cff489b1cb7ea6612a1947201f4e377f6f08b056d7a939730fd42287"}
Jun 10 20:07:39.912340 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:39.912024    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:07:39.945949 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:39.945899    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv" podStartSLOduration=2.941021332 podStartE2EDuration="6.945882027s" totalImagesPullingTime="3.098887823s" totalInitContainerRuntime="905.972872ms" isStatefulPod=false podCreationTimestamp="2026-06-10 20:07:33 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:07:39.944439936 +0000 UTC m=+482.205409659" watchObservedRunningTime="2026-06-10 20:07:39.945882027 +0000 UTC m=+482.206851718"
Jun 10 20:07:50.918463 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:07:50.918428    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-74b5876657-blgbv"
Jun 10 20:08:00.060010 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.059953    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"]
Jun 10 20:08:00.062134 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.062114    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.065329 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.065300    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 10 20:08:00.065329 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.065322    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 10 20:08:00.065503 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.065300    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-zf7wd\""
Jun 10 20:08:00.065503 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.065456    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 10 20:08:00.075413 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.075392    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"]
Jun 10 20:08:00.121826 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.117350    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-cert\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.121826 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.117428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjpgf\" (UniqueName: \"kubernetes.io/projected/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-kube-api-access-kjpgf\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.121826 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.117478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-manager-config\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.121826 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.117584    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-metrics-cert\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.218637 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.218601    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-metrics-cert\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.218811 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.218647    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-cert\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.218811 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.218773    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kjpgf\" (UniqueName: \"kubernetes.io/projected/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-kube-api-access-kjpgf\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.218923 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.218833    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-manager-config\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.219514 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.219490    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-manager-config\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.221145 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.221119    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-metrics-cert\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.221233 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.221146    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-cert\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.226733 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.226713    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjpgf\" (UniqueName: \"kubernetes.io/projected/3fd6542c-2120-46da-aeb7-bf2c1b8cf970-kube-api-access-kjpgf\") pod \"lws-controller-manager-7db946db8b-wgthj\" (UID: \"3fd6542c-2120-46da-aeb7-bf2c1b8cf970\") " pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.371703 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.371617    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:00.512423 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:00.512397    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"]
Jun 10 20:08:00.515234 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:08:00.515200    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd6542c_2120_46da_aeb7_bf2c1b8cf970.slice/crio-864ca370a595d62c67acb8777d558e18db5aae34ef53910cb0db444ab1f309a7 WatchSource:0}: Error finding container 864ca370a595d62c67acb8777d558e18db5aae34ef53910cb0db444ab1f309a7: Status 404 returned error can't find the container with id 864ca370a595d62c67acb8777d558e18db5aae34ef53910cb0db444ab1f309a7
Jun 10 20:08:01.002001 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:01.001965    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj" event={"ID":"3fd6542c-2120-46da-aeb7-bf2c1b8cf970","Type":"ContainerStarted","Data":"864ca370a595d62c67acb8777d558e18db5aae34ef53910cb0db444ab1f309a7"}
Jun 10 20:08:04.016524 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:04.016480    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj" event={"ID":"3fd6542c-2120-46da-aeb7-bf2c1b8cf970","Type":"ContainerStarted","Data":"a19651ce14fe098bcbd8fb2b354db87fef1db2fe337f8b6bd870cf0cfa6989a4"}
Jun 10 20:08:04.017039 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:04.016542    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:04.060429 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:04.060326    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj" podStartSLOduration=0.771328984 podStartE2EDuration="4.060309144s" totalImagesPullingTime="3.28898016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:04.058776297 +0000 UTC m=+506.319745989" watchObservedRunningTime="2026-06-10 20:08:04.060309144 +0000 UTC m=+506.321278838"
Jun 10 20:08:15.022896 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:15.022845    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7db946db8b-wgthj"
Jun 10 20:08:23.607821 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.607749    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-56984d5999-wksf5"]
Jun 10 20:08:23.610783 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.610769    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:23.613122 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.613098    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9hddz\""
Jun 10 20:08:23.613231 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.613102    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 10 20:08:23.619377 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.619354    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56984d5999-wksf5"]
Jun 10 20:08:23.622139 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.622114    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qvg22\" (UniqueName: \"kubernetes.io/projected/0f5f35f1-8967-4e20-855b-7c26a84b1aa3-kube-api-access-qvg22\") pod \"dashboard-redirect-56984d5999-wksf5\" (UID: \"0f5f35f1-8967-4e20-855b-7c26a84b1aa3\") " pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:23.622287 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.622269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f5f35f1-8967-4e20-855b-7c26a84b1aa3-redirect-config\") pod \"dashboard-redirect-56984d5999-wksf5\" (UID: \"0f5f35f1-8967-4e20-855b-7c26a84b1aa3\") " pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:23.722903 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.722866    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f5f35f1-8967-4e20-855b-7c26a84b1aa3-redirect-config\") pod \"dashboard-redirect-56984d5999-wksf5\" (UID: \"0f5f35f1-8967-4e20-855b-7c26a84b1aa3\") " pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:23.722903 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.722899    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qvg22\" (UniqueName: \"kubernetes.io/projected/0f5f35f1-8967-4e20-855b-7c26a84b1aa3-kube-api-access-qvg22\") pod \"dashboard-redirect-56984d5999-wksf5\" (UID: \"0f5f35f1-8967-4e20-855b-7c26a84b1aa3\") " pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:23.723492 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.723475    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/0f5f35f1-8967-4e20-855b-7c26a84b1aa3-redirect-config\") pod \"dashboard-redirect-56984d5999-wksf5\" (UID: \"0f5f35f1-8967-4e20-855b-7c26a84b1aa3\") " pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:23.730481 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.730457    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qvg22\" (UniqueName: \"kubernetes.io/projected/0f5f35f1-8967-4e20-855b-7c26a84b1aa3-kube-api-access-qvg22\") pod \"dashboard-redirect-56984d5999-wksf5\" (UID: \"0f5f35f1-8967-4e20-855b-7c26a84b1aa3\") " pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:23.922632 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:23.922551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-56984d5999-wksf5"
Jun 10 20:08:24.047112 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:24.047032    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-56984d5999-wksf5"]
Jun 10 20:08:24.049675 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:08:24.049642    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f5f35f1_8967_4e20_855b_7c26a84b1aa3.slice/crio-7f8487d9ecc7bd0849aded4fa8f21a9f821e0fed7cd6b0eaa453787f3b89693e WatchSource:0}: Error finding container 7f8487d9ecc7bd0849aded4fa8f21a9f821e0fed7cd6b0eaa453787f3b89693e: Status 404 returned error can't find the container with id 7f8487d9ecc7bd0849aded4fa8f21a9f821e0fed7cd6b0eaa453787f3b89693e
Jun 10 20:08:24.102942 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:24.102912    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56984d5999-wksf5" event={"ID":"0f5f35f1-8967-4e20-855b-7c26a84b1aa3","Type":"ContainerStarted","Data":"7f8487d9ecc7bd0849aded4fa8f21a9f821e0fed7cd6b0eaa453787f3b89693e"}
Jun 10 20:08:29.126682 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:29.126643    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-56984d5999-wksf5" event={"ID":"0f5f35f1-8967-4e20-855b-7c26a84b1aa3","Type":"ContainerStarted","Data":"aeda3e9cb8efd3f9b7c540a7b4c265e40d42e7d981a351da8c5eb68a36eaf595"}
Jun 10 20:08:29.142086 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:29.142044    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-56984d5999-wksf5" podStartSLOduration=1.425458106 podStartE2EDuration="6.142028416s" totalImagesPullingTime="4.71657031s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:29.14088049 +0000 UTC m=+531.401850179" watchObservedRunningTime="2026-06-10 20:08:29.142028416 +0000 UTC m=+531.402998107"
Jun 10 20:08:45.174117 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.174083    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"]
Jun 10 20:08:45.180344 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.180324    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.182824 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.182802    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 10 20:08:45.182989 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.182945    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 10 20:08:45.183055 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.182993    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-7vt8d\""
Jun 10 20:08:45.183957 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.183942    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 10 20:08:45.188710 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.188684    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"]
Jun 10 20:08:45.312645 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312618    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.312809 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312659    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.312809 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312690    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.312809 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312758    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.312961 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312811    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.312961 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312835    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4sg6\" (UniqueName: \"kubernetes.io/projected/7e00a047-3d7a-4f12-932a-6a96d8af10fd-kube-api-access-j4sg6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.312961 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312884    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.312961 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312927    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.313137 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.312964    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.413768 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413734    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.413768 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413767    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413789    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413819    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413841    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4sg6\" (UniqueName: \"kubernetes.io/projected/7e00a047-3d7a-4f12-932a-6a96d8af10fd-kube-api-access-j4sg6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413896    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413920    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.413950    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414323 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.414083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414323 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.414285    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414435 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.414353    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414435 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.414406    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414539 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.414504    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.414539 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.414525    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.416020 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.415999    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.416410 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.416392    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.424520 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.424461    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4sg6\" (UniqueName: \"kubernetes.io/projected/7e00a047-3d7a-4f12-932a-6a96d8af10fd-kube-api-access-j4sg6\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.425158 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.425136    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/7e00a047-3d7a-4f12-932a-6a96d8af10fd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-5b556588bcp64bx\" (UID: \"7e00a047-3d7a-4f12-932a-6a96d8af10fd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.493165 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.493139    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:45.626227 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:45.626184    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"]
Jun 10 20:08:45.628320 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:08:45.628297    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7e00a047_3d7a_4f12_932a_6a96d8af10fd.slice/crio-ad12341b0f89e73403f3d3c20b38cc07de7c58d706257477e79170e58eb72030 WatchSource:0}: Error finding container ad12341b0f89e73403f3d3c20b38cc07de7c58d706257477e79170e58eb72030: Status 404 returned error can't find the container with id ad12341b0f89e73403f3d3c20b38cc07de7c58d706257477e79170e58eb72030
Jun 10 20:08:46.202102 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:46.202062    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx" event={"ID":"7e00a047-3d7a-4f12-932a-6a96d8af10fd","Type":"ContainerStarted","Data":"ad12341b0f89e73403f3d3c20b38cc07de7c58d706257477e79170e58eb72030"}
Jun 10 20:08:50.767979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:50.767933    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:08:50.768279 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:50.768024    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:08:50.768279 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:50.768059    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:08:51.227094 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:51.227052    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx" event={"ID":"7e00a047-3d7a-4f12-932a-6a96d8af10fd","Type":"ContainerStarted","Data":"6eee964ae0a8b7ae615039d6830724a73bbdd3e3b8c3afd007d9bd016d59606f"}
Jun 10 20:08:51.245623 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:51.245541    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx" podStartSLOduration=1.107988278 podStartE2EDuration="6.245518906s" totalImagesPullingTime="5.137530628s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:51.245099976 +0000 UTC m=+553.506069659" watchObservedRunningTime="2026-06-10 20:08:51.245518906 +0000 UTC m=+553.506488601"
Jun 10 20:08:51.493708 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:51.493620    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:51.498404 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:51.498378    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:52.231886 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:52.231836    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:52.232900 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:52.232881    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-5b556588bcp64bx"
Jun 10 20:08:54.324407 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.324376    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpgc"]
Jun 10 20:08:54.327570 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.327551    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc"
Jun 10 20:08:54.330351 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.330331    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 10 20:08:54.330351 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.330343    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-bnt5k\""
Jun 10 20:08:54.330559 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.330379    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 10 20:08:54.335702 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.335678    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpgc"]
Jun 10 20:08:54.401375 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.401338    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62494\" (UniqueName: \"kubernetes.io/projected/b046b076-5af1-4412-8221-3e8ff17df65b-kube-api-access-62494\") pod \"kuadrant-operator-catalog-wbpgc\" (UID: \"b046b076-5af1-4412-8221-3e8ff17df65b\") " pod="kuadrant-system/kuadrant-operator-catalog-wbpgc"
Jun 10 20:08:54.502028 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.501975    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62494\" (UniqueName: \"kubernetes.io/projected/b046b076-5af1-4412-8221-3e8ff17df65b-kube-api-access-62494\") pod \"kuadrant-operator-catalog-wbpgc\" (UID: \"b046b076-5af1-4412-8221-3e8ff17df65b\") " pod="kuadrant-system/kuadrant-operator-catalog-wbpgc"
Jun 10 20:08:54.510181 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.510151    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62494\" (UniqueName: \"kubernetes.io/projected/b046b076-5af1-4412-8221-3e8ff17df65b-kube-api-access-62494\") pod \"kuadrant-operator-catalog-wbpgc\" (UID: \"b046b076-5af1-4412-8221-3e8ff17df65b\") " pod="kuadrant-system/kuadrant-operator-catalog-wbpgc"
Jun 10 20:08:54.639290 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.639202    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc"
Jun 10 20:08:54.699220 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.699189    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpgc"]
Jun 10 20:08:54.766055 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.766023    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpgc"]
Jun 10 20:08:54.768721 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:08:54.768699    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb046b076_5af1_4412_8221_3e8ff17df65b.slice/crio-19028612ca27d9716832a59611aa96eaed3d59bc4f3263ae2e351767dbd6266c WatchSource:0}: Error finding container 19028612ca27d9716832a59611aa96eaed3d59bc4f3263ae2e351767dbd6266c: Status 404 returned error can't find the container with id 19028612ca27d9716832a59611aa96eaed3d59bc4f3263ae2e351767dbd6266c
Jun 10 20:08:54.908996 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.908921    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bq7t6"]
Jun 10 20:08:54.913234 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.913218    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:08:54.919652 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:54.919627    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bq7t6"]
Jun 10 20:08:55.006807 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:55.006774    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pmlsm\" (UniqueName: \"kubernetes.io/projected/34a9759c-c914-4f51-b8fa-2f3d7ec018b4-kube-api-access-pmlsm\") pod \"kuadrant-operator-catalog-bq7t6\" (UID: \"34a9759c-c914-4f51-b8fa-2f3d7ec018b4\") " pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:08:55.108265 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:55.108231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pmlsm\" (UniqueName: \"kubernetes.io/projected/34a9759c-c914-4f51-b8fa-2f3d7ec018b4-kube-api-access-pmlsm\") pod \"kuadrant-operator-catalog-bq7t6\" (UID: \"34a9759c-c914-4f51-b8fa-2f3d7ec018b4\") " pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:08:55.118034 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:55.118002    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pmlsm\" (UniqueName: \"kubernetes.io/projected/34a9759c-c914-4f51-b8fa-2f3d7ec018b4-kube-api-access-pmlsm\") pod \"kuadrant-operator-catalog-bq7t6\" (UID: \"34a9759c-c914-4f51-b8fa-2f3d7ec018b4\") " pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:08:55.223986 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:55.223915    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:08:55.245919 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:55.245886    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc" event={"ID":"b046b076-5af1-4412-8221-3e8ff17df65b","Type":"ContainerStarted","Data":"19028612ca27d9716832a59611aa96eaed3d59bc4f3263ae2e351767dbd6266c"}
Jun 10 20:08:55.363705 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:55.363676    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-bq7t6"]
Jun 10 20:08:55.366027 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:08:55.366008    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34a9759c_c914_4f51_b8fa_2f3d7ec018b4.slice/crio-c822409a9572b47d0f0f757d702240c88cc2043df5f53aad32c12b6a2a6c2b78 WatchSource:0}: Error finding container c822409a9572b47d0f0f757d702240c88cc2043df5f53aad32c12b6a2a6c2b78: Status 404 returned error can't find the container with id c822409a9572b47d0f0f757d702240c88cc2043df5f53aad32c12b6a2a6c2b78
Jun 10 20:08:56.251322 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:56.251289    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6" event={"ID":"34a9759c-c914-4f51-b8fa-2f3d7ec018b4","Type":"ContainerStarted","Data":"c822409a9572b47d0f0f757d702240c88cc2043df5f53aad32c12b6a2a6c2b78"}
Jun 10 20:08:57.257316 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.257234    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6" event={"ID":"34a9759c-c914-4f51-b8fa-2f3d7ec018b4","Type":"ContainerStarted","Data":"8cc92b5cd14910d186f65d51d3919b11875dd98ab14dc4fe664d5d3153fbcfb6"}
Jun 10 20:08:57.258647 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.258620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc" event={"ID":"b046b076-5af1-4412-8221-3e8ff17df65b","Type":"ContainerStarted","Data":"efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d"}
Jun 10 20:08:57.258766 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.258706    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc" podUID="b046b076-5af1-4412-8221-3e8ff17df65b" containerName="registry-server" containerID="cri-o://efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d" gracePeriod=2
Jun 10 20:08:57.271838 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.271786    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6" podStartSLOduration=1.7527099069999998 podStartE2EDuration="3.271771487s" totalImagesPullingTime="1.51906158s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:57.271479032 +0000 UTC m=+559.532448726" watchObservedRunningTime="2026-06-10 20:08:57.271771487 +0000 UTC m=+559.532741179"
Jun 10 20:08:57.285643 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.285607    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc" podStartSLOduration=1.172330664 podStartE2EDuration="3.285592481s" totalImagesPullingTime="2.113261817s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:08:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:08:57.285340658 +0000 UTC m=+559.546310350" watchObservedRunningTime="2026-06-10 20:08:57.285592481 +0000 UTC m=+559.546562173"
Jun 10 20:08:57.506715 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.506684    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc"
Jun 10 20:08:57.634122 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.634081    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-62494\" (UniqueName: \"kubernetes.io/projected/b046b076-5af1-4412-8221-3e8ff17df65b-kube-api-access-62494\") pod \"b046b076-5af1-4412-8221-3e8ff17df65b\" (UID: \"b046b076-5af1-4412-8221-3e8ff17df65b\") "
Jun 10 20:08:57.636209 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.636182    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b046b076-5af1-4412-8221-3e8ff17df65b-kube-api-access-62494" (OuterVolumeSpecName: "kube-api-access-62494") pod "b046b076-5af1-4412-8221-3e8ff17df65b" (UID: "b046b076-5af1-4412-8221-3e8ff17df65b"). InnerVolumeSpecName "kube-api-access-62494". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:08:57.734716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:57.734680    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-62494\" (UniqueName: \"kubernetes.io/projected/b046b076-5af1-4412-8221-3e8ff17df65b-kube-api-access-62494\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:08:58.264517 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.264479    2578 generic.go:356] "Generic (PLEG): container finished" podID="b046b076-5af1-4412-8221-3e8ff17df65b" containerID="efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d" exitCode=0
Jun 10 20:08:58.264980 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.264523    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc"
Jun 10 20:08:58.264980 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.264572    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc" event={"ID":"b046b076-5af1-4412-8221-3e8ff17df65b","Type":"ContainerDied","Data":"efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d"}
Jun 10 20:08:58.264980 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.264627    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wbpgc" event={"ID":"b046b076-5af1-4412-8221-3e8ff17df65b","Type":"ContainerDied","Data":"19028612ca27d9716832a59611aa96eaed3d59bc4f3263ae2e351767dbd6266c"}
Jun 10 20:08:58.264980 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.264651    2578 scope.go:117] "RemoveContainer" containerID="efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d"
Jun 10 20:08:58.273667 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.273597    2578 scope.go:117] "RemoveContainer" containerID="efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d"
Jun 10 20:08:58.273837 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:08:58.273816    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d\": container with ID starting with efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d not found: ID does not exist" containerID="efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d"
Jun 10 20:08:58.273946 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.273872    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d"} err="failed to get container status \"efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d\": rpc error: code = NotFound desc = could not find container \"efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d\": container with ID starting with efc1256a8622d2e922e2a67007a0f57409ee3b49edf3beb9808d946ab812e80d not found: ID does not exist"
Jun 10 20:08:58.279532 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.279502    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpgc"]
Jun 10 20:08:58.285205 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:08:58.285179    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wbpgc"]
Jun 10 20:09:00.162728 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:00.162693    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b046b076-5af1-4412-8221-3e8ff17df65b" path="/var/lib/kubelet/pods/b046b076-5af1-4412-8221-3e8ff17df65b/volumes"
Jun 10 20:09:05.224972 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:05.224928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:09:05.225442 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:05.224995    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:09:05.246804 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:05.246780    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:09:05.318109 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:05.318082    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-bq7t6"
Jun 10 20:09:24.306633 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.306601    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"]
Jun 10 20:09:24.307070 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.306945    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b046b076-5af1-4412-8221-3e8ff17df65b" containerName="registry-server"
Jun 10 20:09:24.307070 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.306956    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="b046b076-5af1-4412-8221-3e8ff17df65b" containerName="registry-server"
Jun 10 20:09:24.307070 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.307017    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="b046b076-5af1-4412-8221-3e8ff17df65b" containerName="registry-server"
Jun 10 20:09:24.315149 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.315131    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.317539 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.317522    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-cbd6n\""
Jun 10 20:09:24.324047 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.324027    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"]
Jun 10 20:09:24.361032 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.361006    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.361149 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.361117    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwhr9\" (UniqueName: \"kubernetes.io/projected/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-kube-api-access-nwhr9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.461659 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.461627    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.461777 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.461715    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwhr9\" (UniqueName: \"kubernetes.io/projected/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-kube-api-access-nwhr9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.462043 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.462024    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.471727 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.471706    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwhr9\" (UniqueName: \"kubernetes.io/projected/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-kube-api-access-nwhr9\") pod \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.626236 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.626160    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:24.757969 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:24.757938    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"]
Jun 10 20:09:24.761216 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:09:24.761188    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0040ce8_ca8c_40cb_811a_53a2ee525b5d.slice/crio-bb1737eb29264762cab520809339218066848a5ae340cfb781df758f7aed1c08 WatchSource:0}: Error finding container bb1737eb29264762cab520809339218066848a5ae340cfb781df758f7aed1c08: Status 404 returned error can't find the container with id bb1737eb29264762cab520809339218066848a5ae340cfb781df758f7aed1c08
Jun 10 20:09:25.385050 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:25.385015    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h" event={"ID":"a0040ce8-ca8c-40cb-811a-53a2ee525b5d","Type":"ContainerStarted","Data":"bb1737eb29264762cab520809339218066848a5ae340cfb781df758f7aed1c08"}
Jun 10 20:09:32.007655 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.007616    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"]
Jun 10 20:09:32.011975 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.011948    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:32.014575 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.014553    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-kqlh5\""
Jun 10 20:09:32.019156 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.019101    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"]
Jun 10 20:09:32.134928 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.134878    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mwvpg\" (UniqueName: \"kubernetes.io/projected/445fb532-0b77-40be-9321-71cc6f76a920-kube-api-access-mwvpg\") pod \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" (UID: \"445fb532-0b77-40be-9321-71cc6f76a920\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:32.235590 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.235550    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mwvpg\" (UniqueName: \"kubernetes.io/projected/445fb532-0b77-40be-9321-71cc6f76a920-kube-api-access-mwvpg\") pod \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" (UID: \"445fb532-0b77-40be-9321-71cc6f76a920\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:32.244436 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.244411    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mwvpg\" (UniqueName: \"kubernetes.io/projected/445fb532-0b77-40be-9321-71cc6f76a920-kube-api-access-mwvpg\") pod \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" (UID: \"445fb532-0b77-40be-9321-71cc6f76a920\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:32.326866 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.326808    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:32.483555 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:32.483532    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"]
Jun 10 20:09:32.485923 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:09:32.485893    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod445fb532_0b77_40be_9321_71cc6f76a920.slice/crio-0caea638e92a6d109f7f577bc9dac9da248b98ee4c4a46469d19f8059eaa450e WatchSource:0}: Error finding container 0caea638e92a6d109f7f577bc9dac9da248b98ee4c4a46469d19f8059eaa450e: Status 404 returned error can't find the container with id 0caea638e92a6d109f7f577bc9dac9da248b98ee4c4a46469d19f8059eaa450e
Jun 10 20:09:33.425912 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:33.425873    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk" event={"ID":"445fb532-0b77-40be-9321-71cc6f76a920","Type":"ContainerStarted","Data":"0caea638e92a6d109f7f577bc9dac9da248b98ee4c4a46469d19f8059eaa450e"}
Jun 10 20:09:33.428457 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:33.428398    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h" event={"ID":"a0040ce8-ca8c-40cb-811a-53a2ee525b5d","Type":"ContainerStarted","Data":"4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458"}
Jun 10 20:09:33.428652 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:33.428577    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:33.452761 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:33.452715    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h" podStartSLOduration=1.794453321 podStartE2EDuration="9.452699482s" totalImagesPullingTime="7.658246161s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:33.450512971 +0000 UTC m=+595.711482664" watchObservedRunningTime="2026-06-10 20:09:33.452699482 +0000 UTC m=+595.713669174"
Jun 10 20:09:34.436224 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:34.436187    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk" event={"ID":"445fb532-0b77-40be-9321-71cc6f76a920","Type":"ContainerStarted","Data":"33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae"}
Jun 10 20:09:34.436671 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:34.436490    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:34.452834 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:34.452790    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk" podStartSLOduration=1.6384243710000002 podStartE2EDuration="3.452776276s" totalImagesPullingTime="1.814351905s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:34.451197442 +0000 UTC m=+596.712167138" watchObservedRunningTime="2026-06-10 20:09:34.452776276 +0000 UTC m=+596.713745969"
Jun 10 20:09:38.159201 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:38.159172    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:09:38.159628 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:38.159610    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:09:44.439230 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:44.439192    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:45.442982 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.442954    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:45.483051 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.483019    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"]
Jun 10 20:09:45.486465 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.486443    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:45.498120 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.498100    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"]
Jun 10 20:09:45.592029 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.591995    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"]
Jun 10 20:09:45.592270 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:45.592248    2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-7dvmf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn" podUID="8c821192-543f-42a3-adba-231e6b7976a9"
Jun 10 20:09:45.626803 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.626776    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"]
Jun 10 20:09:45.630134 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.630118    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:45.644552 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.644531    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"]
Jun 10 20:09:45.655242 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.655215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c821192-543f-42a3-adba-231e6b7976a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:45.655336 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.655257    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dvmf\" (UniqueName: \"kubernetes.io/projected/8c821192-543f-42a3-adba-231e6b7976a9-kube-api-access-7dvmf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:45.756512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.756452    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1a96-a552-46ac-b665-6c86f1401ffa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:45.756512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.756491    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6ltp\" (UniqueName: \"kubernetes.io/projected/d6cb1a96-a552-46ac-b665-6c86f1401ffa-kube-api-access-h6ltp\") pod \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:45.756677 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.756616    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c821192-543f-42a3-adba-231e6b7976a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:45.756677 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.756657    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dvmf\" (UniqueName: \"kubernetes.io/projected/8c821192-543f-42a3-adba-231e6b7976a9-kube-api-access-7dvmf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:45.756996 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.756976    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c821192-543f-42a3-adba-231e6b7976a9-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:45.768565 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.768545    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dvmf\" (UniqueName: \"kubernetes.io/projected/8c821192-543f-42a3-adba-231e6b7976a9-kube-api-access-7dvmf\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:45.857481 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.857447    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1a96-a552-46ac-b665-6c86f1401ffa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:45.857664 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.857513    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6ltp\" (UniqueName: \"kubernetes.io/projected/d6cb1a96-a552-46ac-b665-6c86f1401ffa-kube-api-access-h6ltp\") pod \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:45.857898 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.857874    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1a96-a552-46ac-b665-6c86f1401ffa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:45.865925 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.865902    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6ltp\" (UniqueName: \"kubernetes.io/projected/d6cb1a96-a552-46ac-b665-6c86f1401ffa-kube-api-access-h6ltp\") pod \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:45.939512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:45.939478    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.072266 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.072218    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"]
Jun 10 20:09:46.081284 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.081249    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"]
Jun 10 20:09:46.094052 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.094024    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"]
Jun 10 20:09:46.097419 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.097393    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"]
Jun 10 20:09:46.102516 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.102493    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.107621 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.107591    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"]
Jun 10 20:09:46.120144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.115092    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"]
Jun 10 20:09:46.123410 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.123382    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"]
Jun 10 20:09:46.123958 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.123922    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" containerName="manager" containerID="cri-o://4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458" gracePeriod=2
Jun 10 20:09:46.131529 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.131438    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:46.134871 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.134823    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"]
Jun 10 20:09:46.142702 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.142609    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"]
Jun 10 20:09:46.143249 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.142783    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk" podUID="445fb532-0b77-40be-9321-71cc6f76a920" containerName="manager" containerID="cri-o://33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae" gracePeriod=2
Jun 10 20:09:46.147030 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.146983    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"]
Jun 10 20:09:46.147529 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.147505    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" containerName="manager"
Jun 10 20:09:46.147529 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.147528    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" containerName="manager"
Jun 10 20:09:46.147683 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.147632    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" containerName="manager"
Jun 10 20:09:46.150772 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.150754    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.164725 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.164681    2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"445fb532-0b77-40be-9321-71cc6f76a920\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-hmxfk\": pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.167034 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.166985    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:46.170538 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.170511    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"]
Jun 10 20:09:46.170666 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.170553    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"]
Jun 10 20:09:46.173559 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.173535    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"]
Jun 10 20:09:46.173903 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.173887    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="445fb532-0b77-40be-9321-71cc6f76a920" containerName="manager"
Jun 10 20:09:46.173903 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.173901    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="445fb532-0b77-40be-9321-71cc6f76a920" containerName="manager"
Jun 10 20:09:46.174047 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.173970    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="445fb532-0b77-40be-9321-71cc6f76a920" containerName="manager"
Jun 10 20:09:46.176935 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.176831    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"
Jun 10 20:09:46.188702 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.186830    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"]
Jun 10 20:09:46.190438 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.190404    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-4x68h\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:46.192357 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.192323    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.218833 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.218792    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.237042 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.237011    2578 log.go:32] "RunPodSandbox from runtime service failed" err=<
Jun 10 20:09:46.237042 ip-10-0-137-191 kubenswrapper[2578]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-sv5vz_kuadrant-system_d6cb1a96-a552-46ac-b665-6c86f1401ffa_0(15057e495aaca1a7921585c1fd02ccf4cb55387232dceefa5d0d3df6c68112eb): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-sv5vz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"15057e495aaca1a7921585c1fd02ccf4cb55387232dceefa5d0d3df6c68112eb" Netns:"/var/run/netns/5fd8bdba-c158-47c9-8016-bd6df095b4a8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-sv5vz;K8S_POD_INFRA_CONTAINER_ID=15057e495aaca1a7921585c1fd02ccf4cb55387232dceefa5d0d3df6c68112eb;K8S_POD_UID=d6cb1a96-a552-46ac-b665-6c86f1401ffa" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz/d6cb1a96-a552-46ac-b665-6c86f1401ffa]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-sv5vz in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-sv5vz in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-sv5vz" not found
Jun 10 20:09:46.237042 ip-10-0-137-191 kubenswrapper[2578]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jun 10 20:09:46.237042 ip-10-0-137-191 kubenswrapper[2578]:  >
Jun 10 20:09:46.237224 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.237069    2578 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err=<
Jun 10 20:09:46.237224 ip-10-0-137-191 kubenswrapper[2578]:         rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-55467d9f7-sv5vz_kuadrant-system_d6cb1a96-a552-46ac-b665-6c86f1401ffa_0(15057e495aaca1a7921585c1fd02ccf4cb55387232dceefa5d0d3df6c68112eb): error adding pod kuadrant-system_kuadrant-operator-controller-manager-55467d9f7-sv5vz to CNI network "multus-cni-network": plugin type="multus-shim" name="multus-cni-network" failed (add): CmdAdd (shim): CNI request failed with status 400: 'ContainerID:"15057e495aaca1a7921585c1fd02ccf4cb55387232dceefa5d0d3df6c68112eb" Netns:"/var/run/netns/5fd8bdba-c158-47c9-8016-bd6df095b4a8" IfName:"eth0" Args:"IgnoreUnknown=1;K8S_POD_NAMESPACE=kuadrant-system;K8S_POD_NAME=kuadrant-operator-controller-manager-55467d9f7-sv5vz;K8S_POD_INFRA_CONTAINER_ID=15057e495aaca1a7921585c1fd02ccf4cb55387232dceefa5d0d3df6c68112eb;K8S_POD_UID=d6cb1a96-a552-46ac-b665-6c86f1401ffa" Path:"" ERRORED: error configuring pod [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz] networking: Multus: [kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz/d6cb1a96-a552-46ac-b665-6c86f1401ffa]: error setting the networks status: SetPodNetworkStatusAnnotation: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-sv5vz in out of cluster comm: SetNetworkStatus: failed to update the pod kuadrant-operator-controller-manager-55467d9f7-sv5vz in out of cluster comm: status update failed for pod /: pods "kuadrant-operator-controller-manager-55467d9f7-sv5vz" not found
Jun 10 20:09:46.237224 ip-10-0-137-191 kubenswrapper[2578]:         ': StdinData: {"auxiliaryCNIChainName":"vendor-cni-chain","binDir":"/var/lib/cni/bin","clusterNetwork":"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf","cniVersion":"0.3.1","daemonSocketDir":"/run/multus/socket","globalNamespaces":"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv","logLevel":"verbose","logToStderr":true,"name":"multus-cni-network","namespaceIsolation":true,"type":"multus-shim"}
Jun 10 20:09:46.237224 ip-10-0-137-191 kubenswrapper[2578]:  > pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.261049 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.261021    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwzc2\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.261153 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.261083    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ec62657-a4fb-42f5-a735-07072cc6a937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kvc8z\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.261228 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.261154    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txmqz\" (UniqueName: \"kubernetes.io/projected/2ec62657-a4fb-42f5-a735-07072cc6a937-kube-api-access-txmqz\") pod \"kuadrant-operator-controller-manager-55467d9f7-kvc8z\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.261228 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.261197    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbn86\" (UniqueName: \"kubernetes.io/projected/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-kube-api-access-mbn86\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwzc2\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.362477 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.362442    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwzc2\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.362477 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.362482    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ec62657-a4fb-42f5-a735-07072cc6a937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kvc8z\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.362702 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.362534    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zrgn\" (UniqueName: \"kubernetes.io/projected/2d879cb9-2fb7-4f99-b779-a61c0b136b85-kube-api-access-4zrgn\") pod \"limitador-operator-controller-manager-859d7b78bd-2j4pw\" (UID: \"2d879cb9-2fb7-4f99-b779-a61c0b136b85\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"
Jun 10 20:09:46.362702 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.362555    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txmqz\" (UniqueName: \"kubernetes.io/projected/2ec62657-a4fb-42f5-a735-07072cc6a937-kube-api-access-txmqz\") pod \"kuadrant-operator-controller-manager-55467d9f7-kvc8z\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.362702 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.362594    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbn86\" (UniqueName: \"kubernetes.io/projected/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-kube-api-access-mbn86\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwzc2\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.362888 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.362873    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwzc2\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.362949 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.362933    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ec62657-a4fb-42f5-a735-07072cc6a937-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-kvc8z\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.374408 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.374376    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txmqz\" (UniqueName: \"kubernetes.io/projected/2ec62657-a4fb-42f5-a735-07072cc6a937-kube-api-access-txmqz\") pod \"kuadrant-operator-controller-manager-55467d9f7-kvc8z\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.374544 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.374430    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbn86\" (UniqueName: \"kubernetes.io/projected/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-kube-api-access-mbn86\") pod \"kuadrant-operator-controller-manager-8684c9ff49-fwzc2\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.375554 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.375531    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:46.378212 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.378181    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.385370 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.385352    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.387915 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.387895    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.426080 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.426058    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:46.463677 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.463631    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zrgn\" (UniqueName: \"kubernetes.io/projected/2d879cb9-2fb7-4f99-b779-a61c0b136b85-kube-api-access-4zrgn\") pod \"limitador-operator-controller-manager-859d7b78bd-2j4pw\" (UID: \"2d879cb9-2fb7-4f99-b779-a61c0b136b85\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"
Jun 10 20:09:46.481471 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.480506    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zrgn\" (UniqueName: \"kubernetes.io/projected/2d879cb9-2fb7-4f99-b779-a61c0b136b85-kube-api-access-4zrgn\") pod \"limitador-operator-controller-manager-859d7b78bd-2j4pw\" (UID: \"2d879cb9-2fb7-4f99-b779-a61c0b136b85\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"
Jun 10 20:09:46.492421 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.492395    2578 generic.go:356] "Generic (PLEG): container finished" podID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" containerID="4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458" exitCode=0
Jun 10 20:09:46.492549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.492440    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-4x68h"
Jun 10 20:09:46.492549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.492489    2578 scope.go:117] "RemoveContainer" containerID="4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458"
Jun 10 20:09:46.493806 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.493781    2578 generic.go:356] "Generic (PLEG): container finished" podID="445fb532-0b77-40be-9321-71cc6f76a920" containerID="33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae" exitCode=0
Jun 10 20:09:46.493939 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.493828    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.494004 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.493971    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.494004 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.493993    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:46.494703 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.494676    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.496577 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.496551    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.501021 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.500953    2578 scope.go:117] "RemoveContainer" containerID="4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458"
Jun 10 20:09:46.501208 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.501186    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458\": container with ID starting with 4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458 not found: ID does not exist" containerID="4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458"
Jun 10 20:09:46.501286 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.501216    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458"} err="failed to get container status \"4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458\": rpc error: code = NotFound desc = could not find container \"4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458\": container with ID starting with 4b1bfd7cf28f5d3896aee60a979109c0cfd5d24a6b70144df45e1cc8f8597458 not found: ID does not exist"
Jun 10 20:09:46.501286 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.501234    2578 scope.go:117] "RemoveContainer" containerID="33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae"
Jun 10 20:09:46.502243 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.502225    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.504334 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.504310    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.505628 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.505578    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:46.506111 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.506080    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.508245 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.508116    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.509986 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.509946    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="8c821192-543f-42a3-adba-231e6b7976a9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:46.510361 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.510343    2578 scope.go:117] "RemoveContainer" containerID="33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae"
Jun 10 20:09:46.510631 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.510593    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae\": container with ID starting with 33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae not found: ID does not exist" containerID="33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae"
Jun 10 20:09:46.510717 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.510629    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae"} err="failed to get container status \"33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae\": rpc error: code = NotFound desc = could not find container \"33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae\": container with ID starting with 33f2c369dca21622ae36b82841d3447772625b456a3a8e2cbe8dd1157684bfae not found: ID does not exist"
Jun 10 20:09:46.511665 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.511634    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.552969 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.552940    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:46.560156 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.560132    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"]
Jun 10 20:09:46.561347 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.561327    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"
Jun 10 20:09:46.564002 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:09:46.563973    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ec62657_a4fb_42f5_a735_07072cc6a937.slice/crio-40dcf923e008848afd0f051b96d85a4704f7d85f59746073b44dff40b277c275 WatchSource:0}: Error finding container 40dcf923e008848afd0f051b96d85a4704f7d85f59746073b44dff40b277c275: Status 404 returned error can't find the container with id 40dcf923e008848afd0f051b96d85a4704f7d85f59746073b44dff40b277c275
Jun 10 20:09:46.564002 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.563980    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mwvpg\" (UniqueName: \"kubernetes.io/projected/445fb532-0b77-40be-9321-71cc6f76a920-kube-api-access-mwvpg\") pod \"445fb532-0b77-40be-9321-71cc6f76a920\" (UID: \"445fb532-0b77-40be-9321-71cc6f76a920\") "
Jun 10 20:09:46.564154 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.564030    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nwhr9\" (UniqueName: \"kubernetes.io/projected/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-kube-api-access-nwhr9\") pod \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") "
Jun 10 20:09:46.564154 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.564082    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-extensions-socket-volume\") pod \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\" (UID: \"a0040ce8-ca8c-40cb-811a-53a2ee525b5d\") "
Jun 10 20:09:46.564535 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.564508    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "a0040ce8-ca8c-40cb-811a-53a2ee525b5d" (UID: "a0040ce8-ca8c-40cb-811a-53a2ee525b5d"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:09:46.566122 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.566084    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/445fb532-0b77-40be-9321-71cc6f76a920-kube-api-access-mwvpg" (OuterVolumeSpecName: "kube-api-access-mwvpg") pod "445fb532-0b77-40be-9321-71cc6f76a920" (UID: "445fb532-0b77-40be-9321-71cc6f76a920"). InnerVolumeSpecName "kube-api-access-mwvpg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:09:46.566245 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.566220    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-kube-api-access-nwhr9" (OuterVolumeSpecName: "kube-api-access-nwhr9") pod "a0040ce8-ca8c-40cb-811a-53a2ee525b5d" (UID: "a0040ce8-ca8c-40cb-811a-53a2ee525b5d"). InnerVolumeSpecName "kube-api-access-nwhr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:09:46.665352 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665322    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h6ltp\" (UniqueName: \"kubernetes.io/projected/d6cb1a96-a552-46ac-b665-6c86f1401ffa-kube-api-access-h6ltp\") pod \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") "
Jun 10 20:09:46.665482 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665469    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c821192-543f-42a3-adba-231e6b7976a9-extensions-socket-volume\") pod \"8c821192-543f-42a3-adba-231e6b7976a9\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") "
Jun 10 20:09:46.665553 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665527    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7dvmf\" (UniqueName: \"kubernetes.io/projected/8c821192-543f-42a3-adba-231e6b7976a9-kube-api-access-7dvmf\") pod \"8c821192-543f-42a3-adba-231e6b7976a9\" (UID: \"8c821192-543f-42a3-adba-231e6b7976a9\") "
Jun 10 20:09:46.665611 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665573    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1a96-a552-46ac-b665-6c86f1401ffa-extensions-socket-volume\") pod \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\" (UID: \"d6cb1a96-a552-46ac-b665-6c86f1401ffa\") "
Jun 10 20:09:46.666066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665816    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mwvpg\" (UniqueName: \"kubernetes.io/projected/445fb532-0b77-40be-9321-71cc6f76a920-kube-api-access-mwvpg\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:46.666066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665840    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nwhr9\" (UniqueName: \"kubernetes.io/projected/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-kube-api-access-nwhr9\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:46.666066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665880    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/a0040ce8-ca8c-40cb-811a-53a2ee525b5d-extensions-socket-volume\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:46.666066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.665943    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c821192-543f-42a3-adba-231e6b7976a9-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "8c821192-543f-42a3-adba-231e6b7976a9" (UID: "8c821192-543f-42a3-adba-231e6b7976a9"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:09:46.666410 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.666376    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d6cb1a96-a552-46ac-b665-6c86f1401ffa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d6cb1a96-a552-46ac-b665-6c86f1401ffa" (UID: "d6cb1a96-a552-46ac-b665-6c86f1401ffa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:09:46.669941 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.669887    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c821192-543f-42a3-adba-231e6b7976a9-kube-api-access-7dvmf" (OuterVolumeSpecName: "kube-api-access-7dvmf") pod "8c821192-543f-42a3-adba-231e6b7976a9" (UID: "8c821192-543f-42a3-adba-231e6b7976a9"). InnerVolumeSpecName "kube-api-access-7dvmf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:09:46.670045 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.669960    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d6cb1a96-a552-46ac-b665-6c86f1401ffa-kube-api-access-h6ltp" (OuterVolumeSpecName: "kube-api-access-h6ltp") pod "d6cb1a96-a552-46ac-b665-6c86f1401ffa" (UID: "d6cb1a96-a552-46ac-b665-6c86f1401ffa"). InnerVolumeSpecName "kube-api-access-h6ltp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:09:46.712878 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.712833    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"]
Jun 10 20:09:46.715773 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:09:46.715748    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0431f8bd_e2d5_4785_84b1_8d4edd5f00b6.slice/crio-db22961e75f1084d03b1866870d62ae60f4673882aa287c928766502665e95ea WatchSource:0}: Error finding container db22961e75f1084d03b1866870d62ae60f4673882aa287c928766502665e95ea: Status 404 returned error can't find the container with id db22961e75f1084d03b1866870d62ae60f4673882aa287c928766502665e95ea
Jun 10 20:09:46.733420 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.733398    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"]
Jun 10 20:09:46.739760 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:09:46.739738    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d879cb9_2fb7_4f99_b779_a61c0b136b85.slice/crio-25aae41ca1b3882af80e7ea6c44092ae560091c6aa0f0e45f36f54c0a8f5a680 WatchSource:0}: Error finding container 25aae41ca1b3882af80e7ea6c44092ae560091c6aa0f0e45f36f54c0a8f5a680: Status 404 returned error can't find the container with id 25aae41ca1b3882af80e7ea6c44092ae560091c6aa0f0e45f36f54c0a8f5a680
Jun 10 20:09:46.766981 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.766955    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8c821192-543f-42a3-adba-231e6b7976a9-extensions-socket-volume\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:46.766981 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.766977    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7dvmf\" (UniqueName: \"kubernetes.io/projected/8c821192-543f-42a3-adba-231e6b7976a9-kube-api-access-7dvmf\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:46.767096 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.766987    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1a96-a552-46ac-b665-6c86f1401ffa-extensions-socket-volume\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:46.767096 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:46.766995    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h6ltp\" (UniqueName: \"kubernetes.io/projected/d6cb1a96-a552-46ac-b665-6c86f1401ffa-kube-api-access-h6ltp\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:46.829057 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.829021    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.831277 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.831240    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.833033 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.833007    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="8c821192-543f-42a3-adba-231e6b7976a9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:46.834801 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.834775    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:46.836624 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.836594    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:46.838375 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:46.838351    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="8c821192-543f-42a3-adba-231e6b7976a9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:47.499770 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.499734    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2" event={"ID":"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6","Type":"ContainerStarted","Data":"fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609"}
Jun 10 20:09:47.500163 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.499788    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2" event={"ID":"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6","Type":"ContainerStarted","Data":"db22961e75f1084d03b1866870d62ae60f4673882aa287c928766502665e95ea"}
Jun 10 20:09:47.500163 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.499869    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:47.501402 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.501376    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z" event={"ID":"2ec62657-a4fb-42f5-a735-07072cc6a937","Type":"ContainerStarted","Data":"1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1"}
Jun 10 20:09:47.501516 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.501423    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z" event={"ID":"2ec62657-a4fb-42f5-a735-07072cc6a937","Type":"ContainerStarted","Data":"40dcf923e008848afd0f051b96d85a4704f7d85f59746073b44dff40b277c275"}
Jun 10 20:09:47.501516 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.501444    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:47.504434 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.504415    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:47.504529 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.504422    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw" event={"ID":"2d879cb9-2fb7-4f99-b779-a61c0b136b85","Type":"ContainerStarted","Data":"46f5224c83fcf0c9eaf65ccfe904d526ebf657b50b0c43aee50668237f7e3c49"}
Jun 10 20:09:47.504591 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.504539    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw" event={"ID":"2d879cb9-2fb7-4f99-b779-a61c0b136b85","Type":"ContainerStarted","Data":"25aae41ca1b3882af80e7ea6c44092ae560091c6aa0f0e45f36f54c0a8f5a680"}
Jun 10 20:09:47.504591 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.504585    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:47.527019 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.526080    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2" podStartSLOduration=1.5260628189999998 podStartE2EDuration="1.526062819s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:47.524497211 +0000 UTC m=+609.785466906" watchObservedRunningTime="2026-06-10 20:09:47.526062819 +0000 UTC m=+609.787032516"
Jun 10 20:09:47.530488 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.530448    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:47.533086 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.533056    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="8c821192-543f-42a3-adba-231e6b7976a9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:47.535484 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.535455    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:47.537880 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.537753    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cb1a96_a552_46ac_b665_6c86f1401ffa.slice\": RecentStats: unable to find data in memory cache]"
Jun 10 20:09:47.537880 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.537791    2578 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cb1a96_a552_46ac_b665_6c86f1401ffa.slice\": RecentStats: unable to find data in memory cache], [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c821192_543f_42a3_adba_231e6b7976a9.slice\": RecentStats: unable to find data in memory cache]"
Jun 10 20:09:47.550832 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.550794    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw" podStartSLOduration=1.5507822180000002 podStartE2EDuration="1.550782218s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:47.550099796 +0000 UTC m=+609.811069490" watchObservedRunningTime="2026-06-10 20:09:47.550782218 +0000 UTC m=+609.811751911"
Jun 10 20:09:47.552028 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.552007    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:47.553699 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.553673    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="8c821192-543f-42a3-adba-231e6b7976a9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:47.555422 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:47.555400    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:47.572402 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:47.572364    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z" podStartSLOduration=1.5723499159999998 podStartE2EDuration="1.572349916s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:47.571900949 +0000 UTC m=+609.832870651" watchObservedRunningTime="2026-06-10 20:09:47.572349916 +0000 UTC m=+609.833319612"
Jun 10 20:09:48.165316 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:48.165273    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sv5vz\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sv5vz"
Jun 10 20:09:48.167372 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:48.167330    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-6zktn\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="8c821192-543f-42a3-adba-231e6b7976a9" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-6zktn"
Jun 10 20:09:48.168588 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:48.168566    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="445fb532-0b77-40be-9321-71cc6f76a920" path="/var/lib/kubelet/pods/445fb532-0b77-40be-9321-71cc6f76a920/volumes"
Jun 10 20:09:48.168958 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:48.168943    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c821192-543f-42a3-adba-231e6b7976a9" path="/var/lib/kubelet/pods/8c821192-543f-42a3-adba-231e6b7976a9/volumes"
Jun 10 20:09:48.169232 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:48.169201    2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-hmxfk\" is forbidden: User \"system:node:ip-10-0-137-191.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-191.ec2.internal' and this object" podUID="445fb532-0b77-40be-9321-71cc6f76a920" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-hmxfk"
Jun 10 20:09:48.169232 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:48.169232    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0040ce8-ca8c-40cb-811a-53a2ee525b5d" path="/var/lib/kubelet/pods/a0040ce8-ca8c-40cb-811a-53a2ee525b5d/volumes"
Jun 10 20:09:48.169538 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:48.169526    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d6cb1a96-a552-46ac-b665-6c86f1401ffa" path="/var/lib/kubelet/pods/d6cb1a96-a552-46ac-b665-6c86f1401ffa/volumes"
Jun 10 20:09:48.509429 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:48.509338    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"
Jun 10 20:09:58.511463 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.511390    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:09:58.511918 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.511467    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:58.581699 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.581656    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"]
Jun 10 20:09:58.581930 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.581886    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2" podUID="0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" containerName="manager" containerID="cri-o://fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609" gracePeriod=10
Jun 10 20:09:58.776273 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.776241    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"]
Jun 10 20:09:58.779833 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.779813    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:58.793182 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.793161    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"]
Jun 10 20:09:58.830570 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.830548    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:58.864448 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.864423    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-extensions-socket-volume\") pod \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") "
Jun 10 20:09:58.864558 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.864459    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbn86\" (UniqueName: \"kubernetes.io/projected/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-kube-api-access-mbn86\") pod \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\" (UID: \"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6\") "
Jun 10 20:09:58.864616 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.864601    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62cebc7c-fd16-4d95-b53f-e242bf127bc7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-22th9\" (UID: \"62cebc7c-fd16-4d95-b53f-e242bf127bc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:58.864662 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.864635    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mj7vm\" (UniqueName: \"kubernetes.io/projected/62cebc7c-fd16-4d95-b53f-e242bf127bc7-kube-api-access-mj7vm\") pod \"kuadrant-operator-controller-manager-86878c769f-22th9\" (UID: \"62cebc7c-fd16-4d95-b53f-e242bf127bc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:58.864858 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.864827    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" (UID: "0431f8bd-e2d5-4785-84b1-8d4edd5f00b6"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:09:58.866592 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.866560    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-kube-api-access-mbn86" (OuterVolumeSpecName: "kube-api-access-mbn86") pod "0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" (UID: "0431f8bd-e2d5-4785-84b1-8d4edd5f00b6"). InnerVolumeSpecName "kube-api-access-mbn86". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:09:58.965468 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.965432    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62cebc7c-fd16-4d95-b53f-e242bf127bc7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-22th9\" (UID: \"62cebc7c-fd16-4d95-b53f-e242bf127bc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:58.965636 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.965495    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mj7vm\" (UniqueName: \"kubernetes.io/projected/62cebc7c-fd16-4d95-b53f-e242bf127bc7-kube-api-access-mj7vm\") pod \"kuadrant-operator-controller-manager-86878c769f-22th9\" (UID: \"62cebc7c-fd16-4d95-b53f-e242bf127bc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:58.965636 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.965562    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-extensions-socket-volume\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:58.965636 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.965582    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbn86\" (UniqueName: \"kubernetes.io/projected/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6-kube-api-access-mbn86\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:09:58.965910 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.965891    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/62cebc7c-fd16-4d95-b53f-e242bf127bc7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-22th9\" (UID: \"62cebc7c-fd16-4d95-b53f-e242bf127bc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:58.973441 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:58.973415    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mj7vm\" (UniqueName: \"kubernetes.io/projected/62cebc7c-fd16-4d95-b53f-e242bf127bc7-kube-api-access-mj7vm\") pod \"kuadrant-operator-controller-manager-86878c769f-22th9\" (UID: \"62cebc7c-fd16-4d95-b53f-e242bf127bc7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:59.092438 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.092353    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:59.222512 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.222488    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"]
Jun 10 20:09:59.225177 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:09:59.225158    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62cebc7c_fd16_4d95_b53f_e242bf127bc7.slice/crio-617d22ffdb5d2c14a36226aa03b06007eb26b7cba8e83f218a4e2a99970df7d2 WatchSource:0}: Error finding container 617d22ffdb5d2c14a36226aa03b06007eb26b7cba8e83f218a4e2a99970df7d2: Status 404 returned error can't find the container with id 617d22ffdb5d2c14a36226aa03b06007eb26b7cba8e83f218a4e2a99970df7d2
Jun 10 20:09:59.515578 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.515500    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-2j4pw"
Jun 10 20:09:59.568575 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.568525    2578 generic.go:356] "Generic (PLEG): container finished" podID="0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" containerID="fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609" exitCode=0
Jun 10 20:09:59.568775 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.568594    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"
Jun 10 20:09:59.568775 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.568595    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2" event={"ID":"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6","Type":"ContainerDied","Data":"fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609"}
Jun 10 20:09:59.568775 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.568689    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2" event={"ID":"0431f8bd-e2d5-4785-84b1-8d4edd5f00b6","Type":"ContainerDied","Data":"db22961e75f1084d03b1866870d62ae60f4673882aa287c928766502665e95ea"}
Jun 10 20:09:59.568775 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.568720    2578 scope.go:117] "RemoveContainer" containerID="fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609"
Jun 10 20:09:59.570899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.570867    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9" event={"ID":"62cebc7c-fd16-4d95-b53f-e242bf127bc7","Type":"ContainerStarted","Data":"d3e7612cf52650ebed87b17cb0706e8ebb157304239a331ee02d3875f6cfc67a"}
Jun 10 20:09:59.571026 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.570924    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9" event={"ID":"62cebc7c-fd16-4d95-b53f-e242bf127bc7","Type":"ContainerStarted","Data":"617d22ffdb5d2c14a36226aa03b06007eb26b7cba8e83f218a4e2a99970df7d2"}
Jun 10 20:09:59.571093 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.571042    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:09:59.579600 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.579574    2578 scope.go:117] "RemoveContainer" containerID="fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609"
Jun 10 20:09:59.579978 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:09:59.579953    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609\": container with ID starting with fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609 not found: ID does not exist" containerID="fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609"
Jun 10 20:09:59.580110 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.579991    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609"} err="failed to get container status \"fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609\": rpc error: code = NotFound desc = could not find container \"fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609\": container with ID starting with fee60f423a8606f86e22c4e40818336d2d3b87dabf8eb4c5e62590ccc39df609 not found: ID does not exist"
Jun 10 20:09:59.589443 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.589395    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9" podStartSLOduration=1.589377191 podStartE2EDuration="1.589377191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:09:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:09:59.587933336 +0000 UTC m=+621.848903027" watchObservedRunningTime="2026-06-10 20:09:59.589377191 +0000 UTC m=+621.850346885"
Jun 10 20:09:59.603167 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.603145    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"]
Jun 10 20:09:59.607515 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:09:59.607494    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-fwzc2"]
Jun 10 20:10:00.163430 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:00.163399    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" path="/var/lib/kubelet/pods/0431f8bd-e2d5-4785-84b1-8d4edd5f00b6/volumes"
Jun 10 20:10:10.579213 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.579175    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-22th9"
Jun 10 20:10:10.628779 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.628742    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"]
Jun 10 20:10:10.629079 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.629026    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z" podUID="2ec62657-a4fb-42f5-a735-07072cc6a937" containerName="manager" containerID="cri-o://1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1" gracePeriod=10
Jun 10 20:10:10.887323 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.887293    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:10:10.968973 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.968939    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txmqz\" (UniqueName: \"kubernetes.io/projected/2ec62657-a4fb-42f5-a735-07072cc6a937-kube-api-access-txmqz\") pod \"2ec62657-a4fb-42f5-a735-07072cc6a937\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") "
Jun 10 20:10:10.969147 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.968988    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ec62657-a4fb-42f5-a735-07072cc6a937-extensions-socket-volume\") pod \"2ec62657-a4fb-42f5-a735-07072cc6a937\" (UID: \"2ec62657-a4fb-42f5-a735-07072cc6a937\") "
Jun 10 20:10:10.969411 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.969392    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2ec62657-a4fb-42f5-a735-07072cc6a937-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "2ec62657-a4fb-42f5-a735-07072cc6a937" (UID: "2ec62657-a4fb-42f5-a735-07072cc6a937"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 10 20:10:10.971083 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:10.971062    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ec62657-a4fb-42f5-a735-07072cc6a937-kube-api-access-txmqz" (OuterVolumeSpecName: "kube-api-access-txmqz") pod "2ec62657-a4fb-42f5-a735-07072cc6a937" (UID: "2ec62657-a4fb-42f5-a735-07072cc6a937"). InnerVolumeSpecName "kube-api-access-txmqz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:10:11.070392 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.070359    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txmqz\" (UniqueName: \"kubernetes.io/projected/2ec62657-a4fb-42f5-a735-07072cc6a937-kube-api-access-txmqz\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:10:11.070392 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.070386    2578 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ec62657-a4fb-42f5-a735-07072cc6a937-extensions-socket-volume\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:10:11.629898 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.629865    2578 generic.go:356] "Generic (PLEG): container finished" podID="2ec62657-a4fb-42f5-a735-07072cc6a937" containerID="1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1" exitCode=0
Jun 10 20:10:11.630352 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.629911    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"
Jun 10 20:10:11.630352 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.629956    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z" event={"ID":"2ec62657-a4fb-42f5-a735-07072cc6a937","Type":"ContainerDied","Data":"1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1"}
Jun 10 20:10:11.630352 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.630018    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z" event={"ID":"2ec62657-a4fb-42f5-a735-07072cc6a937","Type":"ContainerDied","Data":"40dcf923e008848afd0f051b96d85a4704f7d85f59746073b44dff40b277c275"}
Jun 10 20:10:11.630352 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.630064    2578 scope.go:117] "RemoveContainer" containerID="1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1"
Jun 10 20:10:11.639196 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.639170    2578 scope.go:117] "RemoveContainer" containerID="1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1"
Jun 10 20:10:11.639444 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:10:11.639420    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1\": container with ID starting with 1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1 not found: ID does not exist" containerID="1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1"
Jun 10 20:10:11.639483 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.639453    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1"} err="failed to get container status \"1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1\": rpc error: code = NotFound desc = could not find container \"1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1\": container with ID starting with 1ff60c8bad769732b3076386a22af5a0c9f024d251d35bb8599e0fc652be3bb1 not found: ID does not exist"
Jun 10 20:10:11.652147 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.652122    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"]
Jun 10 20:10:11.658330 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:11.658307    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-kvc8z"]
Jun 10 20:10:12.163641 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:12.163602    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ec62657-a4fb-42f5-a735-07072cc6a937" path="/var/lib/kubelet/pods/2ec62657-a4fb-42f5-a735-07072cc6a937/volumes"
Jun 10 20:10:14.830526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.830487    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"]
Jun 10 20:10:14.830966 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.830837    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" containerName="manager"
Jun 10 20:10:14.830966 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.830863    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" containerName="manager"
Jun 10 20:10:14.830966 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.830876    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ec62657-a4fb-42f5-a735-07072cc6a937" containerName="manager"
Jun 10 20:10:14.830966 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.830882    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ec62657-a4fb-42f5-a735-07072cc6a937" containerName="manager"
Jun 10 20:10:14.830966 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.830947    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0431f8bd-e2d5-4785-84b1-8d4edd5f00b6" containerName="manager"
Jun 10 20:10:14.830966 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.830962    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ec62657-a4fb-42f5-a735-07072cc6a937" containerName="manager"
Jun 10 20:10:14.834129 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.834108    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.836645 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.836625    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cpbpq\""
Jun 10 20:10:14.847309 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.847285    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"]
Jun 10 20:10:14.908252 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908216    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908445 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908308    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908445 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908356    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908445 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908378    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908445 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908395    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9h9bv\" (UniqueName: \"kubernetes.io/projected/b678c026-0ece-4565-8ba1-2447db6f18bb-kube-api-access-9h9bv\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908445 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908433    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908479    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908507    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b678c026-0ece-4565-8ba1-2447db6f18bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:14.908642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:14.908566    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009236 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009198    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009236 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009241    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009460 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009264    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9h9bv\" (UniqueName: \"kubernetes.io/projected/b678c026-0ece-4565-8ba1-2447db6f18bb-kube-api-access-9h9bv\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009460 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009430    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009540 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009488    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009540 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009525    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b678c026-0ece-4565-8ba1-2447db6f18bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009634 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009603    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009689 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009663    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009744 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009683    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-workload-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009744 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009696    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-workload-certs\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009744 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009705    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.009932 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.009745    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-data\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.010201 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.010180    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-credential-socket\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.010273 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.010235    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b678c026-0ece-4565-8ba1-2447db6f18bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.011779 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.011751    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.012098 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.012081    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.017445 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.017417    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9h9bv\" (UniqueName: \"kubernetes.io/projected/b678c026-0ece-4565-8ba1-2447db6f18bb-kube-api-access-9h9bv\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.017974 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.017955    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b678c026-0ece-4565-8ba1-2447db6f18bb-istio-token\") pod \"maas-default-gateway-openshift-default-8559cd5744-pfhx8\" (UID: \"b678c026-0ece-4565-8ba1-2447db6f18bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.145119 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.145029    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:15.280715 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.280691    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"]
Jun 10 20:10:15.282829 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:10:15.282805    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb678c026_0ece_4565_8ba1_2447db6f18bb.slice/crio-ddcc0fa50061708c651b8940e5703ef298942f5397dee363e0cd08e8ed32c39e WatchSource:0}: Error finding container ddcc0fa50061708c651b8940e5703ef298942f5397dee363e0cd08e8ed32c39e: Status 404 returned error can't find the container with id ddcc0fa50061708c651b8940e5703ef298942f5397dee363e0cd08e8ed32c39e
Jun 10 20:10:15.284957 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.284928    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:10:15.285058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.284990    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:10:15.285058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.285026    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:10:15.654604 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.654568    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" event={"ID":"b678c026-0ece-4565-8ba1-2447db6f18bb","Type":"ContainerStarted","Data":"0d38110c749aca69c35da8b3cd10973e5480e299ea1c01e7ccde389332eeab35"}
Jun 10 20:10:15.654767 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.654620    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" event={"ID":"b678c026-0ece-4565-8ba1-2447db6f18bb","Type":"ContainerStarted","Data":"ddcc0fa50061708c651b8940e5703ef298942f5397dee363e0cd08e8ed32c39e"}
Jun 10 20:10:15.674751 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:15.674693    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" podStartSLOduration=1.67467362 podStartE2EDuration="1.67467362s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:10:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:10:15.672576757 +0000 UTC m=+637.933546476" watchObservedRunningTime="2026-06-10 20:10:15.67467362 +0000 UTC m=+637.935643313"
Jun 10 20:10:16.145459 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:16.145412    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:16.150010 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:16.149987    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:16.659646 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:16.659608    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:16.660663 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:16.660644    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:10:29.588498 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.588462    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-rffnx"]
Jun 10 20:10:29.591090 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.591069    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rffnx"
Jun 10 20:10:29.593623 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.593605    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-t26dq\""
Jun 10 20:10:29.601890 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.601863    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rffnx"]
Jun 10 20:10:29.747802 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.747766    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bb5l\" (UniqueName: \"kubernetes.io/projected/c75fcf4c-c1ec-4619-95f8-09adeb1fdab2-kube-api-access-7bb5l\") pod \"authorino-58cd955675-rffnx\" (UID: \"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2\") " pod="kuadrant-system/authorino-58cd955675-rffnx"
Jun 10 20:10:29.848740 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.848658    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bb5l\" (UniqueName: \"kubernetes.io/projected/c75fcf4c-c1ec-4619-95f8-09adeb1fdab2-kube-api-access-7bb5l\") pod \"authorino-58cd955675-rffnx\" (UID: \"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2\") " pod="kuadrant-system/authorino-58cd955675-rffnx"
Jun 10 20:10:29.857061 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.857035    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bb5l\" (UniqueName: \"kubernetes.io/projected/c75fcf4c-c1ec-4619-95f8-09adeb1fdab2-kube-api-access-7bb5l\") pod \"authorino-58cd955675-rffnx\" (UID: \"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2\") " pod="kuadrant-system/authorino-58cd955675-rffnx"
Jun 10 20:10:29.900961 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:29.900930    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rffnx"
Jun 10 20:10:30.027792 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:30.027758    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-rffnx"]
Jun 10 20:10:30.030984 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:10:30.030960    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc75fcf4c_c1ec_4619_95f8_09adeb1fdab2.slice/crio-df3928075f59b0f478b1036b0249bb29b9857031e59edcec03cc3b5a677208c3 WatchSource:0}: Error finding container df3928075f59b0f478b1036b0249bb29b9857031e59edcec03cc3b5a677208c3: Status 404 returned error can't find the container with id df3928075f59b0f478b1036b0249bb29b9857031e59edcec03cc3b5a677208c3
Jun 10 20:10:30.732467 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:30.732424    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rffnx" event={"ID":"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2","Type":"ContainerStarted","Data":"df3928075f59b0f478b1036b0249bb29b9857031e59edcec03cc3b5a677208c3"}
Jun 10 20:10:33.750542 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:33.750496    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rffnx" event={"ID":"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2","Type":"ContainerStarted","Data":"b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4"}
Jun 10 20:10:33.769291 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:33.769074    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-rffnx" podStartSLOduration=1.849876464 podStartE2EDuration="4.769052531s" totalImagesPullingTime="2.919176067s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:10:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:10:33.768696954 +0000 UTC m=+656.029666645" watchObservedRunningTime="2026-06-10 20:10:33.769052531 +0000 UTC m=+656.030022224"
Jun 10 20:10:34.633024 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:34.632983    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rffnx"]
Jun 10 20:10:35.761144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:35.761106    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-rffnx" podUID="c75fcf4c-c1ec-4619-95f8-09adeb1fdab2" containerName="authorino" containerID="cri-o://b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4" gracePeriod=30
Jun 10 20:10:36.001845 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.001822    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rffnx"
Jun 10 20:10:36.005471 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.005451    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bb5l\" (UniqueName: \"kubernetes.io/projected/c75fcf4c-c1ec-4619-95f8-09adeb1fdab2-kube-api-access-7bb5l\") pod \"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2\" (UID: \"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2\") "
Jun 10 20:10:36.007299 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.007277    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c75fcf4c-c1ec-4619-95f8-09adeb1fdab2-kube-api-access-7bb5l" (OuterVolumeSpecName: "kube-api-access-7bb5l") pod "c75fcf4c-c1ec-4619-95f8-09adeb1fdab2" (UID: "c75fcf4c-c1ec-4619-95f8-09adeb1fdab2"). InnerVolumeSpecName "kube-api-access-7bb5l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:10:36.106748 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.106717    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bb5l\" (UniqueName: \"kubernetes.io/projected/c75fcf4c-c1ec-4619-95f8-09adeb1fdab2-kube-api-access-7bb5l\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:10:36.767176 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.767141    2578 generic.go:356] "Generic (PLEG): container finished" podID="c75fcf4c-c1ec-4619-95f8-09adeb1fdab2" containerID="b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4" exitCode=0
Jun 10 20:10:36.767634 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.767184    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-rffnx"
Jun 10 20:10:36.767634 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.767225    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rffnx" event={"ID":"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2","Type":"ContainerDied","Data":"b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4"}
Jun 10 20:10:36.767634 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.767264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-rffnx" event={"ID":"c75fcf4c-c1ec-4619-95f8-09adeb1fdab2","Type":"ContainerDied","Data":"df3928075f59b0f478b1036b0249bb29b9857031e59edcec03cc3b5a677208c3"}
Jun 10 20:10:36.767634 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.767281    2578 scope.go:117] "RemoveContainer" containerID="b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4"
Jun 10 20:10:36.776048 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.776016    2578 scope.go:117] "RemoveContainer" containerID="b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4"
Jun 10 20:10:36.776296 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:10:36.776279    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4\": container with ID starting with b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4 not found: ID does not exist" containerID="b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4"
Jun 10 20:10:36.776353 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.776305    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4"} err="failed to get container status \"b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4\": rpc error: code = NotFound desc = could not find container \"b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4\": container with ID starting with b8cb8e02e43f380ade6dc5fc96f37d8a179e8779825cb87cfa45787d2b6740a4 not found: ID does not exist"
Jun 10 20:10:36.782696 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.782669    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-rffnx"]
Jun 10 20:10:36.786281 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:36.786260    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-rffnx"]
Jun 10 20:10:38.168716 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:10:38.168682    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c75fcf4c-c1ec-4619-95f8-09adeb1fdab2" path="/var/lib/kubelet/pods/c75fcf4c-c1ec-4619-95f8-09adeb1fdab2/volumes"
Jun 10 20:11:24.613001 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.612915    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:11:24.613439 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.613301    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c75fcf4c-c1ec-4619-95f8-09adeb1fdab2" containerName="authorino"
Jun 10 20:11:24.613439 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.613314    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c75fcf4c-c1ec-4619-95f8-09adeb1fdab2" containerName="authorino"
Jun 10 20:11:24.613439 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.613396    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c75fcf4c-c1ec-4619-95f8-09adeb1fdab2" containerName="authorino"
Jun 10 20:11:24.616307 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.616290    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:24.618621 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.618599    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 10 20:11:24.618761 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.618658    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-mtbnt\""
Jun 10 20:11:24.618761 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.618703    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 10 20:11:24.618761 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.618711    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 10 20:11:24.624494 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.624473    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:11:24.629172 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.629148    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9b4s\" (UniqueName: \"kubernetes.io/projected/c4759240-7464-4f42-bcc8-669a61ff427b-kube-api-access-z9b4s\") pod \"maas-keycloak-0\" (UID: \"c4759240-7464-4f42-bcc8-669a61ff427b\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:24.729621 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.729589    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9b4s\" (UniqueName: \"kubernetes.io/projected/c4759240-7464-4f42-bcc8-669a61ff427b-kube-api-access-z9b4s\") pod \"maas-keycloak-0\" (UID: \"c4759240-7464-4f42-bcc8-669a61ff427b\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:24.738143 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.738123    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9b4s\" (UniqueName: \"kubernetes.io/projected/c4759240-7464-4f42-bcc8-669a61ff427b-kube-api-access-z9b4s\") pod \"maas-keycloak-0\" (UID: \"c4759240-7464-4f42-bcc8-669a61ff427b\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:24.926095 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:24.926022    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:25.058056 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:25.058034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:11:25.060331 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:11:25.060302    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4759240_7464_4f42_bcc8_669a61ff427b.slice/crio-25b046ce91ee76ec215d2304dd076fe2272e28d47b7470305f9939d88fea31b6 WatchSource:0}: Error finding container 25b046ce91ee76ec215d2304dd076fe2272e28d47b7470305f9939d88fea31b6: Status 404 returned error can't find the container with id 25b046ce91ee76ec215d2304dd076fe2272e28d47b7470305f9939d88fea31b6
Jun 10 20:11:25.998221 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:25.998188    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c4759240-7464-4f42-bcc8-669a61ff427b","Type":"ContainerStarted","Data":"25b046ce91ee76ec215d2304dd076fe2272e28d47b7470305f9939d88fea31b6"}
Jun 10 20:11:30.020211 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:30.020166    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c4759240-7464-4f42-bcc8-669a61ff427b","Type":"ContainerStarted","Data":"84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3"}
Jun 10 20:11:30.926541 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:30.926501    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:30.928231 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:30.928195    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:31.926980 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:31.926931    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:32.926955 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:32.926903    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:33.926537 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:33.926481    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:34.926893 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:34.926807    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:34.928097 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:34.928070    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:35.926591 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:35.926544    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:36.927426 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:36.927367    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:37.927074 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:37.927029    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:38.927360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:38.927315    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:39.927444 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:39.927397    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:40.926490 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:40.926444    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:41.926894 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:41.926832    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.38:9000/health/started\": dial tcp 10.134.0.38:9000: connect: connection refused"
Jun 10 20:11:43.016739 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:43.016448    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:43.034472 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:43.034400    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=14.492182462 podStartE2EDuration="19.034379674s" totalImagesPullingTime="4.542197212s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:11:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:11:30.036957868 +0000 UTC m=+712.297927561" watchObservedRunningTime="2026-06-10 20:11:43.034379674 +0000 UTC m=+725.295349367"
Jun 10 20:11:43.038484 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:43.038203    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 20:11:53.022816 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:53.022774    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:11:59.507174 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.507141    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-68bdfcb748-bb9tc"]
Jun 10 20:11:59.510549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.510529    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:11:59.513677 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.513646    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-smtkj\""
Jun 10 20:11:59.513981 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.513937    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 10 20:11:59.514207 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.514173    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jun 10 20:11:59.521936 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.521845    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdfcb748-bb9tc"]
Jun 10 20:11:59.586916 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.586880    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert\") pod \"maas-controller-68bdfcb748-bb9tc\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") " pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:11:59.587082 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.586994    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wxgz\" (UniqueName: \"kubernetes.io/projected/0f565bb7-4cd2-4426-8263-3d49ba456a60-kube-api-access-6wxgz\") pod \"maas-controller-68bdfcb748-bb9tc\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") " pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:11:59.674475 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.674439    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6cd5b57c44-bwzqj"]
Jun 10 20:11:59.677900 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.677879    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:11:59.685998 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.685973    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd5b57c44-bwzqj"]
Jun 10 20:11:59.687833 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.687810    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wxgz\" (UniqueName: \"kubernetes.io/projected/0f565bb7-4cd2-4426-8263-3d49ba456a60-kube-api-access-6wxgz\") pod \"maas-controller-68bdfcb748-bb9tc\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") " pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:11:59.687963 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.687893    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert\") pod \"maas-controller-68bdfcb748-bb9tc\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") " pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:11:59.688039 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:11:59.687984    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jun 10 20:11:59.688095 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:11:59.688058    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert podName:0f565bb7-4cd2-4426-8263-3d49ba456a60 nodeName:}" failed. No retries permitted until 2026-06-10 20:12:00.188040771 +0000 UTC m=+742.449010457 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert") pod "maas-controller-68bdfcb748-bb9tc" (UID: "0f565bb7-4cd2-4426-8263-3d49ba456a60") : secret "maas-controller-webhook-cert" not found
Jun 10 20:11:59.698642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.698609    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wxgz\" (UniqueName: \"kubernetes.io/projected/0f565bb7-4cd2-4426-8263-3d49ba456a60-kube-api-access-6wxgz\") pod \"maas-controller-68bdfcb748-bb9tc\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") " pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:11:59.789221 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.789195    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sqsdm\" (UniqueName: \"kubernetes.io/projected/c7021d33-917f-473e-b48d-aab74373664d-kube-api-access-sqsdm\") pod \"maas-controller-6cd5b57c44-bwzqj\" (UID: \"c7021d33-917f-473e-b48d-aab74373664d\") " pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:11:59.789363 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.789237    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7021d33-917f-473e-b48d-aab74373664d-webhook-cert\") pod \"maas-controller-6cd5b57c44-bwzqj\" (UID: \"c7021d33-917f-473e-b48d-aab74373664d\") " pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:11:59.889621 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.889581    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sqsdm\" (UniqueName: \"kubernetes.io/projected/c7021d33-917f-473e-b48d-aab74373664d-kube-api-access-sqsdm\") pod \"maas-controller-6cd5b57c44-bwzqj\" (UID: \"c7021d33-917f-473e-b48d-aab74373664d\") " pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:11:59.889799 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.889638    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7021d33-917f-473e-b48d-aab74373664d-webhook-cert\") pod \"maas-controller-6cd5b57c44-bwzqj\" (UID: \"c7021d33-917f-473e-b48d-aab74373664d\") " pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:11:59.889799 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:11:59.889719    2578 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found
Jun 10 20:11:59.889799 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:11:59.889788    2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7021d33-917f-473e-b48d-aab74373664d-webhook-cert podName:c7021d33-917f-473e-b48d-aab74373664d nodeName:}" failed. No retries permitted until 2026-06-10 20:12:00.389773444 +0000 UTC m=+742.650743114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/c7021d33-917f-473e-b48d-aab74373664d-webhook-cert") pod "maas-controller-6cd5b57c44-bwzqj" (UID: "c7021d33-917f-473e-b48d-aab74373664d") : secret "maas-controller-webhook-cert" not found
Jun 10 20:11:59.900214 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:11:59.900189    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sqsdm\" (UniqueName: \"kubernetes.io/projected/c7021d33-917f-473e-b48d-aab74373664d-kube-api-access-sqsdm\") pod \"maas-controller-6cd5b57c44-bwzqj\" (UID: \"c7021d33-917f-473e-b48d-aab74373664d\") " pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:12:00.192650 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.192563    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert\") pod \"maas-controller-68bdfcb748-bb9tc\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") " pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:12:00.195224 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.195191    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert\") pod \"maas-controller-68bdfcb748-bb9tc\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") " pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:12:00.394250 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.394205    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7021d33-917f-473e-b48d-aab74373664d-webhook-cert\") pod \"maas-controller-6cd5b57c44-bwzqj\" (UID: \"c7021d33-917f-473e-b48d-aab74373664d\") " pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:12:00.396694 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.396664    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c7021d33-917f-473e-b48d-aab74373664d-webhook-cert\") pod \"maas-controller-6cd5b57c44-bwzqj\" (UID: \"c7021d33-917f-473e-b48d-aab74373664d\") " pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:12:00.425497 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.425462    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:12:00.557576 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.557545    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-68bdfcb748-bb9tc"]
Jun 10 20:12:00.560271 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:12:00.560241    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f565bb7_4cd2_4426_8263_3d49ba456a60.slice/crio-10937aa134b52d6555b42d0b5156bc21451e5837c77aa14f0e0eeeeea899dfcc WatchSource:0}: Error finding container 10937aa134b52d6555b42d0b5156bc21451e5837c77aa14f0e0eeeeea899dfcc: Status 404 returned error can't find the container with id 10937aa134b52d6555b42d0b5156bc21451e5837c77aa14f0e0eeeeea899dfcc
Jun 10 20:12:00.588842 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.588814    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:12:00.717285 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:00.717245    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6cd5b57c44-bwzqj"]
Jun 10 20:12:00.719673 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:12:00.719637    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7021d33_917f_473e_b48d_aab74373664d.slice/crio-8319ae8b3f7a5b4925c4fba99b16a8c592149079b6dfa0f2b394284b5dbf89d9 WatchSource:0}: Error finding container 8319ae8b3f7a5b4925c4fba99b16a8c592149079b6dfa0f2b394284b5dbf89d9: Status 404 returned error can't find the container with id 8319ae8b3f7a5b4925c4fba99b16a8c592149079b6dfa0f2b394284b5dbf89d9
Jun 10 20:12:01.200318 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:01.200254    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdfcb748-bb9tc" event={"ID":"0f565bb7-4cd2-4426-8263-3d49ba456a60","Type":"ContainerStarted","Data":"10937aa134b52d6555b42d0b5156bc21451e5837c77aa14f0e0eeeeea899dfcc"}
Jun 10 20:12:01.201706 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:01.201667    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd5b57c44-bwzqj" event={"ID":"c7021d33-917f-473e-b48d-aab74373664d","Type":"ContainerStarted","Data":"8319ae8b3f7a5b4925c4fba99b16a8c592149079b6dfa0f2b394284b5dbf89d9"}
Jun 10 20:12:04.218154 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:04.218115    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdfcb748-bb9tc" event={"ID":"0f565bb7-4cd2-4426-8263-3d49ba456a60","Type":"ContainerStarted","Data":"79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7"}
Jun 10 20:12:04.218575 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:04.218222    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:12:04.219636 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:04.219605    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6cd5b57c44-bwzqj" event={"ID":"c7021d33-917f-473e-b48d-aab74373664d","Type":"ContainerStarted","Data":"a71ba04a62c3f72787382742104280a25aed994ed28f9f346a9230ece2d4440a"}
Jun 10 20:12:04.219746 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:04.219668    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:12:04.236617 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:04.236564    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-68bdfcb748-bb9tc" podStartSLOduration=2.539324187 podStartE2EDuration="5.236549975s" totalImagesPullingTime="2.697225788s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:12:04.234454303 +0000 UTC m=+746.495423995" watchObservedRunningTime="2026-06-10 20:12:04.236549975 +0000 UTC m=+746.497519667"
Jun 10 20:12:04.252999 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:04.252937    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6cd5b57c44-bwzqj" podStartSLOduration=2.707838864 podStartE2EDuration="5.252918181s" totalImagesPullingTime="2.545079317s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:11:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:12:04.251238467 +0000 UTC m=+746.512208171" watchObservedRunningTime="2026-06-10 20:12:04.252918181 +0000 UTC m=+746.513887874"
Jun 10 20:12:15.228843 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.228812    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:12:15.229411 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.229036    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6cd5b57c44-bwzqj"
Jun 10 20:12:15.295675 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.295622    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bdfcb748-bb9tc"]
Jun 10 20:12:15.295933 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.295901    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-68bdfcb748-bb9tc" podUID="0f565bb7-4cd2-4426-8263-3d49ba456a60" containerName="manager" containerID="cri-o://79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7" gracePeriod=30
Jun 10 20:12:15.544348 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.544326    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:12:15.643788 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.643752    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert\") pod \"0f565bb7-4cd2-4426-8263-3d49ba456a60\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") "
Jun 10 20:12:15.643979 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.643801    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wxgz\" (UniqueName: \"kubernetes.io/projected/0f565bb7-4cd2-4426-8263-3d49ba456a60-kube-api-access-6wxgz\") pod \"0f565bb7-4cd2-4426-8263-3d49ba456a60\" (UID: \"0f565bb7-4cd2-4426-8263-3d49ba456a60\") "
Jun 10 20:12:15.646096 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.646067    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "0f565bb7-4cd2-4426-8263-3d49ba456a60" (UID: "0f565bb7-4cd2-4426-8263-3d49ba456a60"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 10 20:12:15.646209 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.646104    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f565bb7-4cd2-4426-8263-3d49ba456a60-kube-api-access-6wxgz" (OuterVolumeSpecName: "kube-api-access-6wxgz") pod "0f565bb7-4cd2-4426-8263-3d49ba456a60" (UID: "0f565bb7-4cd2-4426-8263-3d49ba456a60"). InnerVolumeSpecName "kube-api-access-6wxgz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:12:15.744660 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.744616    2578 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0f565bb7-4cd2-4426-8263-3d49ba456a60-webhook-cert\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:12:15.744660 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:15.744654    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wxgz\" (UniqueName: \"kubernetes.io/projected/0f565bb7-4cd2-4426-8263-3d49ba456a60-kube-api-access-6wxgz\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:12:16.276495 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.276462    2578 generic.go:356] "Generic (PLEG): container finished" podID="0f565bb7-4cd2-4426-8263-3d49ba456a60" containerID="79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7" exitCode=0
Jun 10 20:12:16.276939 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.276500    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-68bdfcb748-bb9tc"
Jun 10 20:12:16.276939 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.276553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdfcb748-bb9tc" event={"ID":"0f565bb7-4cd2-4426-8263-3d49ba456a60","Type":"ContainerDied","Data":"79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7"}
Jun 10 20:12:16.276939 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.276604    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-68bdfcb748-bb9tc" event={"ID":"0f565bb7-4cd2-4426-8263-3d49ba456a60","Type":"ContainerDied","Data":"10937aa134b52d6555b42d0b5156bc21451e5837c77aa14f0e0eeeeea899dfcc"}
Jun 10 20:12:16.276939 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.276625    2578 scope.go:117] "RemoveContainer" containerID="79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7"
Jun 10 20:12:16.285172 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.285154    2578 scope.go:117] "RemoveContainer" containerID="79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7"
Jun 10 20:12:16.285425 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:12:16.285406    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7\": container with ID starting with 79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7 not found: ID does not exist" containerID="79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7"
Jun 10 20:12:16.285489 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.285432    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7"} err="failed to get container status \"79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7\": rpc error: code = NotFound desc = could not find container \"79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7\": container with ID starting with 79eb56406da3bfef2127e38fdbe9129921bf84c5d3edb6978850acf35c8408c7 not found: ID does not exist"
Jun 10 20:12:16.292271 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.292242    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-68bdfcb748-bb9tc"]
Jun 10 20:12:16.294277 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:16.294258    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-68bdfcb748-bb9tc"]
Jun 10 20:12:18.164321 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:18.164290    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f565bb7-4cd2-4426-8263-3d49ba456a60" path="/var/lib/kubelet/pods/0f565bb7-4cd2-4426-8263-3d49ba456a60/volumes"
Jun 10 20:12:34.581435 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.581403    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-8449d8b6c8-f6mwx"]
Jun 10 20:12:34.581799 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.581777    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f565bb7-4cd2-4426-8263-3d49ba456a60" containerName="manager"
Jun 10 20:12:34.581799 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.581788    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f565bb7-4cd2-4426-8263-3d49ba456a60" containerName="manager"
Jun 10 20:12:34.581921 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.581871    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f565bb7-4cd2-4426-8263-3d49ba456a60" containerName="manager"
Jun 10 20:12:34.584917 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.584900    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:34.588478 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.588455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-n4ggl\""
Jun 10 20:12:34.588609 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.588455    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 10 20:12:34.594226 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.594199    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8449d8b6c8-f6mwx"]
Jun 10 20:12:34.616449 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.616428    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfx45\" (UniqueName: \"kubernetes.io/projected/4e77fff7-16cf-4413-9f72-110fa5d0c9e6-kube-api-access-sfx45\") pod \"maas-api-8449d8b6c8-f6mwx\" (UID: \"4e77fff7-16cf-4413-9f72-110fa5d0c9e6\") " pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:34.616556 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.616485    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77fff7-16cf-4413-9f72-110fa5d0c9e6-maas-api-tls\") pod \"maas-api-8449d8b6c8-f6mwx\" (UID: \"4e77fff7-16cf-4413-9f72-110fa5d0c9e6\") " pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:34.717473 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.717440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77fff7-16cf-4413-9f72-110fa5d0c9e6-maas-api-tls\") pod \"maas-api-8449d8b6c8-f6mwx\" (UID: \"4e77fff7-16cf-4413-9f72-110fa5d0c9e6\") " pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:34.717631 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.717507    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfx45\" (UniqueName: \"kubernetes.io/projected/4e77fff7-16cf-4413-9f72-110fa5d0c9e6-kube-api-access-sfx45\") pod \"maas-api-8449d8b6c8-f6mwx\" (UID: \"4e77fff7-16cf-4413-9f72-110fa5d0c9e6\") " pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:34.719813 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.719791    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/4e77fff7-16cf-4413-9f72-110fa5d0c9e6-maas-api-tls\") pod \"maas-api-8449d8b6c8-f6mwx\" (UID: \"4e77fff7-16cf-4413-9f72-110fa5d0c9e6\") " pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:34.725143 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.725121    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfx45\" (UniqueName: \"kubernetes.io/projected/4e77fff7-16cf-4413-9f72-110fa5d0c9e6-kube-api-access-sfx45\") pod \"maas-api-8449d8b6c8-f6mwx\" (UID: \"4e77fff7-16cf-4413-9f72-110fa5d0c9e6\") " pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:34.896701 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:34.896598    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:35.083603 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.083577    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-8449d8b6c8-f6mwx"]
Jun 10 20:12:35.085835 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:12:35.085804    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e77fff7_16cf_4413_9f72_110fa5d0c9e6.slice/crio-40df4babd9c9cc1b77cfaaadba38b221c2493bd4e426ee49dfe57ead12fdbd52 WatchSource:0}: Error finding container 40df4babd9c9cc1b77cfaaadba38b221c2493bd4e426ee49dfe57ead12fdbd52: Status 404 returned error can't find the container with id 40df4babd9c9cc1b77cfaaadba38b221c2493bd4e426ee49dfe57ead12fdbd52
Jun 10 20:12:35.087551 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.087533    2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 10 20:12:35.209389 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.209320    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hwjb9"]
Jun 10 20:12:35.214268 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.214250    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9"
Jun 10 20:12:35.216881 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.216862    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 10 20:12:35.216994 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.216879    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-jmrdw\""
Jun 10 20:12:35.222669 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.222647    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hwjb9"]
Jun 10 20:12:35.291097 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.291061    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-67mlx"]
Jun 10 20:12:35.294598 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.294574    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-67mlx"
Jun 10 20:12:35.302953 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.302924    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-67mlx"]
Jun 10 20:12:35.321133 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.321047    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2dkj\" (UniqueName: \"kubernetes.io/projected/c42beee6-2e7d-4f40-9997-6bcc5378a5ec-kube-api-access-r2dkj\") pod \"payload-processing-699b6cd6c-67mlx\" (UID: \"c42beee6-2e7d-4f40-9997-6bcc5378a5ec\") " pod="openshift-ingress/payload-processing-699b6cd6c-67mlx"
Jun 10 20:12:35.321133 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.321109    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzfmx\" (UniqueName: \"kubernetes.io/projected/cae23cf5-1c1e-413d-8ba2-71cde21b0a7e-kube-api-access-zzfmx\") pod \"payload-pre-processing-579785bc64-hwjb9\" (UID: \"cae23cf5-1c1e-413d-8ba2-71cde21b0a7e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9"
Jun 10 20:12:35.371068 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.371036    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8449d8b6c8-f6mwx" event={"ID":"4e77fff7-16cf-4413-9f72-110fa5d0c9e6","Type":"ContainerStarted","Data":"40df4babd9c9cc1b77cfaaadba38b221c2493bd4e426ee49dfe57ead12fdbd52"}
Jun 10 20:12:35.422703 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.422665    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2dkj\" (UniqueName: \"kubernetes.io/projected/c42beee6-2e7d-4f40-9997-6bcc5378a5ec-kube-api-access-r2dkj\") pod \"payload-processing-699b6cd6c-67mlx\" (UID: \"c42beee6-2e7d-4f40-9997-6bcc5378a5ec\") " pod="openshift-ingress/payload-processing-699b6cd6c-67mlx"
Jun 10 20:12:35.422879 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.422709    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzfmx\" (UniqueName: \"kubernetes.io/projected/cae23cf5-1c1e-413d-8ba2-71cde21b0a7e-kube-api-access-zzfmx\") pod \"payload-pre-processing-579785bc64-hwjb9\" (UID: \"cae23cf5-1c1e-413d-8ba2-71cde21b0a7e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9"
Jun 10 20:12:35.431619 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.431593    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzfmx\" (UniqueName: \"kubernetes.io/projected/cae23cf5-1c1e-413d-8ba2-71cde21b0a7e-kube-api-access-zzfmx\") pod \"payload-pre-processing-579785bc64-hwjb9\" (UID: \"cae23cf5-1c1e-413d-8ba2-71cde21b0a7e\") " pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9"
Jun 10 20:12:35.431762 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.431620    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2dkj\" (UniqueName: \"kubernetes.io/projected/c42beee6-2e7d-4f40-9997-6bcc5378a5ec-kube-api-access-r2dkj\") pod \"payload-processing-699b6cd6c-67mlx\" (UID: \"c42beee6-2e7d-4f40-9997-6bcc5378a5ec\") " pod="openshift-ingress/payload-processing-699b6cd6c-67mlx"
Jun 10 20:12:35.525282 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.525252    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9"
Jun 10 20:12:35.608300 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.608267    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-699b6cd6c-67mlx"
Jun 10 20:12:35.668737 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.666979    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-579785bc64-hwjb9"]
Jun 10 20:12:35.670912 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:12:35.670879    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae23cf5_1c1e_413d_8ba2_71cde21b0a7e.slice/crio-ca073db1f0cba35d2af1858c1b7f7d1b68b8c7ef3e3ad070f3a13ac8e1a81eef WatchSource:0}: Error finding container ca073db1f0cba35d2af1858c1b7f7d1b68b8c7ef3e3ad070f3a13ac8e1a81eef: Status 404 returned error can't find the container with id ca073db1f0cba35d2af1858c1b7f7d1b68b8c7ef3e3ad070f3a13ac8e1a81eef
Jun 10 20:12:35.756548 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:35.756464    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-699b6cd6c-67mlx"]
Jun 10 20:12:35.760521 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:12:35.760478    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42beee6_2e7d_4f40_9997_6bcc5378a5ec.slice/crio-82060ba4a41abfa73ec9a2e0124f78e7e75f90cb7b03610ce08035ec1111060a WatchSource:0}: Error finding container 82060ba4a41abfa73ec9a2e0124f78e7e75f90cb7b03610ce08035ec1111060a: Status 404 returned error can't find the container with id 82060ba4a41abfa73ec9a2e0124f78e7e75f90cb7b03610ce08035ec1111060a
Jun 10 20:12:36.384888 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:36.384835    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-67mlx" event={"ID":"c42beee6-2e7d-4f40-9997-6bcc5378a5ec","Type":"ContainerStarted","Data":"82060ba4a41abfa73ec9a2e0124f78e7e75f90cb7b03610ce08035ec1111060a"}
Jun 10 20:12:36.387144 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:36.387072    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9" event={"ID":"cae23cf5-1c1e-413d-8ba2-71cde21b0a7e","Type":"ContainerStarted","Data":"ca073db1f0cba35d2af1858c1b7f7d1b68b8c7ef3e3ad070f3a13ac8e1a81eef"}
Jun 10 20:12:38.400983 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:38.400935    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-8449d8b6c8-f6mwx" event={"ID":"4e77fff7-16cf-4413-9f72-110fa5d0c9e6","Type":"ContainerStarted","Data":"17874a4eb92d719912068fd8646e7756cc0eccfe67486b6ccfc370be377bbc7b"}
Jun 10 20:12:38.401379 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:38.401359    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:38.416152 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:38.416066    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-8449d8b6c8-f6mwx" podStartSLOduration=2.102222742 podStartE2EDuration="4.416048231s" totalImagesPullingTime="2.313825489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:12:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:12:38.415441341 +0000 UTC m=+780.676411032" watchObservedRunningTime="2026-06-10 20:12:38.416048231 +0000 UTC m=+780.677017917"
Jun 10 20:12:39.100354 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:39.100331    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 10 20:12:39.407840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:39.407747    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9" event={"ID":"cae23cf5-1c1e-413d-8ba2-71cde21b0a7e","Type":"ContainerStarted","Data":"09e2020e2ce61d1d163b8e931b9ce536a9975faf88958914cda49287cceafd02"}
Jun 10 20:12:39.407840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:39.407818    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9"
Jun 10 20:12:39.409529 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:39.409503    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-699b6cd6c-67mlx" event={"ID":"c42beee6-2e7d-4f40-9997-6bcc5378a5ec","Type":"ContainerStarted","Data":"4efa46410b58fb3335774cdca74f1d0d80baede4a625b5166b85d5e036917dd2"}
Jun 10 20:12:39.409642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:39.409627    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-699b6cd6c-67mlx"
Jun 10 20:12:39.423735 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:39.423680    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9" podStartSLOduration=0.999601943 podStartE2EDuration="4.42366645s" totalImagesPullingTime="3.424064507s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:12:39.421412153 +0000 UTC m=+781.682381846" watchObservedRunningTime="2026-06-10 20:12:39.42366645 +0000 UTC m=+781.684636141"
Jun 10 20:12:39.437376 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:39.437321    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-699b6cd6c-67mlx" podStartSLOduration=1.098101181 podStartE2EDuration="4.43730411s" totalImagesPullingTime="3.339202929s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:12:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:12:39.434901541 +0000 UTC m=+781.695871234" watchObservedRunningTime="2026-06-10 20:12:39.43730411 +0000 UTC m=+781.698273802"
Jun 10 20:12:43.430513 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:43.430478    2578 generic.go:356] "Generic (PLEG): container finished" podID="b678c026-0ece-4565-8ba1-2447db6f18bb" containerID="0d38110c749aca69c35da8b3cd10973e5480e299ea1c01e7ccde389332eeab35" exitCode=0
Jun 10 20:12:43.430961 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:43.430553    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" event={"ID":"b678c026-0ece-4565-8ba1-2447db6f18bb","Type":"ContainerDied","Data":"0d38110c749aca69c35da8b3cd10973e5480e299ea1c01e7ccde389332eeab35"}
Jun 10 20:12:43.431029 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:43.431009    2578 scope.go:117] "RemoveContainer" containerID="0d38110c749aca69c35da8b3cd10973e5480e299ea1c01e7ccde389332eeab35"
Jun 10 20:12:43.432017 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:43.431979    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:12:43.432122 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:43.432072    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:12:43.432184 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:43.432121    2578 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jun 10 20:12:44.415206 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:44.415180    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-8449d8b6c8-f6mwx"
Jun 10 20:12:44.438491 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:44.438460    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" event={"ID":"b678c026-0ece-4565-8ba1-2447db6f18bb","Type":"ContainerStarted","Data":"24a6cd14be94e68b2c8e6e38ef6a8866c11032144b48380058ab30c009c7513a"}
Jun 10 20:12:45.146462 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:45.146418    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:12:45.146681 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:45.146548    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-pfhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jun 10 20:12:45.146681 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:45.146592    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" podUID="b678c026-0ece-4565-8ba1-2447db6f18bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jun 10 20:12:46.146181 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:46.146137    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-pfhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jun 10 20:12:46.146775 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:46.146203    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" podUID="b678c026-0ece-4565-8ba1-2447db6f18bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jun 10 20:12:46.601102 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:46.601066    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:12:46.601291 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:46.601254    2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak" containerID="cri-o://84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3" gracePeriod=30
Jun 10 20:12:46.660357 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:46.660318    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:12:47.146344 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:47.146300    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-pfhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jun 10 20:12:47.146834 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:47.146368    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" podUID="b678c026-0ece-4565-8ba1-2447db6f18bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jun 10 20:12:48.146100 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.145588    2578 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-8559cd5744-pfhx8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused" start-of-body=
Jun 10 20:12:48.146100 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.145656    2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8" podUID="b678c026-0ece-4565-8ba1-2447db6f18bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.36:15021/healthz/ready\": dial tcp 10.134.0.36:15021: connect: connection refused"
Jun 10 20:12:48.298022 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.297995    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.367197 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.367100    2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z9b4s\" (UniqueName: \"kubernetes.io/projected/c4759240-7464-4f42-bcc8-669a61ff427b-kube-api-access-z9b4s\") pod \"c4759240-7464-4f42-bcc8-669a61ff427b\" (UID: \"c4759240-7464-4f42-bcc8-669a61ff427b\") "
Jun 10 20:12:48.369991 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.369960    2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4759240-7464-4f42-bcc8-669a61ff427b-kube-api-access-z9b4s" (OuterVolumeSpecName: "kube-api-access-z9b4s") pod "c4759240-7464-4f42-bcc8-669a61ff427b" (UID: "c4759240-7464-4f42-bcc8-669a61ff427b"). InnerVolumeSpecName "kube-api-access-z9b4s". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 10 20:12:48.464199 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.464162    2578 generic.go:356] "Generic (PLEG): container finished" podID="c4759240-7464-4f42-bcc8-669a61ff427b" containerID="84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3" exitCode=143
Jun 10 20:12:48.464382 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.464215    2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.464382 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.464246    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c4759240-7464-4f42-bcc8-669a61ff427b","Type":"ContainerDied","Data":"84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3"}
Jun 10 20:12:48.464382 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.464300    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"c4759240-7464-4f42-bcc8-669a61ff427b","Type":"ContainerDied","Data":"25b046ce91ee76ec215d2304dd076fe2272e28d47b7470305f9939d88fea31b6"}
Jun 10 20:12:48.464382 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.464320    2578 scope.go:117] "RemoveContainer" containerID="84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3"
Jun 10 20:12:48.467969 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.467941    2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z9b4s\" (UniqueName: \"kubernetes.io/projected/c4759240-7464-4f42-bcc8-669a61ff427b-kube-api-access-z9b4s\") on node \"ip-10-0-137-191.ec2.internal\" DevicePath \"\""
Jun 10 20:12:48.474260 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.474244    2578 scope.go:117] "RemoveContainer" containerID="84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3"
Jun 10 20:12:48.474549 ip-10-0-137-191 kubenswrapper[2578]: E0610 20:12:48.474514    2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3\": container with ID starting with 84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3 not found: ID does not exist" containerID="84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3"
Jun 10 20:12:48.474593 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.474556    2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3"} err="failed to get container status \"84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3\": rpc error: code = NotFound desc = could not find container \"84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3\": container with ID starting with 84cccf7e809a501510186a19ea53266c9cc94791f4254d777ece7874f2547cb3 not found: ID does not exist"
Jun 10 20:12:48.485014 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.484991    2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:12:48.488592 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.488570    2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:12:48.509056 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.509020    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:12:48.509439 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.509426    2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak"
Jun 10 20:12:48.509481 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.509441    2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak"
Jun 10 20:12:48.509516 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.509503    2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" containerName="keycloak"
Jun 10 20:12:48.514032 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.514007    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.516540 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.516517    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 10 20:12:48.516680 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.516631    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-mtbnt\""
Jun 10 20:12:48.516747 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.516716    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 10 20:12:48.516791 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.516751    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 10 20:12:48.516888 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.516873    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 10 20:12:48.524010 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.523982    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:12:48.569157 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.569123    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/aeec539d-aa9d-4903-9f5b-6307623118b3-test-realms\") pod \"maas-keycloak-0\" (UID: \"aeec539d-aa9d-4903-9f5b-6307623118b3\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.569334 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.569269    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lt5m9\" (UniqueName: \"kubernetes.io/projected/aeec539d-aa9d-4903-9f5b-6307623118b3-kube-api-access-lt5m9\") pod \"maas-keycloak-0\" (UID: \"aeec539d-aa9d-4903-9f5b-6307623118b3\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.670730 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.670644    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lt5m9\" (UniqueName: \"kubernetes.io/projected/aeec539d-aa9d-4903-9f5b-6307623118b3-kube-api-access-lt5m9\") pod \"maas-keycloak-0\" (UID: \"aeec539d-aa9d-4903-9f5b-6307623118b3\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.670730 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.670700    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/aeec539d-aa9d-4903-9f5b-6307623118b3-test-realms\") pod \"maas-keycloak-0\" (UID: \"aeec539d-aa9d-4903-9f5b-6307623118b3\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.671422 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.671400    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/aeec539d-aa9d-4903-9f5b-6307623118b3-test-realms\") pod \"maas-keycloak-0\" (UID: \"aeec539d-aa9d-4903-9f5b-6307623118b3\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.679298 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.679265    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lt5m9\" (UniqueName: \"kubernetes.io/projected/aeec539d-aa9d-4903-9f5b-6307623118b3-kube-api-access-lt5m9\") pod \"maas-keycloak-0\" (UID: \"aeec539d-aa9d-4903-9f5b-6307623118b3\") " pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.825012 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.824974    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:48.959055 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:48.959034    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 10 20:12:48.961021 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:12:48.960998    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaeec539d_aa9d_4903_9f5b_6307623118b3.slice/crio-b62cc60915123e86295e5a4ad38bd6656f5dc4a2d35497b0ba78cca89af7618e WatchSource:0}: Error finding container b62cc60915123e86295e5a4ad38bd6656f5dc4a2d35497b0ba78cca89af7618e: Status 404 returned error can't find the container with id b62cc60915123e86295e5a4ad38bd6656f5dc4a2d35497b0ba78cca89af7618e
Jun 10 20:12:49.149981 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:49.149952    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:12:49.150792 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:49.150771    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-8559cd5744-pfhx8"
Jun 10 20:12:49.471319 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:49.471195    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aeec539d-aa9d-4903-9f5b-6307623118b3","Type":"ContainerStarted","Data":"25739c51fa1cdde9d3d99ec6dc1ced12d67b226f2fc68a813d0ec8f9943352d2"}
Jun 10 20:12:49.471319 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:49.471249    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aeec539d-aa9d-4903-9f5b-6307623118b3","Type":"ContainerStarted","Data":"b62cc60915123e86295e5a4ad38bd6656f5dc4a2d35497b0ba78cca89af7618e"}
Jun 10 20:12:49.490619 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:49.490524    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.181390701 podStartE2EDuration="1.49050973s" totalImagesPullingTime="309.119029ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:12:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:12:49.488758324 +0000 UTC m=+791.749728100" watchObservedRunningTime="2026-06-10 20:12:49.49050973 +0000 UTC m=+791.751479421"
Jun 10 20:12:49.825829 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:49.825790    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:49.827222 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:49.827186    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:50.165468 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:50.165378    2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4759240-7464-4f42-bcc8-669a61ff427b" path="/var/lib/kubelet/pods/c4759240-7464-4f42-bcc8-669a61ff427b/volumes"
Jun 10 20:12:50.416335 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:50.416254    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-699b6cd6c-67mlx"
Jun 10 20:12:50.416482 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:50.416345    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-579785bc64-hwjb9"
Jun 10 20:12:50.826291 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:50.826242    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:51.825718 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:51.825627    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:52.826133 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:52.826077    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:53.826219 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:53.826164    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:54.826235 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:54.826188    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:55.825840 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:55.825799    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:56.826378 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:56.826329    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:57.826468 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:57.826429    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:58.825695 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:58.825637    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:12:58.826004 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:58.825965    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:12:59.825927 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:12:59.825873    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:13:00.826116 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:00.826068    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:13:01.826066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:01.826015    2578 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.44:9000/health/started\": dial tcp 10.134.0.44:9000: connect: connection refused"
Jun 10 20:13:02.919969 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:02.919928    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:13:02.935206 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:02.935152    2578 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="aeec539d-aa9d-4903-9f5b-6307623118b3" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 10 20:13:12.926064 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:12.926024    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 10 20:13:34.212577 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.212533    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"]
Jun 10 20:13:34.216233 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.216213    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.218925 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.218876    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 10 20:13:34.218925 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.218893    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 10 20:13:34.219906 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.219890    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 10 20:13:34.220018 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.219927    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vb6mh\""
Jun 10 20:13:34.225087 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.225067    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"]
Jun 10 20:13:34.335899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.335829    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81dc8722-872b-4886-86c3-11a277d20df3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.335899 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.335894    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.336185 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.335997    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6j77\" (UniqueName: \"kubernetes.io/projected/81dc8722-872b-4886-86c3-11a277d20df3-kube-api-access-v6j77\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.336185 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.336050    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.336185 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.336116    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.336329 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.336215    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437079 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437038    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81dc8722-872b-4886-86c3-11a277d20df3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437079 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437083    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437332 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437137    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6j77\" (UniqueName: \"kubernetes.io/projected/81dc8722-872b-4886-86c3-11a277d20df3-kube-api-access-v6j77\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437332 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437162    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437332 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437193    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437332 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437231    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437585 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437564    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437655 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437608    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.437720 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.437690    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.439449 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.439431    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/81dc8722-872b-4886-86c3-11a277d20df3-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.439544 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.439528    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/81dc8722-872b-4886-86c3-11a277d20df3-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.444684 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.444661    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6j77\" (UniqueName: \"kubernetes.io/projected/81dc8722-872b-4886-86c3-11a277d20df3-kube-api-access-v6j77\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn\" (UID: \"81dc8722-872b-4886-86c3-11a277d20df3\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.528020 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.527983    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:13:34.662919 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.662891    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"]
Jun 10 20:13:34.666214 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:13:34.666179    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81dc8722_872b_4886_86c3_11a277d20df3.slice/crio-61db2863da0be4e3cb285626b0f4b33f040deccdc1868df199d79425bafbeae4 WatchSource:0}: Error finding container 61db2863da0be4e3cb285626b0f4b33f040deccdc1868df199d79425bafbeae4: Status 404 returned error can't find the container with id 61db2863da0be4e3cb285626b0f4b33f040deccdc1868df199d79425bafbeae4
Jun 10 20:13:34.732925 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:34.732891    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn" event={"ID":"81dc8722-872b-4886-86c3-11a277d20df3","Type":"ContainerStarted","Data":"61db2863da0be4e3cb285626b0f4b33f040deccdc1868df199d79425bafbeae4"}
Jun 10 20:13:39.763701 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:39.763663    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn" event={"ID":"81dc8722-872b-4886-86c3-11a277d20df3","Type":"ContainerStarted","Data":"0a20b139af5a9264d95dc40ecdf631a28cdda32771763cb51d4e3f6009d7f45b"}
Jun 10 20:13:40.916669 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:40.916634    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"]
Jun 10 20:13:40.922006 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:40.921982    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:40.924400 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:40.924374    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 10 20:13:40.931006 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:40.930938    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"]
Jun 10 20:13:41.103253 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.103211    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4ac1d5b-a89e-47b6-8db9-3082fd929645-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.103253 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.103255    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.103468 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.103416    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.103506 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.103460    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.103555 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.103536    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.103590 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.103569    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4ss4j\" (UniqueName: \"kubernetes.io/projected/c4ac1d5b-a89e-47b6-8db9-3082fd929645-kube-api-access-4ss4j\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.204841 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.204748    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.204841 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.204786    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.204841 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.204826    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.204841 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.204844    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4ss4j\" (UniqueName: \"kubernetes.io/projected/c4ac1d5b-a89e-47b6-8db9-3082fd929645-kube-api-access-4ss4j\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.205200 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.204888    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4ac1d5b-a89e-47b6-8db9-3082fd929645-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.205200 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.204909    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.205306 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.205210    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.205306 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.205263    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.205395 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.205321    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.207081 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.207064    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c4ac1d5b-a89e-47b6-8db9-3082fd929645-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.207359 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.207341    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c4ac1d5b-a89e-47b6-8db9-3082fd929645-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.212800 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.212777    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4ss4j\" (UniqueName: \"kubernetes.io/projected/c4ac1d5b-a89e-47b6-8db9-3082fd929645-kube-api-access-4ss4j\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-r82wd\" (UID: \"c4ac1d5b-a89e-47b6-8db9-3082fd929645\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.236332 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.236295    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:41.370066 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.370035    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"]
Jun 10 20:13:41.371623 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:13:41.371594    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4ac1d5b_a89e_47b6_8db9_3082fd929645.slice/crio-37ac4a8def953c9a0d67c286bee577fff4768cadb6008baf2cdaf458e7509807 WatchSource:0}: Error finding container 37ac4a8def953c9a0d67c286bee577fff4768cadb6008baf2cdaf458e7509807: Status 404 returned error can't find the container with id 37ac4a8def953c9a0d67c286bee577fff4768cadb6008baf2cdaf458e7509807
Jun 10 20:13:41.777207 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.777169    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd" event={"ID":"c4ac1d5b-a89e-47b6-8db9-3082fd929645","Type":"ContainerStarted","Data":"c8580e51b4dcc0f5a4e3dc627111c5ed37f7a62994aa265d88b079a0a84f65e4"}
Jun 10 20:13:41.777430 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:41.777236    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd" event={"ID":"c4ac1d5b-a89e-47b6-8db9-3082fd929645","Type":"ContainerStarted","Data":"37ac4a8def953c9a0d67c286bee577fff4768cadb6008baf2cdaf458e7509807"}
Jun 10 20:13:43.789256 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:43.789225    2578 generic.go:356] "Generic (PLEG): container finished" podID="c4ac1d5b-a89e-47b6-8db9-3082fd929645" containerID="c8580e51b4dcc0f5a4e3dc627111c5ed37f7a62994aa265d88b079a0a84f65e4" exitCode=0
Jun 10 20:13:43.789631 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:43.789295    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd" event={"ID":"c4ac1d5b-a89e-47b6-8db9-3082fd929645","Type":"ContainerDied","Data":"c8580e51b4dcc0f5a4e3dc627111c5ed37f7a62994aa265d88b079a0a84f65e4"}
Jun 10 20:13:45.801557 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:45.801523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd" event={"ID":"c4ac1d5b-a89e-47b6-8db9-3082fd929645","Type":"ContainerStarted","Data":"972fa489d5e59fd3193f2da33517bfef8a7fd9580b86e71f28b1053c1cee4b77"}
Jun 10 20:13:45.820130 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:45.820079    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd" podStartSLOduration=3.209194833 podStartE2EDuration="5.820062073s" totalImagesPullingTime="1.235944019s" totalInitContainerRuntime="1.374923221s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:13:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:13:45.817202052 +0000 UTC m=+848.078171743" watchObservedRunningTime="2026-06-10 20:13:45.820062073 +0000 UTC m=+848.081031764"
Jun 10 20:13:51.237213 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:51.237160    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:51.237617 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:51.237235    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:51.249795 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:51.249767    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:13:51.842478 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:13:51.842436    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-r82wd"
Jun 10 20:14:01.418042 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.418001    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"]
Jun 10 20:14:01.433354 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.433315    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"]
Jun 10 20:14:01.433502 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.433423    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.435985 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.435959    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jun 10 20:14:01.496072 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.496036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.496072 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.496072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.496316 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.496090    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78dac9df-796e-48ab-bc9b-f8034df7c8fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.496316 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.496115    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2qxq\" (UniqueName: \"kubernetes.io/projected/78dac9df-796e-48ab-bc9b-f8034df7c8fc-kube-api-access-f2qxq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.496316 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.496228    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.496433 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.496348    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.597442 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.597386    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2qxq\" (UniqueName: \"kubernetes.io/projected/78dac9df-796e-48ab-bc9b-f8034df7c8fc-kube-api-access-f2qxq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.597752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.597484    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.597752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.597588    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.597752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.597646    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.597752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.597686    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.597752 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.597711    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78dac9df-796e-48ab-bc9b-f8034df7c8fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.598584 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.598533    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.598690 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.598562    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.598834 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.598811    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.600503 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.600479    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/78dac9df-796e-48ab-bc9b-f8034df7c8fc-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.600904 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.600883    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78dac9df-796e-48ab-bc9b-f8034df7c8fc-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.606430 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.606403    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2qxq\" (UniqueName: \"kubernetes.io/projected/78dac9df-796e-48ab-bc9b-f8034df7c8fc-kube-api-access-f2qxq\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv\" (UID: \"78dac9df-796e-48ab-bc9b-f8034df7c8fc\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.744799 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.744703    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:01.886341 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:01.886310    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"]
Jun 10 20:14:01.889508 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:14:01.889476    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78dac9df_796e_48ab_bc9b_f8034df7c8fc.slice/crio-6a9d43d6992b4b9a85a21cedad986e026280e8a6b87f64d08955e469e7456053 WatchSource:0}: Error finding container 6a9d43d6992b4b9a85a21cedad986e026280e8a6b87f64d08955e469e7456053: Status 404 returned error can't find the container with id 6a9d43d6992b4b9a85a21cedad986e026280e8a6b87f64d08955e469e7456053
Jun 10 20:14:02.886115 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:02.886077    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv" event={"ID":"78dac9df-796e-48ab-bc9b-f8034df7c8fc","Type":"ContainerStarted","Data":"e4d22a10b47e1ab0d1987afad6664fb335b95e08e7f158a6268ebd17523416a6"}
Jun 10 20:14:02.886566 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:02.886133    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv" event={"ID":"78dac9df-796e-48ab-bc9b-f8034df7c8fc","Type":"ContainerStarted","Data":"6a9d43d6992b4b9a85a21cedad986e026280e8a6b87f64d08955e469e7456053"}
Jun 10 20:14:03.892091 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:03.892058    2578 generic.go:356] "Generic (PLEG): container finished" podID="78dac9df-796e-48ab-bc9b-f8034df7c8fc" containerID="e4d22a10b47e1ab0d1987afad6664fb335b95e08e7f158a6268ebd17523416a6" exitCode=0
Jun 10 20:14:03.892486 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:03.892122    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv" event={"ID":"78dac9df-796e-48ab-bc9b-f8034df7c8fc","Type":"ContainerDied","Data":"e4d22a10b47e1ab0d1987afad6664fb335b95e08e7f158a6268ebd17523416a6"}
Jun 10 20:14:04.898642 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:04.898603    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv" event={"ID":"78dac9df-796e-48ab-bc9b-f8034df7c8fc","Type":"ContainerStarted","Data":"95a040665d9b549fae5f36b685cb94852d9d28f28dc060bd4a40af2e0273d651"}
Jun 10 20:14:04.918975 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:04.918925    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv" podStartSLOduration=2.357365575 podStartE2EDuration="3.918909867s" totalImagesPullingTime="291.475901ms" totalInitContainerRuntime="1.270068391s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:14:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:14:04.917261047 +0000 UTC m=+867.178230763" watchObservedRunningTime="2026-06-10 20:14:04.918909867 +0000 UTC m=+867.179879560"
Jun 10 20:14:11.745578 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:11.745535    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:11.746103 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:11.745617    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:11.758339 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:11.758314    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:11.949145 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:11.949119    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv"
Jun 10 20:14:13.632649 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.632617    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"]
Jun 10 20:14:13.638625 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.638603    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.640893 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.640871    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jun 10 20:14:13.648508 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.648482    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"]
Jun 10 20:14:13.820990 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.820950    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.821190 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.821012    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.821190 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.821036    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.821190 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.821072    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/684c3149-884b-4abd-9092-50ebabef8948-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.821526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.821218    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.821526 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.821261    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkmcr\" (UniqueName: \"kubernetes.io/projected/684c3149-884b-4abd-9092-50ebabef8948-kube-api-access-xkmcr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922484 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922399    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922484 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922443    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkmcr\" (UniqueName: \"kubernetes.io/projected/684c3149-884b-4abd-9092-50ebabef8948-kube-api-access-xkmcr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922689 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922485    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922689 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922546    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922689 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922571    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922689 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922620    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/684c3149-884b-4abd-9092-50ebabef8948-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922953 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922812    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-kserve-provision-location\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922953 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922863    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.922953 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.922916    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.924908 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.924879    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/684c3149-884b-4abd-9092-50ebabef8948-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.925139 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.925122    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/684c3149-884b-4abd-9092-50ebabef8948-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.930426 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.930405    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkmcr\" (UniqueName: \"kubernetes.io/projected/684c3149-884b-4abd-9092-50ebabef8948-kube-api-access-xkmcr\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn\" (UID: \"684c3149-884b-4abd-9092-50ebabef8948\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:13.951449 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:13.951425    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:14:14.087332 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:14.087293    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"]
Jun 10 20:14:14.090409 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:14:14.090380    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod684c3149_884b_4abd_9092_50ebabef8948.slice/crio-4987ed1476fb9718bdb8030c025e81f0bb4db6bfeac43a69ae82da03b5376b1d WatchSource:0}: Error finding container 4987ed1476fb9718bdb8030c025e81f0bb4db6bfeac43a69ae82da03b5376b1d: Status 404 returned error can't find the container with id 4987ed1476fb9718bdb8030c025e81f0bb4db6bfeac43a69ae82da03b5376b1d
Jun 10 20:14:14.954555 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:14.954523    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn" event={"ID":"684c3149-884b-4abd-9092-50ebabef8948","Type":"ContainerStarted","Data":"554ccff82fb8be1576a9930f89e1c9b5bd4e32552a103e9ba96e0c8fa6ffef4d"}
Jun 10 20:14:14.954953 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:14.954578    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn" event={"ID":"684c3149-884b-4abd-9092-50ebabef8948","Type":"ContainerStarted","Data":"4987ed1476fb9718bdb8030c025e81f0bb4db6bfeac43a69ae82da03b5376b1d"}
Jun 10 20:14:22.004077 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.004046    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"]
Jun 10 20:14:22.008865 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.008832    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.011271 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.011249    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jun 10 20:14:22.020245 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.020221    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"]
Jun 10 20:14:22.099555 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.099511    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.099555 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.099553    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.099784 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.099577    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.099784 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.099596    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqsbz\" (UniqueName: \"kubernetes.io/projected/7eb413cb-a961-4f46-bb32-8dc627a13cc5-kube-api-access-qqsbz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.099784 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.099708    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.099784 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.099750    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb413cb-a961-4f46-bb32-8dc627a13cc5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200286 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200250    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200286 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200289    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200515 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200314    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200515 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200440    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqsbz\" (UniqueName: \"kubernetes.io/projected/7eb413cb-a961-4f46-bb32-8dc627a13cc5-kube-api-access-qqsbz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200624 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200607    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200678 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200670    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb413cb-a961-4f46-bb32-8dc627a13cc5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200731 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200696    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200800 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200741    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.200800 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.200783    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.202977 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.202943    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7eb413cb-a961-4f46-bb32-8dc627a13cc5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.203372 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.203346    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7eb413cb-a961-4f46-bb32-8dc627a13cc5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.208177 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.208156    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqsbz\" (UniqueName: \"kubernetes.io/projected/7eb413cb-a961-4f46-bb32-8dc627a13cc5-kube-api-access-qqsbz\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-84947\" (UID: \"7eb413cb-a961-4f46-bb32-8dc627a13cc5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.323218 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.323170    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:22.460745 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.460717    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"]
Jun 10 20:14:22.462603 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:14:22.462566    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7eb413cb_a961_4f46_bb32_8dc627a13cc5.slice/crio-c3b8e769c7f53949e5fbac728809991e9ddeca52b2559b3d1da26b3b6bc120eb WatchSource:0}: Error finding container c3b8e769c7f53949e5fbac728809991e9ddeca52b2559b3d1da26b3b6bc120eb: Status 404 returned error can't find the container with id c3b8e769c7f53949e5fbac728809991e9ddeca52b2559b3d1da26b3b6bc120eb
Jun 10 20:14:22.996301 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.996264    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947" event={"ID":"7eb413cb-a961-4f46-bb32-8dc627a13cc5","Type":"ContainerStarted","Data":"3e45a674bbb10aeb5059937aef996d5e370737653012401732e0b6aa6eca429b"}
Jun 10 20:14:22.996513 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:22.996319    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947" event={"ID":"7eb413cb-a961-4f46-bb32-8dc627a13cc5","Type":"ContainerStarted","Data":"c3b8e769c7f53949e5fbac728809991e9ddeca52b2559b3d1da26b3b6bc120eb"}
Jun 10 20:14:26.012867 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:26.012827    2578 generic.go:356] "Generic (PLEG): container finished" podID="7eb413cb-a961-4f46-bb32-8dc627a13cc5" containerID="3e45a674bbb10aeb5059937aef996d5e370737653012401732e0b6aa6eca429b" exitCode=0
Jun 10 20:14:26.013304 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:26.012903    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947" event={"ID":"7eb413cb-a961-4f46-bb32-8dc627a13cc5","Type":"ContainerDied","Data":"3e45a674bbb10aeb5059937aef996d5e370737653012401732e0b6aa6eca429b"}
Jun 10 20:14:27.019514 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:27.019476    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947" event={"ID":"7eb413cb-a961-4f46-bb32-8dc627a13cc5","Type":"ContainerStarted","Data":"ee505d5294d7a46b8451f2ec347d42693a9f9ddbcc8bb2190b43df83852712f8"}
Jun 10 20:14:27.036750 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:27.036690    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947" podStartSLOduration=2.395418828 podStartE2EDuration="6.036670576s" totalImagesPullingTime="221.122246ms" totalInitContainerRuntime="3.420129502s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:14:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:14:27.035926242 +0000 UTC m=+889.296895934" watchObservedRunningTime="2026-06-10 20:14:27.036670576 +0000 UTC m=+889.297640269"
Jun 10 20:14:32.323372 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:32.323330    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:32.323879 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:32.323403    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:32.336098 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:32.336065    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:33.062366 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:33.062335    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-84947"
Jun 10 20:14:38.197502 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:38.197475    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:14:38.199664 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:14:38.199636    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:15:09.233643 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:09.233561    2578 generic.go:356] "Generic (PLEG): container finished" podID="684c3149-884b-4abd-9092-50ebabef8948" containerID="554ccff82fb8be1576a9930f89e1c9b5bd4e32552a103e9ba96e0c8fa6ffef4d" exitCode=0
Jun 10 20:15:09.233643 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:09.233632    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn" event={"ID":"684c3149-884b-4abd-9092-50ebabef8948","Type":"ContainerDied","Data":"554ccff82fb8be1576a9930f89e1c9b5bd4e32552a103e9ba96e0c8fa6ffef4d"}
Jun 10 20:15:10.240765 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:10.240729    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn" event={"ID":"684c3149-884b-4abd-9092-50ebabef8948","Type":"ContainerStarted","Data":"a331e9f432154f0b5842c0e93c1e2347a9f9c92e8803abbf4a48c6b1d4f262fb"}
Jun 10 20:15:10.259655 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:10.259608    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn" podStartSLOduration=2.249541942 podStartE2EDuration="57.259592612s" totalImagesPullingTime="291.73228ms" totalInitContainerRuntime="54.71831839s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:14:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:15:10.257663236 +0000 UTC m=+932.518632928" watchObservedRunningTime="2026-06-10 20:15:10.259592612 +0000 UTC m=+932.520562303"
Jun 10 20:15:13.951977 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:13.951934    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:15:13.952377 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:13.952094    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:15:13.964456 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:13.964431    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:15:14.271980 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:15:14.271957    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn"
Jun 10 20:16:12.572709 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:12.572675    2578 generic.go:356] "Generic (PLEG): container finished" podID="81dc8722-872b-4886-86c3-11a277d20df3" containerID="0a20b139af5a9264d95dc40ecdf631a28cdda32771763cb51d4e3f6009d7f45b" exitCode=0
Jun 10 20:16:12.573168 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:12.572759    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn" event={"ID":"81dc8722-872b-4886-86c3-11a277d20df3","Type":"ContainerDied","Data":"0a20b139af5a9264d95dc40ecdf631a28cdda32771763cb51d4e3f6009d7f45b"}
Jun 10 20:16:13.579567 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:13.579530    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn" event={"ID":"81dc8722-872b-4886-86c3-11a277d20df3","Type":"ContainerStarted","Data":"98fcf5a538159d8753368c02c3da70da21f463d538e7dfd0725e2eed41f22569"}
Jun 10 20:16:13.597522 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:13.597464    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn" podStartSLOduration=1.6161058640000001 podStartE2EDuration="2m39.597447006s" totalImagesPullingTime="4.378455869s" totalInitContainerRuntime="2m33.602885273s" isStatefulPod=false podCreationTimestamp="2026-06-10 20:13:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:16:13.595926374 +0000 UTC m=+995.856896070" watchObservedRunningTime="2026-06-10 20:16:13.597447006 +0000 UTC m=+995.858416720"
Jun 10 20:16:14.528353 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:14.528320    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:16:14.528525 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:14.528383    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:16:14.540874 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:14.540831    2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:16:14.597328 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:16:14.597299    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn"
Jun 10 20:19:38.233843 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:19:38.233803    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:19:38.236428 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:19:38.236407    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-fz8t6_35d8561b-5c94-4fc5-bea5-a5af2335e26e/ovn-acl-logging/0.log"
Jun 10 20:20:28.249491 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:28.249409    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56984d5999-wksf5_0f5f35f1-8967-4e20-855b-7c26a84b1aa3/nginx/0.log"
Jun 10 20:20:28.630569 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:28.630544    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8449d8b6c8-f6mwx_4e77fff7-16cf-4413-9f72-110fa5d0c9e6/maas-api/0.log"
Jun 10 20:20:28.847015 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:28.846985    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cd5b57c44-bwzqj_c7021d33-917f-473e-b48d-aab74373664d/manager/0.log"
Jun 10 20:20:29.196377 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:29.196341    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-blgbv_2cceb920-8829-4f39-8ef2-f9aefadeeb63/copy-manifests/0.log"
Jun 10 20:20:29.214134 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:29.214104    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-blgbv_2cceb920-8829-4f39-8ef2-f9aefadeeb63/manager/0.log"
Jun 10 20:20:32.306048 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:32.306022    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bq7t6_34a9759c-c914-4f51-b8fa-2f3d7ec018b4/registry-server/0.log"
Jun 10 20:20:32.420378 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:32.420342    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-22th9_62cebc7c-fd16-4d95-b53f-e242bf127bc7/manager/0.log"
Jun 10 20:20:32.634357 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:32.634263    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2j4pw_2d879cb9-2fb7-4f99-b779-a61c0b136b85/manager/0.log"
Jun 10 20:20:32.968929 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:32.968827    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcp64bx_7e00a047-3d7a-4f12-932a-6a96d8af10fd/istio-proxy/0.log"
Jun 10 20:20:33.431411 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:33.431384    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-pfhx8_b678c026-0ece-4565-8ba1-2447db6f18bb/istio-proxy/1.log"
Jun 10 20:20:33.536845 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:33.536804    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hwjb9_cae23cf5-1c1e-413d-8ba2-71cde21b0a7e/payload-pre-processing/0.log"
Jun 10 20:20:33.644058 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:33.644011    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-67mlx_c42beee6-2e7d-4f40-9997-6bcc5378a5ec/payload-processing/0.log"
Jun 10 20:20:34.077076 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.077050    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn_81dc8722-872b-4886-86c3-11a277d20df3/storage-initializer/0.log"
Jun 10 20:20:34.085123 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.085101    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-2rxbn_81dc8722-872b-4886-86c3-11a277d20df3/main/0.log"
Jun 10 20:20:34.189956 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.189925    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-r82wd_c4ac1d5b-a89e-47b6-8db9-3082fd929645/storage-initializer/0.log"
Jun 10 20:20:34.196887 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.196869    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-r82wd_c4ac1d5b-a89e-47b6-8db9-3082fd929645/main/0.log"
Jun 10 20:20:34.307981 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.307942    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv_78dac9df-796e-48ab-bc9b-f8034df7c8fc/storage-initializer/0.log"
Jun 10 20:20:34.316096 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.316069    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4bqzv_78dac9df-796e-48ab-bc9b-f8034df7c8fc/main/0.log"
Jun 10 20:20:34.433384 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.433310    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn_684c3149-884b-4abd-9092-50ebabef8948/main/0.log"
Jun 10 20:20:34.440243 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.440217    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-5b477ct8wrn_684c3149-884b-4abd-9092-50ebabef8948/storage-initializer/0.log"
Jun 10 20:20:34.546501 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.546474    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-84947_7eb413cb-a961-4f46-bb32-8dc627a13cc5/storage-initializer/0.log"
Jun 10 20:20:34.554868 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:34.554823    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-84947_7eb413cb-a961-4f46-bb32-8dc627a13cc5/main/0.log"
Jun 10 20:20:41.344623 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:41.344591    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-kpdmj_a93364a5-e951-4b4d-bb08-cd1d597fc638/global-pull-secret-syncer/0.log"
Jun 10 20:20:41.526549 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:41.526522    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-p26p6_88824c83-fdfd-4848-80f9-21ecefd09afc/konnectivity-agent/0.log"
Jun 10 20:20:41.551367 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:41.551338    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-191.ec2.internal_128321a9fc1dae510aeba8d7ac9882bb/haproxy/0.log"
Jun 10 20:20:47.657313 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:47.657276    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-bq7t6_34a9759c-c914-4f51-b8fa-2f3d7ec018b4/registry-server/0.log"
Jun 10 20:20:47.697841 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:47.697811    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-22th9_62cebc7c-fd16-4d95-b53f-e242bf127bc7/manager/0.log"
Jun 10 20:20:47.778174 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:47.778149    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-2j4pw_2d879cb9-2fb7-4f99-b779-a61c0b136b85/manager/0.log"
Jun 10 20:20:50.066834 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.066802    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5mmnl_8d1541b5-6cb3-45fa-9b9f-15873f5044bd/kube-state-metrics/0.log"
Jun 10 20:20:50.101489 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.101460    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5mmnl_8d1541b5-6cb3-45fa-9b9f-15873f5044bd/kube-rbac-proxy-main/0.log"
Jun 10 20:20:50.137609 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.137579    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-5mmnl_8d1541b5-6cb3-45fa-9b9f-15873f5044bd/kube-rbac-proxy-self/0.log"
Jun 10 20:20:50.211784 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.211753    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-76b68cc874-fsx79_f45e64ec-2cb3-40c6-b2bc-897d8eb6dadb/monitoring-plugin/0.log"
Jun 10 20:20:50.379319 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.379244    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8g7bd_e04bb9f4-e510-4788-94dd-9a6ab854e108/node-exporter/0.log"
Jun 10 20:20:50.422300 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.422274    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8g7bd_e04bb9f4-e510-4788-94dd-9a6ab854e108/kube-rbac-proxy/0.log"
Jun 10 20:20:50.483045 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.483022    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8g7bd_e04bb9f4-e510-4788-94dd-9a6ab854e108/init-textfile/0.log"
Jun 10 20:20:50.799143 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.799114    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_103f5324-9a35-4326-ba59-aa451f7f0bc1/prometheus/0.log"
Jun 10 20:20:50.840256 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.840235    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_103f5324-9a35-4326-ba59-aa451f7f0bc1/config-reloader/0.log"
Jun 10 20:20:50.882561 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.882538    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_103f5324-9a35-4326-ba59-aa451f7f0bc1/thanos-sidecar/0.log"
Jun 10 20:20:50.932036 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.932003    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_103f5324-9a35-4326-ba59-aa451f7f0bc1/kube-rbac-proxy-web/0.log"
Jun 10 20:20:50.963588 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:50.963558    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_103f5324-9a35-4326-ba59-aa451f7f0bc1/kube-rbac-proxy/0.log"
Jun 10 20:20:51.006944 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.006917    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_103f5324-9a35-4326-ba59-aa451f7f0bc1/kube-rbac-proxy-thanos/0.log"
Jun 10 20:20:51.056679 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.056617    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_103f5324-9a35-4326-ba59-aa451f7f0bc1/init-config-reloader/0.log"
Jun 10 20:20:51.109274 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.109250    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xvbpz_406112be-ecc8-4930-a00b-b99e1b0e873e/prometheus-operator/0.log"
Jun 10 20:20:51.152315 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.152297    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-xvbpz_406112be-ecc8-4930-a00b-b99e1b0e873e/kube-rbac-proxy/0.log"
Jun 10 20:20:51.267703 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.267676    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b6cc6968c-6bzfd_be9bc895-d40c-4f95-ad6a-1d019469b8ee/telemeter-client/0.log"
Jun 10 20:20:51.325248 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.325174    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b6cc6968c-6bzfd_be9bc895-d40c-4f95-ad6a-1d019469b8ee/reload/0.log"
Jun 10 20:20:51.376771 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.376746    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b6cc6968c-6bzfd_be9bc895-d40c-4f95-ad6a-1d019469b8ee/kube-rbac-proxy/0.log"
Jun 10 20:20:51.440590 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.440565    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc996d8d5-d52rh_6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe/thanos-query/0.log"
Jun 10 20:20:51.503959 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.503934    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc996d8d5-d52rh_6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe/kube-rbac-proxy-web/0.log"
Jun 10 20:20:51.572759 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.572740    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc996d8d5-d52rh_6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe/kube-rbac-proxy/0.log"
Jun 10 20:20:51.609649 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.609582    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc996d8d5-d52rh_6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe/prom-label-proxy/0.log"
Jun 10 20:20:51.665487 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.665470    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc996d8d5-d52rh_6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe/kube-rbac-proxy-rules/0.log"
Jun 10 20:20:51.756000 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.755970    2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"]
Jun 10 20:20:51.759729 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.759711    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.763064 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.763041    2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wpjn6\"/\"default-dockercfg-x97tc\""
Jun 10 20:20:51.763383 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.763361    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpjn6\"/\"openshift-service-ca.crt\""
Jun 10 20:20:51.763545 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.763528    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-5cc996d8d5-d52rh_6b29a40f-cb2b-4e69-a4b0-c6ab26ecdafe/kube-rbac-proxy-metrics/0.log"
Jun 10 20:20:51.764071 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.764052    2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wpjn6\"/\"kube-root-ca.crt\""
Jun 10 20:20:51.785412 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.785392    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-proc\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.785497 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.785478    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r6sn\" (UniqueName: \"kubernetes.io/projected/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-kube-api-access-9r6sn\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.785538 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.785503    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-podres\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.785573 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.785541    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-lib-modules\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.785573 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.785568    2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-sys\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.797502 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.797476    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"]
Jun 10 20:20:51.886967 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.886882    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-lib-modules\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.886967 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.886937    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-sys\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.887177 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.886981    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-proc\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.887177 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.887052    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-lib-modules\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.887177 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.887067    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-sys\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.887177 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.887131    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-proc\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.887177 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.887139    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r6sn\" (UniqueName: \"kubernetes.io/projected/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-kube-api-access-9r6sn\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.887177 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.887164    2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-podres\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.887395 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.887269    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-podres\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:51.899110 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:51.899082    2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r6sn\" (UniqueName: \"kubernetes.io/projected/a3f08af5-653c-40af-bb9b-7e3a2ad89ff7-kube-api-access-9r6sn\") pod \"perf-node-gather-daemonset-ltmwx\" (UID: \"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7\") " pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:52.069298 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:52.069273    2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:52.223482 ip-10-0-137-191 kubenswrapper[2578]: W0610 20:20:52.223446    2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-poda3f08af5_653c_40af_bb9b_7e3a2ad89ff7.slice/crio-ba6beea9eb0a291219018a95c6c200d09773dd2fcccf904736a5543724a27917 WatchSource:0}: Error finding container ba6beea9eb0a291219018a95c6c200d09773dd2fcccf904736a5543724a27917: Status 404 returned error can't find the container with id ba6beea9eb0a291219018a95c6c200d09773dd2fcccf904736a5543724a27917
Jun 10 20:20:52.224298 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:52.224206    2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"]
Jun 10 20:20:53.021112 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:53.021077    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx" event={"ID":"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7","Type":"ContainerStarted","Data":"6d7c9eef57c44646fcef4892e27298b433e76894df6f48faade4d3dcd21a924b"}
Jun 10 20:20:53.021320 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:53.021126    2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx" event={"ID":"a3f08af5-653c-40af-bb9b-7e3a2ad89ff7","Type":"ContainerStarted","Data":"ba6beea9eb0a291219018a95c6c200d09773dd2fcccf904736a5543724a27917"}
Jun 10 20:20:53.021320 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:53.021203    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:53.046590 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:53.046548    2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx" podStartSLOduration=2.04653492 podStartE2EDuration="2.04653492s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-10 20:20:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-10 20:20:53.045975353 +0000 UTC m=+1275.306945044" watchObservedRunningTime="2026-06-10 20:20:53.04653492 +0000 UTC m=+1275.307504612"
Jun 10 20:20:55.784125 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:55.784094    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvwvn_1d6bf961-4890-45a4-9703-9f6afad50e86/dns/0.log"
Jun 10 20:20:55.810825 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:55.810801    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-hvwvn_1d6bf961-4890-45a4-9703-9f6afad50e86/kube-rbac-proxy/0.log"
Jun 10 20:20:55.893521 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:55.893495    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-44nqh_93721cdf-fcd3-43ab-9905-44589865da03/dns-node-resolver/0.log"
Jun 10 20:20:56.591895 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:56.591867    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jv5hf_b64c09dc-1acf-458e-896b-19525dc2d3db/node-ca/0.log"
Jun 10 20:20:57.594764 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:57.594736    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcp64bx_7e00a047-3d7a-4f12-932a-6a96d8af10fd/istio-proxy/0.log"
Jun 10 20:20:57.756582 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:57.756554    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-pfhx8_b678c026-0ece-4565-8ba1-2447db6f18bb/istio-proxy/1.log"
Jun 10 20:20:57.756824 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:57.756806    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-pfhx8_b678c026-0ece-4565-8ba1-2447db6f18bb/istio-proxy/0.log"
Jun 10 20:20:57.777514 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:57.777491    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hwjb9_cae23cf5-1c1e-413d-8ba2-71cde21b0a7e/payload-pre-processing/0.log"
Jun 10 20:20:57.802798 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:57.802774    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-67mlx_c42beee6-2e7d-4f40-9997-6bcc5378a5ec/payload-processing/0.log"
Jun 10 20:20:58.482335 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:58.482306    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mlp2j_eb1ff4e1-c35f-4c37-a044-53198f153956/serve-healthcheck-canary/0.log"
Jun 10 20:20:59.036742 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:59.036717    2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wpjn6/perf-node-gather-daemonset-ltmwx"
Jun 10 20:20:59.140808 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:59.140781    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57mwl_2dd4d927-a461-45c8-ac0e-239cc295107a/kube-rbac-proxy/0.log"
Jun 10 20:20:59.163435 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:59.163406    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57mwl_2dd4d927-a461-45c8-ac0e-239cc295107a/exporter/0.log"
Jun 10 20:20:59.186360 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:20:59.186339    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-57mwl_2dd4d927-a461-45c8-ac0e-239cc295107a/extractor/0.log"
Jun 10 20:21:01.764264 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:01.764180    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-56984d5999-wksf5_0f5f35f1-8967-4e20-855b-7c26a84b1aa3/nginx/0.log"
Jun 10 20:21:01.872780 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:01.872753    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-8449d8b6c8-f6mwx_4e77fff7-16cf-4413-9f72-110fa5d0c9e6/maas-api/0.log"
Jun 10 20:21:01.946661 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:01.946628    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6cd5b57c44-bwzqj_c7021d33-917f-473e-b48d-aab74373664d/manager/0.log"
Jun 10 20:21:02.085875 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:02.085824    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-blgbv_2cceb920-8829-4f39-8ef2-f9aefadeeb63/manager/0.log"
Jun 10 20:21:02.113778 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:02.113749    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-74b5876657-blgbv_2cceb920-8829-4f39-8ef2-f9aefadeeb63/copy-manifests/0.log"
Jun 10 20:21:04.029501 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:04.029459    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7db946db8b-wgthj_3fd6542c-2120-46da-aeb7-bf2c1b8cf970/manager/0.log"
Jun 10 20:21:04.059470 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:04.059441    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xjr88_66882691-5c43-43cb-9636-29a4c327ab51/openshift-lws-operator/0.log"
Jun 10 20:21:06.678268 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:06.678238    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcp64bx_7e00a047-3d7a-4f12-932a-6a96d8af10fd/istio-proxy/0.log"
Jun 10 20:21:06.783691 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:06.783657    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-pfhx8_b678c026-0ece-4565-8ba1-2447db6f18bb/istio-proxy/1.log"
Jun 10 20:21:06.783947 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:06.783931    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-pfhx8_b678c026-0ece-4565-8ba1-2447db6f18bb/istio-proxy/0.log"
Jun 10 20:21:06.793668 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:06.793649    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hwjb9_cae23cf5-1c1e-413d-8ba2-71cde21b0a7e/payload-pre-processing/0.log"
Jun 10 20:21:06.810619 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:06.810598    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-67mlx_c42beee6-2e7d-4f40-9997-6bcc5378a5ec/payload-processing/0.log"
Jun 10 20:21:07.984707 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:07.984632    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-5b556588bcp64bx_7e00a047-3d7a-4f12-932a-6a96d8af10fd/istio-proxy/0.log"
Jun 10 20:21:08.093955 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:08.093925    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-pfhx8_b678c026-0ece-4565-8ba1-2447db6f18bb/istio-proxy/1.log"
Jun 10 20:21:08.094382 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:08.094365    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-8559cd5744-pfhx8_b678c026-0ece-4565-8ba1-2447db6f18bb/istio-proxy/0.log"
Jun 10 20:21:08.105550 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:08.105529    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-579785bc64-hwjb9_cae23cf5-1c1e-413d-8ba2-71cde21b0a7e/payload-pre-processing/0.log"
Jun 10 20:21:08.125124 ip-10-0-137-191 kubenswrapper[2578]: I0610 20:21:08.125105    2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-699b6cd6c-67mlx_c42beee6-2e7d-4f40-9997-6bcc5378a5ec/payload-processing/0.log"