Jun 03 14:45:24.364421 ip-10-0-140-251 systemd[1]: Starting Kubernetes Kubelet...
Jun 03 14:45:24.787516 ip-10-0-140-251 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 14:45:24.787516 ip-10-0-140-251 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 03 14:45:24.787516 ip-10-0-140-251 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 14:45:24.787516 ip-10-0-140-251 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 03 14:45:24.787516 ip-10-0-140-251 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 03 14:45:24.789894 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.789796    2576 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 03 14:45:24.792632 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792611    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 14:45:24.792632 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792627    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 14:45:24.792632 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792632    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 14:45:24.792632 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792636    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792640    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792644    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792648    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792652    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792656    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792659    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792663    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792667    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792670    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792674    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792690    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792697    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792701    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792705    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792710    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792714    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792718    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792723    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792726    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 14:45:24.792853 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792730    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792734    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792739    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792743    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792747    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792753    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792757    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792763    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792770    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792774    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792778    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792782    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792786    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792791    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792796    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792800    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792805    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792809    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792813    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 14:45:24.793713 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792817    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792821    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792825    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792830    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792834    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792839    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792843    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792847    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792851    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792855    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792859    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792863    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792867    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792872    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792876    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792880    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792884    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792890    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792894    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792898    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 14:45:24.794408 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792902    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792907    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792911    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792914    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792918    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792923    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792928    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792933    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792939    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792943    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792948    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792952    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792955    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792960    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792964    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792969    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792973    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792977    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792981    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792988    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 14:45:24.795021 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792992    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.792996    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793000    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793004    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793656    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793666    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793671    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793677    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793682    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793687    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793691    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793695    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793699    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793704    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793708    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793712    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793716    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793720    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793725    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793729    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 14:45:24.795597 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793734    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793738    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793742    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793746    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793750    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793755    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793759    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793763    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793767    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793771    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793775    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793779    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793784    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793788    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793792    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793796    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793801    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793806    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793810    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793814    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 14:45:24.796109 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793818    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793822    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793826    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793832    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793838    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793845    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793853    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793858    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793863    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793868    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793872    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793877    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793881    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793886    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793891    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793895    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793898    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793902    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793906    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 14:45:24.796646 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793911    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793915    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793919    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793923    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793929    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793933    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793937    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793941    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793945    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793950    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793954    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793958    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793962    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793967    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793971    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793975    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793979    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793983    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793987    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793991    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 14:45:24.797106 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793995    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.793999    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794003    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794007    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794011    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794015    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794019    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794024    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794028    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794033    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.794037    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794725    2576 flags.go:64] FLAG: --address="0.0.0.0"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794739    2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794750    2576 flags.go:64] FLAG: --anonymous-auth="true"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794756    2576 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794763    2576 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794768    2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794775    2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794782    2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794788    2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794793    2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 03 14:45:24.797613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794799    2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794805    2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794810    2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794815    2576 flags.go:64] FLAG: --cgroup-root=""
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794820    2576 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794825    2576 flags.go:64] FLAG: --client-ca-file=""
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794830    2576 flags.go:64] FLAG: --cloud-config=""
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794835    2576 flags.go:64] FLAG: --cloud-provider="external"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794840    2576 flags.go:64] FLAG: --cluster-dns="[]"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794848    2576 flags.go:64] FLAG: --cluster-domain=""
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794853    2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794859    2576 flags.go:64] FLAG: --config-dir=""
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794863    2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794869    2576 flags.go:64] FLAG: --container-log-max-files="5"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794876    2576 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794881    2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794886    2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794892    2576 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794896    2576 flags.go:64] FLAG: --contention-profiling="false"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794902    2576 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794908    2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794913    2576 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794919    2576 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794925    2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794930    2576 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 03 14:45:24.798122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794935    2576 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794940    2576 flags.go:64] FLAG: --enable-load-reader="false"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794945    2576 flags.go:64] FLAG: --enable-server="true"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794950    2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794957    2576 flags.go:64] FLAG: --event-burst="100"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794962    2576 flags.go:64] FLAG: --event-qps="50"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794967    2576 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794973    2576 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794978    2576 flags.go:64] FLAG: --eviction-hard=""
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794984    2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794990    2576 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.794995    2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795000    2576 flags.go:64] FLAG: --eviction-soft=""
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795005    2576 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795009    2576 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795014    2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795019    2576 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795024    2576 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795028    2576 flags.go:64] FLAG: --fail-swap-on="true"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795033    2576 flags.go:64] FLAG: --feature-gates=""
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795039    2576 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795044    2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795049    2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795055    2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795060    2576 flags.go:64] FLAG: --healthz-port="10248"
Jun 03 14:45:24.798732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795065    2576 flags.go:64] FLAG: --help="false"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795070    2576 flags.go:64] FLAG: --hostname-override="ip-10-0-140-251.ec2.internal"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795076    2576 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795081    2576 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795086    2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795092    2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795098    2576 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795104    2576 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795108    2576 flags.go:64] FLAG: --image-service-endpoint=""
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795113    2576 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795118    2576 flags.go:64] FLAG: --kube-api-burst="100"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795145    2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795151    2576 flags.go:64] FLAG: --kube-api-qps="50"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795157    2576 flags.go:64] FLAG: --kube-reserved=""
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795162    2576 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795167    2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795188    2576 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795213    2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795219    2576 flags.go:64] FLAG: --lock-file=""
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795223    2576 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795227    2576 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795231    2576 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795239    2576 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 03 14:45:24.799357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795243    2576 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795246    2576 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795249    2576 flags.go:64] FLAG: --logging-format="text"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795252    2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795255    2576 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795258    2576 flags.go:64] FLAG: --manifest-url=""
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795262    2576 flags.go:64] FLAG: --manifest-url-header=""
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795267    2576 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795270    2576 flags.go:64] FLAG: --max-open-files="1000000"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795275    2576 flags.go:64] FLAG: --max-pods="110"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795279    2576 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795282    2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795285    2576 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795288    2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795291    2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795294    2576 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795297    2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795307    2576 flags.go:64] FLAG: --node-status-max-images="50"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795310    2576 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795314    2576 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795317    2576 flags.go:64] FLAG: --pod-cidr=""
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795320    2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795326    2576 flags.go:64] FLAG: --pod-manifest-path=""
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795329    2576 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 03 14:45:24.800000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795333    2576 flags.go:64] FLAG: --pods-per-core="0"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795336    2576 flags.go:64] FLAG: --port="10250"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795339    2576 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795343    2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-034c4b07da09750ce"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795347    2576 flags.go:64] FLAG: --qos-reserved=""
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795351    2576 flags.go:64] FLAG: --read-only-port="10255"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795354    2576 flags.go:64] FLAG: --register-node="true"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795357    2576 flags.go:64] FLAG: --register-schedulable="true"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795360    2576 flags.go:64] FLAG: --register-with-taints=""
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795363    2576 flags.go:64] FLAG: --registry-burst="10"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795366    2576 flags.go:64] FLAG: --registry-qps="5"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795369    2576 flags.go:64] FLAG: --reserved-cpus=""
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795373    2576 flags.go:64] FLAG: --reserved-memory=""
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795377    2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795380    2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795383    2576 flags.go:64] FLAG: --rotate-certificates="false"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795386    2576 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795389    2576 flags.go:64] FLAG: --runonce="false"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795392    2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795395    2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795403    2576 flags.go:64] FLAG: --seccomp-default="false"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795407    2576 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795410    2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795413    2576 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795416    2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795419    2576 flags.go:64] FLAG: --storage-driver-password="root"
Jun 03 14:45:24.800588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795422    2576 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795425    2576 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795428    2576 flags.go:64] FLAG: --storage-driver-user="root"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795431    2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795434    2576 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795438    2576 flags.go:64] FLAG: --system-cgroups=""
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795441    2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795449    2576 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795452    2576 flags.go:64] FLAG: --tls-cert-file=""
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795455    2576 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795461    2576 flags.go:64] FLAG: --tls-min-version=""
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795464    2576 flags.go:64] FLAG: --tls-private-key-file=""
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795467    2576 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795470    2576 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795473    2576 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795476    2576 flags.go:64] FLAG: --v="2"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795481    2576 flags.go:64] FLAG: --version="false"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795484    2576 flags.go:64] FLAG: --vmodule=""
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795489    2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.795492    2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795598    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795602    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795606    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795609    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 14:45:24.801224 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795612    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795615    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795618    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795620    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795623    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795625    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795628    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795630    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795633    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795636    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795638    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795641    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795644    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795647    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795649    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795652    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795655    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795658    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795660    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 14:45:24.801791 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795663    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795666    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795669    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795671    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795674    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795676    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795679    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795681    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795684    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795687    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795689    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795692    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795694    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795697    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795699    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795702    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795705    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795707    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795710    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795713    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 14:45:24.802296 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795715    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795718    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795721    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795723    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795725    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795729    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795731    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795733    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795737    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795739    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795742    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795744    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795747    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795750    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795752    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795754    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795757    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795759    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795762    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795764    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 14:45:24.802838 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795766    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795769    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795771    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795774    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795776    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795780    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795784    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795787    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795790    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795792    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795795    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795797    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795800    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795803    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795806    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795808    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795811    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795813    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795818    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 14:45:24.803348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795821    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795824    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795827    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.795830    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.797057    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.803516    2576 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.803630    2576 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803679    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803684    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803688    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803691    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803694    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803697    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803699    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803703    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803705    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 14:45:24.803864 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803708    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803710    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803713    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803715    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803718    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803721    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803724    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803726    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803729    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803731    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803734    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803737    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803741    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803745    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803748    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803751    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803753    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803756    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803758    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803761    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 14:45:24.804285 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803764    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803766    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803770    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803773    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803776    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803778    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803781    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803785    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803789    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803792    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803795    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803798    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803800    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803803    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803805    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803808    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803810    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803813    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803815    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 14:45:24.804774 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803818    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803820    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803823    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803825    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803828    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803830    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803833    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803835    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803838    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803840    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803843    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803846    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803848    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803851    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803853    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803857    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803860    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803863    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803866    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 14:45:24.805348 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803868    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803871    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803874    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803877    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803880    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803882    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803885    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803887    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803890    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803892    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803895    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803897    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803900    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803902    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803905    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803908    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803910    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803913    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 14:45:24.805813 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.803915    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.803920    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804016    2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804021    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804024    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804027    2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804030    2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804033    2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804037    2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804040    2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804043    2576 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804047    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804050    2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804053    2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804056    2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 03 14:45:24.806265 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804058    2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804061    2576 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804063    2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804066    2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804068    2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804071    2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804073    2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804076    2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804078    2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804081    2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804083    2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804086    2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804088    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804090    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804093    2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804095    2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804098    2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804100    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804103    2576 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 03 14:45:24.806634 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804105    2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804108    2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804110    2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804112    2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804115    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804117    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804120    2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804123    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804140    2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804145    2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804149    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804153    2576 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804155    2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804158    2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804161    2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804163    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804166    2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804169    2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804171    2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804174    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 03 14:45:24.807096 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804176    2576 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804178    2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804181    2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804184    2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804186    2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804189    2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804191    2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804194    2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804197    2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804200    2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804202    2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804205    2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804207    2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804210    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804212    2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804214    2576 feature_gate.go:328] unrecognized feature gate: Example2
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804217    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804220    2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804222    2576 feature_gate.go:328] unrecognized feature gate: Example
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804225    2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 03 14:45:24.807643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804228    2576 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804230    2576 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804233    2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804235    2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804238    2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804241    2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804243    2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804246    2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804248    2576 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804251    2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804253    2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804255    2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804258    2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:24.804261    2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.804266    2576 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 03 14:45:24.808147 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.804952    2576 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 03 14:45:24.808528 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.807123    2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 03 14:45:24.808528 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.808026    2576 server.go:1019] "Starting client certificate rotation"
Jun 03 14:45:24.808528 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.808119    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 14:45:24.808725 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.808714    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 03 14:45:24.832415 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.832396    2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 14:45:24.837746 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.837724    2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 03 14:45:24.847662 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.847644    2576 log.go:25] "Validated CRI v1 runtime API"
Jun 03 14:45:24.854886 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.854867    2576 log.go:25] "Validated CRI v1 image API"
Jun 03 14:45:24.857828 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.857810    2576 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 03 14:45:24.862350 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.862330    2576 fs.go:135] Filesystem UUIDs: map[6a3811df-68a8-44cb-a05b-1fc2e2783436:/dev/nvme0n1p4 78f7e2bc-a2d1-43ba-b751-d3bbed5ad18f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2]
Jun 03 14:45:24.862417 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.862350    2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 03 14:45:24.865274 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.865257    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 14:45:24.866681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.866573    2576 manager.go:217] Machine: {Timestamp:2026-06-03 14:45:24.866048898 +0000 UTC m=+0.382841945 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3102637 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2df7ffc32b7172050ee2b2a62efe44 SystemUUID:ec2df7ff-c32b-7172-050e-e2b2a62efe44 BootID:63875b77-06a4-494d-b1b4-a43e2c22a572 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:97:13:d4:dd:e1 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:97:13:d4:dd:e1 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:6e:12:67:25:5d:c4 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 03 14:45:24.868164 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.868152    2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 03 14:45:24.868303 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.868289    2576 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 03 14:45:24.869984 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.869961    2576 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 03 14:45:24.870171 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.869988    2576 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-251.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 03 14:45:24.870259 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.870186    2576 topology_manager.go:138] "Creating topology manager with none policy"
Jun 03 14:45:24.870259 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.870198    2576 container_manager_linux.go:306] "Creating device plugin manager"
Jun 03 14:45:24.870259 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.870208    2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 14:45:24.870915 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.870904    2576 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 03 14:45:24.872354 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.872340    2576 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 14:45:24.872504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.872493    2576 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 03 14:45:24.875379 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.875367    2576 kubelet.go:491] "Attempting to sync node with API server"
Jun 03 14:45:24.875444 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.875388    2576 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 03 14:45:24.875444 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.875417    2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 03 14:45:24.875444 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.875434    2576 kubelet.go:397] "Adding apiserver pod source"
Jun 03 14:45:24.875569 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.875446    2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 03 14:45:24.876575 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.876561    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 14:45:24.876664 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.876584    2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 03 14:45:24.880382 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.880365    2576 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 03 14:45:24.882610 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.882596    2576 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 03 14:45:24.887652 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887632    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887660    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887670    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887679    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887692    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887701    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887711    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887725    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 03 14:45:24.887740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887736    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 03 14:45:24.888053 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887780    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 03 14:45:24.888053 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887808    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 03 14:45:24.888053 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.887818    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 03 14:45:24.888712 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.888698    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 03 14:45:24.888753 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.888749    2576 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 03 14:45:24.891948 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.891929    2576 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 03 14:45:24.892043 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.891983    2576 server.go:1295] "Started kubelet"
Jun 03 14:45:24.892266 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.892227    2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 03 14:45:24.892397 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.892361    2576 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 03 14:45:24.892441 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.892412    2576 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 03 14:45:24.892691 ip-10-0-140-251 systemd[1]: Started Kubernetes Kubelet.
Jun 03 14:45:24.892819 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.892789    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 03 14:45:24.892819 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.892794    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 03 14:45:24.893342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.893163    2576 server.go:317] "Adding debug handlers to kubelet server"
Jun 03 14:45:24.893701 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.893691    2576 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 03 14:45:24.901010 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.900989    2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 03 14:45:24.901100 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.900989    2576 csi_plugin.go:988] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-251.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jun 03 14:45:24.901558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.901542    2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 03 14:45:24.901731 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.901712    2576 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 03 14:45:24.901731 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.901729    2576 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 03 14:45:24.901885 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.901850    2576 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 03 14:45:24.901940 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.901929    2576 reconstruct.go:97] "Volume reconstruction finished"
Jun 03 14:45:24.901974 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.901941    2576 reconciler.go:26] "Reconciler: start to sync state"
Jun 03 14:45:24.902008 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.901072    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-251.ec2.internal.18b5996de0813275  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-251.ec2.internal,UID:ip-10-0-140-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-251.ec2.internal,},FirstTimestamp:2026-06-03 14:45:24.891947637 +0000 UTC m=+0.408740684,LastTimestamp:2026-06-03 14:45:24.891947637 +0000 UTC m=+0.408740684,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-251.ec2.internal,}"
Jun 03 14:45:24.902237 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.902220    2576 factory.go:55] Registering systemd factory
Jun 03 14:45:24.902307 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.902240    2576 factory.go:223] Registration of the systemd container factory successfully
Jun 03 14:45:24.902464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.902450    2576 factory.go:153] Registering CRI-O factory
Jun 03 14:45:24.902464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.902463    2576 factory.go:223] Registration of the crio container factory successfully
Jun 03 14:45:24.902558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.902510    2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 03 14:45:24.902558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.902528    2576 factory.go:103] Registering Raw factory
Jun 03 14:45:24.902558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.902541    2576 manager.go:1196] Started watching for new ooms in manager
Jun 03 14:45:24.902634 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.902557    2576 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 03 14:45:24.902980 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.902960    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:24.903976 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.903957    2576 manager.go:319] Starting recovery of all containers
Jun 03 14:45:24.908524 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.908495    2576 reflector.go:200] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jun 03 14:45:24.908647 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.908597    2576 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-251.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jun 03 14:45:24.914772 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.914751    2576 manager.go:324] Recovery completed
Jun 03 14:45:24.920238 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.920221    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 14:45:24.922310 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.922295    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 14:45:24.922367 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.922324    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 14:45:24.922367 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.922337    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientPID"
Jun 03 14:45:24.922863 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.922848    2576 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 03 14:45:24.922863 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.922861    2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 03 14:45:24.922961 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.922876    2576 state_mem.go:36] "Initialized new in-memory state store"
Jun 03 14:45:24.924851 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.924783    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-251.ec2.internal.18b5996de25082e8  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-251.ec2.internal,UID:ip-10-0-140-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-251.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-251.ec2.internal,},FirstTimestamp:2026-06-03 14:45:24.9223114 +0000 UTC m=+0.439104446,LastTimestamp:2026-06-03 14:45:24.9223114 +0000 UTC m=+0.439104446,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-251.ec2.internal,}"
Jun 03 14:45:24.925244 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.925231    2576 policy_none.go:49] "None policy: Start"
Jun 03 14:45:24.925284 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.925248    2576 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 03 14:45:24.925284 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.925260    2576 state_mem.go:35] "Initializing new in-memory state store"
Jun 03 14:45:24.939201 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.939120    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-251.ec2.internal.18b5996de250d31a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-251.ec2.internal,UID:ip-10-0-140-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-251.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-251.ec2.internal,},FirstTimestamp:2026-06-03 14:45:24.92233193 +0000 UTC m=+0.439124975,LastTimestamp:2026-06-03 14:45:24.92233193 +0000 UTC m=+0.439124975,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-251.ec2.internal,}"
Jun 03 14:45:24.942303 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.942275    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ktc9"
Jun 03 14:45:24.948597 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.948535    2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-251.ec2.internal.18b5996de250f670  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-251.ec2.internal,UID:ip-10-0-140-251.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-251.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-251.ec2.internal,},FirstTimestamp:2026-06-03 14:45:24.922340976 +0000 UTC m=+0.439134022,LastTimestamp:2026-06-03 14:45:24.922340976 +0000 UTC m=+0.439134022,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-251.ec2.internal,}"
Jun 03 14:45:24.953072 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.953057    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7ktc9"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.958646    2576 manager.go:341] "Starting Device Plugin manager"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.958677    2576 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.958688    2576 server.go:85] "Starting device plugin registration server"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.958909    2576 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.958919    2576 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.959026    2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.959101    2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:24.959110    2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.959825    2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 03 14:45:24.969189 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:24.959862    2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.037101 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.037059    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 03 14:45:25.038326 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.038282    2576 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 03 14:45:25.038326 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.038303    2576 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 03 14:45:25.038326 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.038321    2576 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 03 14:45:25.038326 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.038328    2576 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 03 14:45:25.038521 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.038424    2576 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 03 14:45:25.043544 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.043526    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 14:45:25.059470 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.059452    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 14:45:25.062779 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.062764    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 14:45:25.062870 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.062792    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 14:45:25.062870 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.062808    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientPID"
Jun 03 14:45:25.062870 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.062835    2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.091908 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.091884    2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.091991 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.091911    2576 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-251.ec2.internal\": node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.121658 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.121633    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.139007 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.138974    2576 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal"]
Jun 03 14:45:25.139061 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.139050    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 14:45:25.139983 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.139967    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 14:45:25.140065 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.139995    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 14:45:25.140065 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.140026    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientPID"
Jun 03 14:45:25.141336 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.141324    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 14:45:25.141528 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.141502    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.141574 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.141532    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 14:45:25.142057 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.142043    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 14:45:25.142116 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.142068    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 14:45:25.142116 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.142076    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientPID"
Jun 03 14:45:25.142568 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.142551    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 14:45:25.142648 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.142582    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 14:45:25.142648 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.142594    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientPID"
Jun 03 14:45:25.143850 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.143832    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.143946 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.143856    2576 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 03 14:45:25.144502 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.144485    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientMemory"
Jun 03 14:45:25.144585 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.144516    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasNoDiskPressure"
Jun 03 14:45:25.144585 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.144531    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeHasSufficientPID"
Jun 03 14:45:25.164682 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.164655    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-251.ec2.internal\" not found" node="ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.168955 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.168938    2576 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-251.ec2.internal\" not found" node="ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.203465 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.203428    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a180eda1c8d6820e570160c8b827bfae-config\") pod \"kube-apiserver-proxy-ip-10-0-140-251.ec2.internal\" (UID: \"a180eda1c8d6820e570160c8b827bfae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.203465 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.203467    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0f687a6ea858d2a61b6b9cf50cd635e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal\" (UID: \"a0f687a6ea858d2a61b6b9cf50cd635e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.203603 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.203485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f687a6ea858d2a61b6b9cf50cd635e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal\" (UID: \"a0f687a6ea858d2a61b6b9cf50cd635e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.221954 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.221927    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.304372 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.304311    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a180eda1c8d6820e570160c8b827bfae-config\") pod \"kube-apiserver-proxy-ip-10-0-140-251.ec2.internal\" (UID: \"a180eda1c8d6820e570160c8b827bfae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.304372 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.304344    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0f687a6ea858d2a61b6b9cf50cd635e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal\" (UID: \"a0f687a6ea858d2a61b6b9cf50cd635e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.304372 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.304363    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f687a6ea858d2a61b6b9cf50cd635e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal\" (UID: \"a0f687a6ea858d2a61b6b9cf50cd635e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.304494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.304406    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/a0f687a6ea858d2a61b6b9cf50cd635e-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal\" (UID: \"a0f687a6ea858d2a61b6b9cf50cd635e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.304494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.304413    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a180eda1c8d6820e570160c8b827bfae-config\") pod \"kube-apiserver-proxy-ip-10-0-140-251.ec2.internal\" (UID: \"a180eda1c8d6820e570160c8b827bfae\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.304494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.304445    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f687a6ea858d2a61b6b9cf50cd635e-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal\" (UID: \"a0f687a6ea858d2a61b6b9cf50cd635e\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.322450 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.322407    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.423221 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.423181    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.467364 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.467338    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.472177 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.472160    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:25.524104 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.524068    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.624669 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.624600    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.725088 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.725056    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.807494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.807468    2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 03 14:45:25.808103 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.807614    2576 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 03 14:45:25.825612 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.825589    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.867521 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.867504    2576 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 14:45:25.901773 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.901716    2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 03 14:45:25.918357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.918338    2576 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 03 14:45:25.926486 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:25.926469    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:25.951245 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.951226    2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfvk8"
Jun 03 14:45:25.955351 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.955330    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-02 14:40:24 +0000 UTC" deadline="2028-02-25 08:45:02.49382059 +0000 UTC"
Jun 03 14:45:25.955351 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.955351    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15161h59m36.538472076s"
Jun 03 14:45:25.961595 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:25.961580    2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-wfvk8"
Jun 03 14:45:26.026729 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:26.026701    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:26.126969 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:26.126940    2576 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-140-251.ec2.internal\" not found"
Jun 03 14:45:26.157097 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:26.157041    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda180eda1c8d6820e570160c8b827bfae.slice/crio-ae85b5637aa6a230472216eeea0678b1b8fcf6477516a76fdbe5328516c9e3f5 WatchSource:0}: Error finding container ae85b5637aa6a230472216eeea0678b1b8fcf6477516a76fdbe5328516c9e3f5: Status 404 returned error can't find the container with id ae85b5637aa6a230472216eeea0678b1b8fcf6477516a76fdbe5328516c9e3f5
Jun 03 14:45:26.161076 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.161060    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 14:45:26.198629 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.198603    2576 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 14:45:26.202799 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.202782    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:26.217408 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.217387    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 14:45:26.218917 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.218904    2576 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal"
Jun 03 14:45:26.228710 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.228688    2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 03 14:45:26.400833 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.400802    2576 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 14:45:26.673922 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:26.673666    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f687a6ea858d2a61b6b9cf50cd635e.slice/crio-45ddc9b6dc3eeed650035f13eefa180943eed98daab01d2af8560d413d880152 WatchSource:0}: Error finding container 45ddc9b6dc3eeed650035f13eefa180943eed98daab01d2af8560d413d880152: Status 404 returned error can't find the container with id 45ddc9b6dc3eeed650035f13eefa180943eed98daab01d2af8560d413d880152
Jun 03 14:45:26.877315 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.877289    2576 apiserver.go:52] "Watching apiserver"
Jun 03 14:45:26.883780 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.883758    2576 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 03 14:45:26.884195 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.884159    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-4l555","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2","openshift-cluster-node-tuning-operator/tuned-5lgwl","openshift-multus/multus-additional-cni-plugins-6dq4s","openshift-multus/network-metrics-daemon-fbcfw","openshift-network-diagnostics/network-check-target-mkzqd","openshift-network-operator/iptables-alerter-n4k87","openshift-ovn-kubernetes/ovnkube-node-cq5p2","kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal","openshift-image-registry/node-ca-5hlrw","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal","openshift-multus/multus-q262g"]
Jun 03 14:45:26.885714 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.885689    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:26.887022 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.886940    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.888201 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.888184    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.889375 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.889354    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.890209 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.890189    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 03 14:45:26.890741 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.890498    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:26.890741 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.890582    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 03 14:45:26.890741 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:26.890572    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:26.890741 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.890672    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-j2g44\""
Jun 03 14:45:26.891724 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.891706    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:26.891827 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:26.891798    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:26.892975 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.892955    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:26.893993 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.893347    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c9bmz\""
Jun 03 14:45:26.893993 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.893385    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 03 14:45:26.894421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894188    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 03 14:45:26.894421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894191    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 03 14:45:26.894421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894297    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 03 14:45:26.894421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894377    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 03 14:45:26.894421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894398    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 03 14:45:26.894711 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894591    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 03 14:45:26.894711 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894600    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 03 14:45:26.894811 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894721    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 03 14:45:26.894811 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894790    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-lslw4\""
Jun 03 14:45:26.894904 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.894837    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 03 14:45:26.896262 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.896035    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.896262 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.896121    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:26.897534 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.897514    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.898404 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.898387    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-qvkxf\""
Jun 03 14:45:26.898756 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.898592    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-zvsmg\""
Jun 03 14:45:26.898756 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.898649    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 03 14:45:26.898756 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.898671    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 03 14:45:26.898929 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.898833    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 03 14:45:26.901704 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.901554    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 03 14:45:26.902312 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.902283    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 03 14:45:26.902397 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.902285    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 03 14:45:26.902516 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.902497    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 03 14:45:26.902691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.902675    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 03 14:45:26.902985 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.902823    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 03 14:45:26.903050 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.902989    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 03 14:45:26.904263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.903171    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-hwk4p\""
Jun 03 14:45:26.904263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.903267    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-hxnm8\""
Jun 03 14:45:26.904263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.903437    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 03 14:45:26.904263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.903700    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 03 14:45:26.904263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.903907    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 03 14:45:26.904263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.904141    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8nlhn\""
Jun 03 14:45:26.904785 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.904363    2576 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 03 14:45:26.912393 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-os-release\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.912489 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912405    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-systemd-units\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.912489 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912430    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.912489 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.912489 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-run-netns\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.912681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912506    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-host\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:26.912681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912530    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-os-release\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.912681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912554    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d92e960e-554c-4498-85ae-aedaa0302260-cni-binary-copy\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.912681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912575    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-hostroot\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.912681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912596    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-multus-certs\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.912681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912617    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-kubernetes\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.912681 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-k8s-cni-cncf-io\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912695    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912727    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-systemd\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-var-lib-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912779    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-socket-dir-parent\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c4f17c2-dd14-4da6-bea0-66889dc222bc-iptables-alerter-script\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912842    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twb58\" (UniqueName: \"kubernetes.io/projected/e3c4a1d9-2454-4993-baf2-ed584ccd7248-kube-api-access-twb58\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-sys\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-cni-netd\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912947    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-device-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.912976    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e7c299b-0053-41d8-8065-a1743a1e50e1-tmp\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.913000 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913027    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-slash\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913056    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-ovn\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovn-node-metrics-cert\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913114    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-cni-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-cnibin\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913174    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-kubelet\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d92e960e-554c-4498-85ae-aedaa0302260-multus-daemon-config\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913219    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-socket-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913252    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-cni-bin\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913286    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-systemd\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913317    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-var-lib-kubelet\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913342    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vbxpp\" (UniqueName: \"kubernetes.io/projected/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-kube-api-access-vbxpp\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913366    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-etc-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-env-overrides\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913413    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-system-cni-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.913542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4p42\" (UniqueName: \"kubernetes.io/projected/8c4f17c2-dd14-4da6-bea0-66889dc222bc-kube-api-access-t4p42\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913459    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913480    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-registration-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-sys-fs\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913537    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-host\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913569    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-cni-bin\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913637    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b26d486-14a9-4e91-b44f-fc82d1cb39d7-konnectivity-ca\") pod \"konnectivity-agent-4l555\" (UID: \"5b26d486-14a9-4e91-b44f-fc82d1cb39d7\") " pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913710    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-modprobe-d\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913743    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/2e7c299b-0053-41d8-8065-a1743a1e50e1-kube-api-access-hzklm\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913766    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cnibin\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913790    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovnkube-script-lib\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7q4w\" (UniqueName: \"kubernetes.io/projected/d92e960e-554c-4498-85ae-aedaa0302260-kube-api-access-j7q4w\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913862    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913886    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rhvgf\" (UniqueName: \"kubernetes.io/projected/6c806192-8385-493c-acc6-b3dfa7ca4ef4-kube-api-access-rhvgf\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:26.914292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913908    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysctl-d\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913928    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysctl-conf\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.913968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914008    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-serviceca\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-conf-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914076    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-system-cni-dir\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914147    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rvpkq\" (UniqueName: \"kubernetes.io/projected/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-kube-api-access-rvpkq\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-run\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914192    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-tuned\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914214    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b26d486-14a9-4e91-b44f-fc82d1cb39d7-agent-certs\") pod \"konnectivity-agent-4l555\" (UID: \"5b26d486-14a9-4e91-b44f-fc82d1cb39d7\") " pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-node-log\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914272    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-log-socket\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914300    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r5hd4\" (UniqueName: \"kubernetes.io/projected/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-kube-api-access-r5hd4\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914325    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-netns\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914347    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-cni-multus\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914368    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-etc-kubernetes\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:26.915009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914385    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-lib-modules\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.915800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914404    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-kubelet\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.915800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.915800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914433    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovnkube-config\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:26.915800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914451    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c4f17c2-dd14-4da6-bea0-66889dc222bc-host-slash\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:26.915800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.914485    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysconfig\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:26.963781 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.963753    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:40:25 +0000 UTC" deadline="2028-03-14 01:22:57.496386316 +0000 UTC"
Jun 03 14:45:26.963781 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:26.963778    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15586h37m30.532610114s"
Jun 03 14:45:27.014907 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.014872    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-cni-netd\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.014919    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-device-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.014933    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-cni-netd\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.014946    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e7c299b-0053-41d8-8065-a1743a1e50e1-tmp\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.014969    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.014992    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-slash\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015000    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-device-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015015    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-ovn\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015033    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-slash\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015038    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovn-node-metrics-cert\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015060    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-ovn\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015057    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-etc-selinux\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.015078 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015060    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-cni-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015111    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-cnibin\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-cni-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015154    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-kubelet\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015180    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d92e960e-554c-4498-85ae-aedaa0302260-multus-daemon-config\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015194    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-cnibin\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015214    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-socket-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015234    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-kubelet\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015236    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-cni-bin\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015268    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-cni-bin\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015270    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-systemd\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015300    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-var-lib-kubelet\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015307    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-systemd\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015332    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vbxpp\" (UniqueName: \"kubernetes.io/projected/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-kube-api-access-vbxpp\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015341    2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015357    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-etc-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015380    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-env-overrides\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015411    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-system-cni-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.015685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015425    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-socket-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015436    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t4p42\" (UniqueName: \"kubernetes.io/projected/8c4f17c2-dd14-4da6-bea0-66889dc222bc-kube-api-access-t4p42\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015474    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-etc-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015504    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015534    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-registration-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015561    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-sys-fs\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015586    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-host\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015611    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015636    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-cni-bin\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015655    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-kubelet-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015662    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b26d486-14a9-4e91-b44f-fc82d1cb39d7-konnectivity-ca\") pod \"konnectivity-agent-4l555\" (UID: \"5b26d486-14a9-4e91-b44f-fc82d1cb39d7\") " pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015689    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-modprobe-d\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015713    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/2e7c299b-0053-41d8-8065-a1743a1e50e1-kube-api-access-hzklm\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-var-lib-kubelet\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015741    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cnibin\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015770    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015808    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovnkube-script-lib\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.016545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015792    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/d92e960e-554c-4498-85ae-aedaa0302260-multus-daemon-config\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015834    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-j7q4w\" (UniqueName: \"kubernetes.io/projected/d92e960e-554c-4498-85ae-aedaa0302260-kube-api-access-j7q4w\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015859    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015885    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rhvgf\" (UniqueName: \"kubernetes.io/projected/6c806192-8385-493c-acc6-b3dfa7ca4ef4-kube-api-access-rhvgf\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015899    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-system-cni-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015910    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysctl-d\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015938    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysctl-conf\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015962    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015969    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-sys-fs\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.015987    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-serviceca\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016011    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-host\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016013    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-conf-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016041    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-system-cni-dir\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016047    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cnibin\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016068    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016094    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rvpkq\" (UniqueName: \"kubernetes.io/projected/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-kube-api-access-rvpkq\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016120    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-run\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.017342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016152    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-env-overrides\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016161    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-tuned\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016189    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b26d486-14a9-4e91-b44f-fc82d1cb39d7-agent-certs\") pod \"konnectivity-agent-4l555\" (UID: \"5b26d486-14a9-4e91-b44f-fc82d1cb39d7\") " pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016214    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-node-log\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016218    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016248    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-log-socket\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016292    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-r5hd4\" (UniqueName: \"kubernetes.io/projected/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-kube-api-access-r5hd4\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016317    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-netns\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016343    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-cni-multus\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016370    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-etc-kubernetes\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016389    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovnkube-script-lib\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016393    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-lib-modules\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016443    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-kubelet\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.016503    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016505    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-lib-modules\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016516    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016527    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.018098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016542    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovnkube-config\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.016571    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:27.516542448 +0000 UTC m=+3.033335504 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016587    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-run-ovn-kubernetes\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016627    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-cni-bin\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016829    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysctl-d\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016879    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/e3c4a1d9-2454-4993-baf2-ed584ccd7248-registration-dir\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016919    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-serviceca\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016978    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-conf-dir\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.016996    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysctl-conf\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017024    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-system-cni-dir\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017154    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/5b26d486-14a9-4e91-b44f-fc82d1cb39d7-konnectivity-ca\") pod \"konnectivity-agent-4l555\" (UID: \"5b26d486-14a9-4e91-b44f-fc82d1cb39d7\") " pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017223    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovnkube-config\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017275    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-modprobe-d\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017299    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-kubelet\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017300    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c4f17c2-dd14-4da6-bea0-66889dc222bc-host-slash\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017349    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysconfig\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017388    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-os-release\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.018876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017466    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-var-lib-cni-multus\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017502    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-systemd-units\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017526    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-etc-kubernetes\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017320    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017555    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017574    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-netns\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017349    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-log-socket\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017587    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017655    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-run\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8c4f17c2-dd14-4da6-bea0-66889dc222bc-host-slash\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017730    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-sysconfig\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017739    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-tuning-conf-dir\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017755    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-run-netns\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017874    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-os-release\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017955    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-host\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.017980    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-os-release\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018003    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d92e960e-554c-4498-85ae-aedaa0302260-cni-binary-copy\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018025    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-hostroot\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.019964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018050    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-multus-certs\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018117    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-kubernetes\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018156    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-k8s-cni-cncf-io\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018181    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018207    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-systemd\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018229    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-var-lib-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018252    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-socket-dir-parent\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018285    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c4f17c2-dd14-4da6-bea0-66889dc222bc-iptables-alerter-script\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018318    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-os-release\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018348    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twb58\" (UniqueName: \"kubernetes.io/projected/e3c4a1d9-2454-4993-baf2-ed584ccd7248-kube-api-access-twb58\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018410    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-multus-certs\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018443    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-host-run-netns\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018620    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-kubernetes\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018680    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-node-log\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-systemd-units\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-host\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018842    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/8c4f17c2-dd14-4da6-bea0-66889dc222bc-iptables-alerter-script\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:27.020728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018893    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-cni-binary-copy\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018936    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-host-run-k8s-cni-cncf-io\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.018980    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-sys\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.019055    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/2e7c299b-0053-41d8-8065-a1743a1e50e1-sys\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.019120    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-multus-socket-dir-parent\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.019182    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-run-systemd\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.019205    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-var-lib-openvswitch\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.019216    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.019254    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/d92e960e-554c-4498-85ae-aedaa0302260-hostroot\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.019304    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/d92e960e-554c-4498-85ae-aedaa0302260-cni-binary-copy\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.020936    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/2e7c299b-0053-41d8-8065-a1743a1e50e1-etc-tuned\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.021017    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-ovn-node-metrics-cert\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.021087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/2e7c299b-0053-41d8-8065-a1743a1e50e1-tmp\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.021433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.021175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/5b26d486-14a9-4e91-b44f-fc82d1cb39d7-agent-certs\") pod \"konnectivity-agent-4l555\" (UID: \"5b26d486-14a9-4e91-b44f-fc82d1cb39d7\") " pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:27.034919 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.034891    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vbxpp\" (UniqueName: \"kubernetes.io/projected/42ce5c30-ac13-4c63-ad41-b67cac79c6bb-kube-api-access-vbxpp\") pod \"multus-additional-cni-plugins-6dq4s\" (UID: \"42ce5c30-ac13-4c63-ad41-b67cac79c6bb\") " pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.035218 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.035194    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4p42\" (UniqueName: \"kubernetes.io/projected/8c4f17c2-dd14-4da6-bea0-66889dc222bc-kube-api-access-t4p42\") pod \"iptables-alerter-n4k87\" (UID: \"8c4f17c2-dd14-4da6-bea0-66889dc222bc\") " pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:27.035978 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.035956    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzklm\" (UniqueName: \"kubernetes.io/projected/2e7c299b-0053-41d8-8065-a1743a1e50e1-kube-api-access-hzklm\") pod \"tuned-5lgwl\" (UID: \"2e7c299b-0053-41d8-8065-a1743a1e50e1\") " pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.037583 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.037561    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rhvgf\" (UniqueName: \"kubernetes.io/projected/6c806192-8385-493c-acc6-b3dfa7ca4ef4-kube-api-access-rhvgf\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:27.038518 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.038492    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7q4w\" (UniqueName: \"kubernetes.io/projected/d92e960e-554c-4498-85ae-aedaa0302260-kube-api-access-j7q4w\") pod \"multus-q262g\" (UID: \"d92e960e-554c-4498-85ae-aedaa0302260\") " pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.042792 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.042767    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 14:45:27.042899 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.042800    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 14:45:27.042899 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.042814    2576 projected.go:194] Error preparing data for projected volume kube-api-access-b8xvk for pod openshift-network-diagnostics/network-check-target-mkzqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:27.043091 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.042949    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk podName:ad4e12bf-ab2f-4223-b004-8cb8e248d3a4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:27.542870094 +0000 UTC m=+3.059663143 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-b8xvk" (UniqueName: "kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk") pod "network-check-target-mkzqd" (UID: "ad4e12bf-ab2f-4223-b004-8cb8e248d3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:27.044702 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.044676    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r5hd4\" (UniqueName: \"kubernetes.io/projected/3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60-kube-api-access-r5hd4\") pod \"ovnkube-node-cq5p2\" (UID: \"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60\") " pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.045252 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.045233    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twb58\" (UniqueName: \"kubernetes.io/projected/e3c4a1d9-2454-4993-baf2-ed584ccd7248-kube-api-access-twb58\") pod \"aws-ebs-csi-driver-node-7nvv2\" (UID: \"e3c4a1d9-2454-4993-baf2-ed584ccd7248\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.045341 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.045222    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal" event={"ID":"a0f687a6ea858d2a61b6b9cf50cd635e","Type":"ContainerStarted","Data":"45ddc9b6dc3eeed650035f13eefa180943eed98daab01d2af8560d413d880152"}
Jun 03 14:45:27.046177 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.046156    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal" event={"ID":"a180eda1c8d6820e570160c8b827bfae","Type":"ContainerStarted","Data":"ae85b5637aa6a230472216eeea0678b1b8fcf6477516a76fdbe5328516c9e3f5"}
Jun 03 14:45:27.046692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.046671    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rvpkq\" (UniqueName: \"kubernetes.io/projected/d5aee60d-1fc5-49d9-b7e3-88955abb0a3f-kube-api-access-rvpkq\") pod \"node-ca-5hlrw\" (UID: \"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f\") " pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:27.119093 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.119060    2576 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 03 14:45:27.197899 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.197871    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:27.206763 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.206741    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2"
Jun 03 14:45:27.215320 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.215298    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-5lgwl"
Jun 03 14:45:27.220892 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.220873    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-6dq4s"
Jun 03 14:45:27.228420 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.228398    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-n4k87"
Jun 03 14:45:27.234921 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.234902    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:27.239969 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.239951    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-5hlrw"
Jun 03 14:45:27.245284 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.245265    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-q262g"
Jun 03 14:45:27.411578 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.411553    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5b26d486_14a9_4e91_b44f_fc82d1cb39d7.slice/crio-112c45b1784ddb999a47b0910e971b68b7b7c3a08a9f8635359ad120d2d5e248 WatchSource:0}: Error finding container 112c45b1784ddb999a47b0910e971b68b7b7c3a08a9f8635359ad120d2d5e248: Status 404 returned error can't find the container with id 112c45b1784ddb999a47b0910e971b68b7b7c3a08a9f8635359ad120d2d5e248
Jun 03 14:45:27.413032 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.413004    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5aee60d_1fc5_49d9_b7e3_88955abb0a3f.slice/crio-e6437a1ddc7ccd2c65cc9bd5dd93de65085daf3b3d8c9d02c3568b781497d47f WatchSource:0}: Error finding container e6437a1ddc7ccd2c65cc9bd5dd93de65085daf3b3d8c9d02c3568b781497d47f: Status 404 returned error can't find the container with id e6437a1ddc7ccd2c65cc9bd5dd93de65085daf3b3d8c9d02c3568b781497d47f
Jun 03 14:45:27.413834 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.413812    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e7c299b_0053_41d8_8065_a1743a1e50e1.slice/crio-9599dda0c8fd3bec9685f5baa9ac77131ab818cec29b3d5f11866420e133920d WatchSource:0}: Error finding container 9599dda0c8fd3bec9685f5baa9ac77131ab818cec29b3d5f11866420e133920d: Status 404 returned error can't find the container with id 9599dda0c8fd3bec9685f5baa9ac77131ab818cec29b3d5f11866420e133920d
Jun 03 14:45:27.415954 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.415892    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3c4a1d9_2454_4993_baf2_ed584ccd7248.slice/crio-8fceab811fd7e3906df57a98257e3641889a919dab9f9f03a6b83182991d86fe WatchSource:0}: Error finding container 8fceab811fd7e3906df57a98257e3641889a919dab9f9f03a6b83182991d86fe: Status 404 returned error can't find the container with id 8fceab811fd7e3906df57a98257e3641889a919dab9f9f03a6b83182991d86fe
Jun 03 14:45:27.418442 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.418415    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42ce5c30_ac13_4c63_ad41_b67cac79c6bb.slice/crio-4f6ae520729bd601cd65cb67052f994f8fafd8a5975e98d1841d159478be2eb7 WatchSource:0}: Error finding container 4f6ae520729bd601cd65cb67052f994f8fafd8a5975e98d1841d159478be2eb7: Status 404 returned error can't find the container with id 4f6ae520729bd601cd65cb67052f994f8fafd8a5975e98d1841d159478be2eb7
Jun 03 14:45:27.419307 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.419287    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92e960e_554c_4498_85ae_aedaa0302260.slice/crio-f5642238621f9212261c337d48633089dc2127af0a7fa11a788c155dc01d8670 WatchSource:0}: Error finding container f5642238621f9212261c337d48633089dc2127af0a7fa11a788c155dc01d8670: Status 404 returned error can't find the container with id f5642238621f9212261c337d48633089dc2127af0a7fa11a788c155dc01d8670
Jun 03 14:45:27.420406 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.420380    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ae7b1b0_8f72_4b0c_8a04_e812b3bb9a60.slice/crio-8a865affa35bb95374ce718df67cf9c76c162f7e626412bb8d8f42e8a69c8cfb WatchSource:0}: Error finding container 8a865affa35bb95374ce718df67cf9c76c162f7e626412bb8d8f42e8a69c8cfb: Status 404 returned error can't find the container with id 8a865affa35bb95374ce718df67cf9c76c162f7e626412bb8d8f42e8a69c8cfb
Jun 03 14:45:27.421190 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:45:27.421161    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c4f17c2_dd14_4da6_bea0_66889dc222bc.slice/crio-4d21695b25c56d47dacf8fba24c2338b5b72790246e50f9e7a0bf678da209122 WatchSource:0}: Error finding container 4d21695b25c56d47dacf8fba24c2338b5b72790246e50f9e7a0bf678da209122: Status 404 returned error can't find the container with id 4d21695b25c56d47dacf8fba24c2338b5b72790246e50f9e7a0bf678da209122
Jun 03 14:45:27.522295 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.522261    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:27.522417 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.522380    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:27.522466 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.522425    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:28.522412379 +0000 UTC m=+4.039205412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:27.623522 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.623487    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:27.623686 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.623655    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 14:45:27.623686 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.623675    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 14:45:27.623686 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.623685    2576 projected.go:194] Error preparing data for projected volume kube-api-access-b8xvk for pod openshift-network-diagnostics/network-check-target-mkzqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:27.623795 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:27.623744    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk podName:ad4e12bf-ab2f-4223-b004-8cb8e248d3a4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:28.623726034 +0000 UTC m=+4.140519069 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8xvk" (UniqueName: "kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk") pod "network-check-target-mkzqd" (UID: "ad4e12bf-ab2f-4223-b004-8cb8e248d3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:27.964199 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.964158    2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-02 14:40:25 +0000 UTC" deadline="2028-01-14 18:31:10.82780331 +0000 UTC"
Jun 03 14:45:27.964199 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:27.964196    2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14163h45m42.863610433s"
Jun 03 14:45:28.052914 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.052835    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5lgwl" event={"ID":"2e7c299b-0053-41d8-8065-a1743a1e50e1","Type":"ContainerStarted","Data":"9599dda0c8fd3bec9685f5baa9ac77131ab818cec29b3d5f11866420e133920d"}
Jun 03 14:45:28.055833 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.055785    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5hlrw" event={"ID":"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f","Type":"ContainerStarted","Data":"e6437a1ddc7ccd2c65cc9bd5dd93de65085daf3b3d8c9d02c3568b781497d47f"}
Jun 03 14:45:28.059029 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.058990    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal" event={"ID":"a180eda1c8d6820e570160c8b827bfae","Type":"ContainerStarted","Data":"2d2a61e29fac8169335138b7508951e293107d452170eabcf170d755e0f5529a"}
Jun 03 14:45:28.061539 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.061475    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4k87" event={"ID":"8c4f17c2-dd14-4da6-bea0-66889dc222bc","Type":"ContainerStarted","Data":"4d21695b25c56d47dacf8fba24c2338b5b72790246e50f9e7a0bf678da209122"}
Jun 03 14:45:28.064245 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.064222    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2" event={"ID":"e3c4a1d9-2454-4993-baf2-ed584ccd7248","Type":"ContainerStarted","Data":"8fceab811fd7e3906df57a98257e3641889a919dab9f9f03a6b83182991d86fe"}
Jun 03 14:45:28.075141 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.075104    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4l555" event={"ID":"5b26d486-14a9-4e91-b44f-fc82d1cb39d7","Type":"ContainerStarted","Data":"112c45b1784ddb999a47b0910e971b68b7b7c3a08a9f8635359ad120d2d5e248"}
Jun 03 14:45:28.077504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.077428    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q262g" event={"ID":"d92e960e-554c-4498-85ae-aedaa0302260","Type":"ContainerStarted","Data":"f5642238621f9212261c337d48633089dc2127af0a7fa11a788c155dc01d8670"}
Jun 03 14:45:28.079560 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.079538    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"8a865affa35bb95374ce718df67cf9c76c162f7e626412bb8d8f42e8a69c8cfb"}
Jun 03 14:45:28.084163 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.084139    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerStarted","Data":"4f6ae520729bd601cd65cb67052f994f8fafd8a5975e98d1841d159478be2eb7"}
Jun 03 14:45:28.103981 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.103933    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-251.ec2.internal" podStartSLOduration=2.103917471 podStartE2EDuration="2.103917471s" podCreationTimestamp="2026-06-03 14:45:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:45:28.103291314 +0000 UTC m=+3.620084369" watchObservedRunningTime="2026-06-03 14:45:28.103917471 +0000 UTC m=+3.620710530"
Jun 03 14:45:28.124084 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.124057    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-ppnw2"]
Jun 03 14:45:28.125906 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.125888    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.129334 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.129310    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 03 14:45:28.129494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.129474    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-96mh2\""
Jun 03 14:45:28.132298 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.132279    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 03 14:45:28.227413 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.227077    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-tmp-dir\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.227413 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.227138    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pm2gg\" (UniqueName: \"kubernetes.io/projected/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-kube-api-access-pm2gg\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.227413 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.227196    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-hosts-file\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.327788 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.327731    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-pm2gg\" (UniqueName: \"kubernetes.io/projected/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-kube-api-access-pm2gg\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.327964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.327809    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-hosts-file\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.327964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.327868    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-tmp-dir\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.328263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.328242    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-tmp-dir\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.328623 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.328600    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-hosts-file\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.361713 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.361679    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pm2gg\" (UniqueName: \"kubernetes.io/projected/2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524-kube-api-access-pm2gg\") pod \"node-resolver-ppnw2\" (UID: \"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524\") " pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.438326 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.438290    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ppnw2"
Jun 03 14:45:28.529832 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.529219    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:28.529832 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:28.529427    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:28.529832 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:28.529490    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:30.529471137 +0000 UTC m=+6.046264174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:28.629664 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:28.629629    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:28.629828 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:28.629801    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 14:45:28.629828 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:28.629821    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 14:45:28.629956 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:28.629833    2576 projected.go:194] Error preparing data for projected volume kube-api-access-b8xvk for pod openshift-network-diagnostics/network-check-target-mkzqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:28.629956 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:28.629891    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk podName:ad4e12bf-ab2f-4223-b004-8cb8e248d3a4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:30.629872473 +0000 UTC m=+6.146665521 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8xvk" (UniqueName: "kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk") pod "network-check-target-mkzqd" (UID: "ad4e12bf-ab2f-4223-b004-8cb8e248d3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:29.047763 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:29.047729    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:29.048190 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:29.047854    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:29.048313 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:29.048293    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:29.048423 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:29.048405    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:29.098265 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:29.097978    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ppnw2" event={"ID":"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524","Type":"ContainerStarted","Data":"dbed626c86852c0e6bb6476d65d97c00662e39c7c1044f3f7b3970446dda60e8"}
Jun 03 14:45:30.547145 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:30.547100    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:30.547606 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:30.547264    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:30.547606 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:30.547335    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:34.547315587 +0000 UTC m=+10.064108637 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:30.647520 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:30.647487    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:30.647729 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:30.647708    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 14:45:30.647818 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:30.647734    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 14:45:30.647818 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:30.647747    2576 projected.go:194] Error preparing data for projected volume kube-api-access-b8xvk for pod openshift-network-diagnostics/network-check-target-mkzqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:30.647818 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:30.647805    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk podName:ad4e12bf-ab2f-4223-b004-8cb8e248d3a4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:34.647786502 +0000 UTC m=+10.164579549 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8xvk" (UniqueName: "kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk") pod "network-check-target-mkzqd" (UID: "ad4e12bf-ab2f-4223-b004-8cb8e248d3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:31.043991 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:31.043493    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:31.043991 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:31.043621    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:31.044368 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:31.044016    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:31.044368 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:31.044098    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:33.039423 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:33.039386    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:33.039821 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:33.039399    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:33.039821 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:33.039503    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:33.039821 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:33.039569    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:34.582760 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:34.582717    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:34.583245 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:34.582884    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:34.583245 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:34.582972    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:42.582946747 +0000 UTC m=+18.099739783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:34.683475 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:34.683433    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:34.683650 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:34.683612    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 14:45:34.683650 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:34.683635    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 14:45:34.683650 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:34.683647    2576 projected.go:194] Error preparing data for projected volume kube-api-access-b8xvk for pod openshift-network-diagnostics/network-check-target-mkzqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:34.683815 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:34.683722    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk podName:ad4e12bf-ab2f-4223-b004-8cb8e248d3a4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:42.683700696 +0000 UTC m=+18.200493748 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8xvk" (UniqueName: "kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk") pod "network-check-target-mkzqd" (UID: "ad4e12bf-ab2f-4223-b004-8cb8e248d3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:35.041559 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:35.041525    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:35.041737 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:35.041532    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:35.041737 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:35.041636    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:35.041737 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:35.041714    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:37.038800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:37.038759    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:37.039279 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:37.038903    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:37.039279 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:37.038959    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:37.039279 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:37.039183    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:39.039204 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:39.039157    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:39.039667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:39.039218    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:39.039667 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:39.039296    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:39.039667 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:39.039437    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:41.039273 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:41.039248    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:41.039661 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:41.039349    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:41.039661 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:41.039375    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:41.039661 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:41.039427    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:42.637593 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:42.637551    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:42.638064 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:42.637690    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:42.638064 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:42.637775    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:58.63775438 +0000 UTC m=+34.154547420 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:42.737888 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:42.737850    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:42.738081 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:42.738037    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 14:45:42.738081 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:42.738061    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 14:45:42.738081 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:42.738073    2576 projected.go:194] Error preparing data for projected volume kube-api-access-b8xvk for pod openshift-network-diagnostics/network-check-target-mkzqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:42.738246 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:42.738156    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk podName:ad4e12bf-ab2f-4223-b004-8cb8e248d3a4 nodeName:}" failed. No retries permitted until 2026-06-03 14:45:58.738121169 +0000 UTC m=+34.254914216 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8xvk" (UniqueName: "kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk") pod "network-check-target-mkzqd" (UID: "ad4e12bf-ab2f-4223-b004-8cb8e248d3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:43.038859 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:43.038814    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:43.039049 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:43.038952    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:43.039049 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:43.039007    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:43.039188 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:43.039138    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:45.040062 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:45.040021    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:45.040676 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:45.040153    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:45.040676 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:45.040199    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:45.040676 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:45.040308    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:46.125919 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:46.125688    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-5lgwl" event={"ID":"2e7c299b-0053-41d8-8065-a1743a1e50e1","Type":"ContainerStarted","Data":"6ea689b70fbd98369c262fb891cb47646b94e4b0f7fd31071338640ee1ebbb24"}
Jun 03 14:45:46.126956 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:46.126932    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-q262g" event={"ID":"d92e960e-554c-4498-85ae-aedaa0302260","Type":"ContainerStarted","Data":"90c1f8f373213690b1ffef5dd1f7441c80a41c7fa1c3bb680d2cbe5f20a0ea60"}
Jun 03 14:45:46.128784 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:46.128763    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"9b0fbb71fec43bf30ffeef1e5c792c96a26bc9881cbf184c199608556657d4e6"}
Jun 03 14:45:46.128862 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:46.128792    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"1290d06463c2cf1d3e484074714fdc65562d59f8c2506ab4a2ac3ee1945c1d7a"}
Jun 03 14:45:46.150791 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:46.150732    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-5lgwl" podStartSLOduration=2.86017248 podStartE2EDuration="21.150711587s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.416205507 +0000 UTC m=+2.932998540" lastFinishedPulling="2026-06-03 14:45:45.706744599 +0000 UTC m=+21.223537647" observedRunningTime="2026-06-03 14:45:46.150571853 +0000 UTC m=+21.667364909" watchObservedRunningTime="2026-06-03 14:45:46.150711587 +0000 UTC m=+21.667504644"
Jun 03 14:45:46.173235 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:46.173196    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-q262g" podStartSLOduration=2.852966112 podStartE2EDuration="21.173181847s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.421235357 +0000 UTC m=+2.938028393" lastFinishedPulling="2026-06-03 14:45:45.74145108 +0000 UTC m=+21.258244128" observedRunningTime="2026-06-03 14:45:46.173033193 +0000 UTC m=+21.689826249" watchObservedRunningTime="2026-06-03 14:45:46.173181847 +0000 UTC m=+21.689974902"
Jun 03 14:45:47.038826 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.038670    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:47.038995 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.038677    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:47.038995 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:47.038903    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:47.038995 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:47.038978    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:47.131175 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.131115    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-4l555" event={"ID":"5b26d486-14a9-4e91-b44f-fc82d1cb39d7","Type":"ContainerStarted","Data":"66ac324e749a8a513920a5306fdcb1413e8ca7265bbfb54762c0eb5aca403436"}
Jun 03 14:45:47.132760 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.132734    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal" event={"ID":"a0f687a6ea858d2a61b6b9cf50cd635e","Type":"ContainerStarted","Data":"ab697a0b08acfe07d347a9947c669c4327eee548df990c07f33961e7e5eda979"}
Jun 03 14:45:47.135571 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.135553    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:45:47.135871 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.135850    2576 generic.go:358] "Generic (PLEG): container finished" podID="3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60" containerID="9b0fbb71fec43bf30ffeef1e5c792c96a26bc9881cbf184c199608556657d4e6" exitCode=1
Jun 03 14:45:47.135948 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.135913    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerDied","Data":"9b0fbb71fec43bf30ffeef1e5c792c96a26bc9881cbf184c199608556657d4e6"}
Jun 03 14:45:47.135948 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.135937    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"76d714a4f3bc8a5c9d03df962e72a466977e6b8dcdd4e424835d423e50ce51ec"}
Jun 03 14:45:47.136032 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.135947    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"abd00a7c62f4d79869503a7fdce7260ee4debc4ee0414e2d4f14f3d142147695"}
Jun 03 14:45:47.136032 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.135959    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"f59a439f64ffeb1c4dd9b32dd02e2437b7321763459ac9ec13caadd36f79e6ea"}
Jun 03 14:45:47.136032 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.135973    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"787be042bf72c4a8bf36e7d37dd95b9bb5c4fc06c3dcf2f2d3dc711a94763997"}
Jun 03 14:45:47.137249 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.137223    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerStarted","Data":"23b54509c58e747c73f6324673c5fd3c0d631b695d9e866e19f212382f6e9ae6"}
Jun 03 14:45:47.138615 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.138590    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-5hlrw" event={"ID":"d5aee60d-1fc5-49d9-b7e3-88955abb0a3f","Type":"ContainerStarted","Data":"8d5a626c84479c99bcdac50a12cd74381e3e6491056aee0b5006279d52d09498"}
Jun 03 14:45:47.140237 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.140215    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ppnw2" event={"ID":"2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524","Type":"ContainerStarted","Data":"8a5dec513f63e7be4f370a3bfdbf82c2dddf8a324b18afc36091210ec13ee7f5"}
Jun 03 14:45:47.141409 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.141388    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-n4k87" event={"ID":"8c4f17c2-dd14-4da6-bea0-66889dc222bc","Type":"ContainerStarted","Data":"a11530e7e87c7521a21aae51162bcac49ff2ff6056e012e5521e4c9998a9ef6f"}
Jun 03 14:45:47.142727 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.142699    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2" event={"ID":"e3c4a1d9-2454-4993-baf2-ed584ccd7248","Type":"ContainerStarted","Data":"f5a26c77150e524f62f01123ea0cdc10c5b2a30403ccf6ecb2da37f09a6f9a6f"}
Jun 03 14:45:47.152532 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.152497    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-4l555" podStartSLOduration=11.92794543 podStartE2EDuration="22.152486524s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.414753917 +0000 UTC m=+2.931546959" lastFinishedPulling="2026-06-03 14:45:37.639295006 +0000 UTC m=+13.156088053" observedRunningTime="2026-06-03 14:45:47.151914767 +0000 UTC m=+22.668707821" watchObservedRunningTime="2026-06-03 14:45:47.152486524 +0000 UTC m=+22.669279579"
Jun 03 14:45:47.227213 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.227165    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-5hlrw" podStartSLOduration=11.95896225 podStartE2EDuration="22.227147953s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.415403457 +0000 UTC m=+2.932196493" lastFinishedPulling="2026-06-03 14:45:37.683589148 +0000 UTC m=+13.200382196" observedRunningTime="2026-06-03 14:45:47.206671437 +0000 UTC m=+22.723464732" watchObservedRunningTime="2026-06-03 14:45:47.227147953 +0000 UTC m=+22.743941001"
Jun 03 14:45:47.248058 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.247998    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-n4k87" podStartSLOduration=4.324108336 podStartE2EDuration="22.247987569s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.423764086 +0000 UTC m=+2.940557122" lastFinishedPulling="2026-06-03 14:45:45.347643322 +0000 UTC m=+20.864436355" observedRunningTime="2026-06-03 14:45:47.247734848 +0000 UTC m=+22.764527925" watchObservedRunningTime="2026-06-03 14:45:47.247987569 +0000 UTC m=+22.764780623"
Jun 03 14:45:47.266824 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.266783    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-ppnw2" podStartSLOduration=2.004742522 podStartE2EDuration="19.266771341s" podCreationTimestamp="2026-06-03 14:45:28 +0000 UTC" firstStartedPulling="2026-06-03 14:45:28.477055134 +0000 UTC m=+3.993848172" lastFinishedPulling="2026-06-03 14:45:45.739083941 +0000 UTC m=+21.255876991" observedRunningTime="2026-06-03 14:45:47.266534882 +0000 UTC m=+22.783327948" watchObservedRunningTime="2026-06-03 14:45:47.266771341 +0000 UTC m=+22.783564396"
Jun 03 14:45:47.815629 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.815598    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:47.816652 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:47.816630    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:48.145798 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.145710    2576 generic.go:358] "Generic (PLEG): container finished" podID="a0f687a6ea858d2a61b6b9cf50cd635e" containerID="ab697a0b08acfe07d347a9947c669c4327eee548df990c07f33961e7e5eda979" exitCode=0
Jun 03 14:45:48.146271 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.145799    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal" event={"ID":"a0f687a6ea858d2a61b6b9cf50cd635e","Type":"ContainerDied","Data":"ab697a0b08acfe07d347a9947c669c4327eee548df990c07f33961e7e5eda979"}
Jun 03 14:45:48.147162 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.147096    2576 generic.go:358] "Generic (PLEG): container finished" podID="42ce5c30-ac13-4c63-ad41-b67cac79c6bb" containerID="23b54509c58e747c73f6324673c5fd3c0d631b695d9e866e19f212382f6e9ae6" exitCode=0
Jun 03 14:45:48.147233 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.147158    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerDied","Data":"23b54509c58e747c73f6324673c5fd3c0d631b695d9e866e19f212382f6e9ae6"}
Jun 03 14:45:48.147732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.147710    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:48.147973 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.147957    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-4l555"
Jun 03 14:45:48.537055 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.536830    2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 03 14:45:48.971853 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.971671    2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-03T14:45:48.537048797Z","UUID":"f8bd7a69-a71f-4b07-b2bf-ab47ce7c20db","Handler":null,"Name":"","Endpoint":""}
Jun 03 14:45:48.973409 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.973390    2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 03 14:45:48.973409 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:48.973413    2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 03 14:45:49.039455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:49.039430    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:49.039612 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:49.039430    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:49.039612 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:49.039544    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:49.039612 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:49.039589    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:49.152735 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:49.152686    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2" event={"ID":"e3c4a1d9-2454-4993-baf2-ed584ccd7248","Type":"ContainerStarted","Data":"2964f97b25147eab69d13a006897671c48c1edbd14bc812fb5f96a49d13d2b7e"}
Jun 03 14:45:49.154416 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:49.154383    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal" event={"ID":"a0f687a6ea858d2a61b6b9cf50cd635e","Type":"ContainerStarted","Data":"d391f455705f1c61ebbf493ca172ec92fde1d029ee5123b7312bd3861c5e1c5c"}
Jun 03 14:45:49.157577 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:49.157559    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:45:49.157923 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:49.157898    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"41db4c07f8d4defcd1877a4c5da07eb2a308d0ac4a5157bce3455c059ca43591"}
Jun 03 14:45:49.172538 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:49.172494    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-251.ec2.internal" podStartSLOduration=23.172485242 podStartE2EDuration="23.172485242s" podCreationTimestamp="2026-06-03 14:45:26 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:45:49.172205377 +0000 UTC m=+24.688998432" watchObservedRunningTime="2026-06-03 14:45:49.172485242 +0000 UTC m=+24.689278297"
Jun 03 14:45:50.161366 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:50.161332    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2" event={"ID":"e3c4a1d9-2454-4993-baf2-ed584ccd7248","Type":"ContainerStarted","Data":"193bf4fb28e340e396521cc065f3e8aaf9345ae3148666e6efda7717a672306c"}
Jun 03 14:45:50.184796 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:50.184751    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-7nvv2" podStartSLOduration=2.969966196 podStartE2EDuration="25.184739667s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.417640305 +0000 UTC m=+2.934433339" lastFinishedPulling="2026-06-03 14:45:49.632413773 +0000 UTC m=+25.149206810" observedRunningTime="2026-06-03 14:45:50.184667642 +0000 UTC m=+25.701460691" watchObservedRunningTime="2026-06-03 14:45:50.184739667 +0000 UTC m=+25.701532722"
Jun 03 14:45:51.039564 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:51.039366    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:51.039727 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:51.039426    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:51.039727 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:51.039639    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:51.039846 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:51.039751    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:51.166631 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:51.166607    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:45:51.167042 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:51.167020    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"2c464ba4efb7e0960c8966a956f21a9028bc9c1d4c14cd9c808d6bab4ed0f0ee"}
Jun 03 14:45:51.167484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:51.167471    2576 scope.go:117] "RemoveContainer" containerID="9b0fbb71fec43bf30ffeef1e5c792c96a26bc9881cbf184c199608556657d4e6"
Jun 03 14:45:52.173562 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.173539    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:45:52.174026 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.173989    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" event={"ID":"3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60","Type":"ContainerStarted","Data":"b35a00615b23039e2ccbfdd2adab635b821903be6237c0be10b4621b29e95a3a"}
Jun 03 14:45:52.174431 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.174349    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:52.174431 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.174391    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:52.174431 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.174404    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:52.193002 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.192975    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:52.194734 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.194714    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:45:52.223439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.223383    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2" podStartSLOduration=8.858555604 podStartE2EDuration="27.223360295s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.422528879 +0000 UTC m=+2.939321928" lastFinishedPulling="2026-06-03 14:45:45.787333585 +0000 UTC m=+21.304126619" observedRunningTime="2026-06-03 14:45:52.22269424 +0000 UTC m=+27.739487301" watchObservedRunningTime="2026-06-03 14:45:52.223360295 +0000 UTC m=+27.740153349"
Jun 03 14:45:52.634978 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.634945    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbcfw"]
Jun 03 14:45:52.635150 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.635074    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:52.635235 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:52.635214    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:52.637486 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.637458    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mkzqd"]
Jun 03 14:45:52.637613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:52.637569    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:52.637669 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:52.637648    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:54.038782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:54.038601    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:54.039213 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:54.038666    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:54.039213 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:54.038851    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:54.039213 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:54.038964    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:54.178292 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:54.178265    2576 generic.go:358] "Generic (PLEG): container finished" podID="42ce5c30-ac13-4c63-ad41-b67cac79c6bb" containerID="e3dc9d775f52868b82d0600583865ad20388f405801b635b67c3d56a40311c4d" exitCode=0
Jun 03 14:45:54.178451 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:54.178356    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerDied","Data":"e3dc9d775f52868b82d0600583865ad20388f405801b635b67c3d56a40311c4d"}
Jun 03 14:45:55.182620 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:55.182582    2576 generic.go:358] "Generic (PLEG): container finished" podID="42ce5c30-ac13-4c63-ad41-b67cac79c6bb" containerID="b581589ed5e930a898431b2ba71efdc0bb4cc48908f8aa0056600021b5cb22c2" exitCode=0
Jun 03 14:45:55.183395 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:55.182645    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerDied","Data":"b581589ed5e930a898431b2ba71efdc0bb4cc48908f8aa0056600021b5cb22c2"}
Jun 03 14:45:56.038861 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:56.038839    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:56.038951 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:56.038839    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:56.039002 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:56.038941    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:56.039060 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:56.039035    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:56.186046 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:56.185962    2576 generic.go:358] "Generic (PLEG): container finished" podID="42ce5c30-ac13-4c63-ad41-b67cac79c6bb" containerID="fda5209668402c80bdfc798afef77ecddc360e5ea9cfefc2394a78277e86105e" exitCode=0
Jun 03 14:45:56.186046 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:56.186030    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerDied","Data":"fda5209668402c80bdfc798afef77ecddc360e5ea9cfefc2394a78277e86105e"}
Jun 03 14:45:58.038789 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.038753    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:58.039317 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.038767    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:58.039317 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.038902    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:45:58.039317 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.038953    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mkzqd" podUID="ad4e12bf-ab2f-4223-b004-8cb8e248d3a4"
Jun 03 14:45:58.663433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.663215    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:45:58.663613 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.663366    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:58.663613 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.663559    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:30.663535898 +0000 UTC m=+66.180328945 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 03 14:45:58.764742 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.764653    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:45:58.764897 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.764824    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 03 14:45:58.764897 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.764848    2576 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 03 14:45:58.764897 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.764862    2576 projected.go:194] Error preparing data for projected volume kube-api-access-b8xvk for pod openshift-network-diagnostics/network-check-target-mkzqd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:58.765062 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:58.764926    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk podName:ad4e12bf-ab2f-4223-b004-8cb8e248d3a4 nodeName:}" failed. No retries permitted until 2026-06-03 14:46:30.764907566 +0000 UTC m=+66.281700603 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-b8xvk" (UniqueName: "kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk") pod "network-check-target-mkzqd" (UID: "ad4e12bf-ab2f-4223-b004-8cb8e248d3a4") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 03 14:45:58.797008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.796980    2576 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-140-251.ec2.internal" event="NodeReady"
Jun 03 14:45:58.797165 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.797120    2576 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 03 14:45:58.880695 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.880668    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-z5f9m"]
Jun 03 14:45:58.884434 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.884414    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mcckm"]
Jun 03 14:45:58.884610 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.884583    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:58.887455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.887437    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:45:58.887921 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.887903    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dkhrx\""
Jun 03 14:45:58.888049 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.887913    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 03 14:45:58.888049 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.887930    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 03 14:45:58.892462 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.892182    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 03 14:45:58.892462 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.892262    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 03 14:45:58.892462 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.892330    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljvdn\""
Jun 03 14:45:58.892462 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.892423    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 03 14:45:58.898951 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.898933    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5f9m"]
Jun 03 14:45:58.901278 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.901256    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcckm"]
Jun 03 14:45:58.966295 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.966265    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54728720-211f-4a83-ab10-ba0fde28f34a-config-volume\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:58.966453 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.966314    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68zp9\" (UniqueName: \"kubernetes.io/projected/d40ccee8-3333-411b-8b01-2a2707cfa56f-kube-api-access-68zp9\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:45:58.966453 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.966348    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54728720-211f-4a83-ab10-ba0fde28f34a-tmp-dir\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:58.966453 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.966394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9jjr\" (UniqueName: \"kubernetes.io/projected/54728720-211f-4a83-ab10-ba0fde28f34a-kube-api-access-d9jjr\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:58.966453 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.966442    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:45:58.966624 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:58.966472    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.067893 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.067778    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54728720-211f-4a83-ab10-ba0fde28f34a-config-volume\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.067893 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.067828    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-68zp9\" (UniqueName: \"kubernetes.io/projected/d40ccee8-3333-411b-8b01-2a2707cfa56f-kube-api-access-68zp9\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:45:59.067893 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.067883    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54728720-211f-4a83-ab10-ba0fde28f34a-tmp-dir\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.067909    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d9jjr\" (UniqueName: \"kubernetes.io/projected/54728720-211f-4a83-ab10-ba0fde28f34a-kube-api-access-d9jjr\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.067928    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.067948    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.068061    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.068074    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.068122    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:45:59.568102758 +0000 UTC m=+35.084895799 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.068157    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:45:59.568147416 +0000 UTC m=+35.084940462 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.068252    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/54728720-211f-4a83-ab10-ba0fde28f34a-tmp-dir\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.068495 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.068419    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/54728720-211f-4a83-ab10-ba0fde28f34a-config-volume\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.088458 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.088436    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9jjr\" (UniqueName: \"kubernetes.io/projected/54728720-211f-4a83-ab10-ba0fde28f34a-kube-api-access-d9jjr\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.088614 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.088597    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68zp9\" (UniqueName: \"kubernetes.io/projected/d40ccee8-3333-411b-8b01-2a2707cfa56f-kube-api-access-68zp9\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:45:59.573055 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.573020    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:45:59.573055 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:45:59.573056    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:45:59.573307 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.573185    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:45:59.573307 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.573201    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:45:59.573307 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.573263    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:46:00.573243012 +0000 UTC m=+36.090036049 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:45:59.573307 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:45:59.573282    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:46:00.573273387 +0000 UTC m=+36.090066421 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:46:00.039228 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.039194    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:46:00.039424 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.039197    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:46:00.042519 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.042497    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 14:46:00.044067 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.044046    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 14:46:00.044067 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.044057    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fk4zz\""
Jun 03 14:46:00.044251 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.044094    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5wkn\""
Jun 03 14:46:00.044251 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.044094    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 14:46:00.581765 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.581731    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:46:00.581765 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:00.581774    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:46:00.582299 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:00.581902    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:46:00.582299 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:00.581957    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:46:00.582299 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:00.581975    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:46:02.581955168 +0000 UTC m=+38.098748221 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:46:00.582299 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:00.582052    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:46:02.58199905 +0000 UTC m=+38.098792100 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:46:02.596463 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:02.596419    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:46:02.596463 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:02.596467    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:46:02.596843 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:02.596564    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:46:02.596843 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:02.596578    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:46:02.596843 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:02.596627    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:46:06.59661364 +0000 UTC m=+42.113406673 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:46:02.596843 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:02.596644    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:46:06.596636703 +0000 UTC m=+42.113429736 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:46:03.199783 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:03.199748    2576 generic.go:358] "Generic (PLEG): container finished" podID="42ce5c30-ac13-4c63-ad41-b67cac79c6bb" containerID="f81e6dc41a5778babd11b9155560bf1aa652fc0e50b6dfdb49c979f1f4beaddd" exitCode=0
Jun 03 14:46:03.199963 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:03.199803    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerDied","Data":"f81e6dc41a5778babd11b9155560bf1aa652fc0e50b6dfdb49c979f1f4beaddd"}
Jun 03 14:46:04.203889 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:04.203853    2576 generic.go:358] "Generic (PLEG): container finished" podID="42ce5c30-ac13-4c63-ad41-b67cac79c6bb" containerID="bf466d3a6bf7824d5325b049b077a45fa584dcc9961654e9986da49410d7626f" exitCode=0
Jun 03 14:46:04.204341 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:04.203908    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerDied","Data":"bf466d3a6bf7824d5325b049b077a45fa584dcc9961654e9986da49410d7626f"}
Jun 03 14:46:05.208474 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:05.208432    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" event={"ID":"42ce5c30-ac13-4c63-ad41-b67cac79c6bb","Type":"ContainerStarted","Data":"528658ea9ed431e8c6bc7287423040e5712a3251ddcaa0c7d3dd134262b6b8bd"}
Jun 03 14:46:05.237174 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:05.237047    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-6dq4s" podStartSLOduration=5.424970941 podStartE2EDuration="40.237034147s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:45:27.420261777 +0000 UTC m=+2.937054814" lastFinishedPulling="2026-06-03 14:46:02.232324985 +0000 UTC m=+37.749118020" observedRunningTime="2026-06-03 14:46:05.235250123 +0000 UTC m=+40.752043177" watchObservedRunningTime="2026-06-03 14:46:05.237034147 +0000 UTC m=+40.753827202"
Jun 03 14:46:06.624805 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:06.624770    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:46:06.624805 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:06.624808    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:46:06.625244 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:06.624907    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:46:06.625244 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:06.624911    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:46:06.625244 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:06.624956    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:46:14.624943554 +0000 UTC m=+50.141736591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:46:06.625244 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:06.624969    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:46:14.624963234 +0000 UTC m=+50.141756267 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:46:14.677465 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:14.677425    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:46:14.677465 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:14.677468    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:46:14.677972 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:14.677568    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:46:14.677972 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:14.677585    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:46:14.677972 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:14.677631    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:46:30.677614816 +0000 UTC m=+66.194407849 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:46:14.677972 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:14.677644    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:46:30.677638422 +0000 UTC m=+66.194431456 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:46:24.188700 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:24.188671    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cq5p2"
Jun 03 14:46:30.689883 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.689843    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:46:30.690447 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.689891    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:46:30.690447 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:30.689995    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:46:30.690447 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.690024    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:46:30.690447 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:30.689998    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:46:30.690447 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:30.690107    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:47:02.690088692 +0000 UTC m=+98.206881725 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:46:30.690447 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:30.690189    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:47:02.690165942 +0000 UTC m=+98.206958979 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:46:30.692969 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.692954    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 03 14:46:30.700363 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:30.700347    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 14:46:30.700448 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:46:30.700390    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:34.700377541 +0000 UTC m=+130.217170574 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : secret "metrics-daemon-secret" not found
Jun 03 14:46:30.790819 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.790790    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:46:30.793448 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.793432    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 03 14:46:30.803945 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.803926    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 03 14:46:30.815179 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.815148    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8xvk\" (UniqueName: \"kubernetes.io/projected/ad4e12bf-ab2f-4223-b004-8cb8e248d3a4-kube-api-access-b8xvk\") pod \"network-check-target-mkzqd\" (UID: \"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4\") " pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:46:30.958177 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.958156    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-p5wkn\""
Jun 03 14:46:30.965617 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:30.965599    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:46:31.132665 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:31.132637    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mkzqd"]
Jun 03 14:46:31.136958 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:46:31.136924    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4e12bf_ab2f_4223_b004_8cb8e248d3a4.slice/crio-63d88e22c1e8a97fc152d71c3b89fce148a0d3917ce5f385d6615a8c71fbc29d WatchSource:0}: Error finding container 63d88e22c1e8a97fc152d71c3b89fce148a0d3917ce5f385d6615a8c71fbc29d: Status 404 returned error can't find the container with id 63d88e22c1e8a97fc152d71c3b89fce148a0d3917ce5f385d6615a8c71fbc29d
Jun 03 14:46:31.254887 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:31.254829    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mkzqd" event={"ID":"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4","Type":"ContainerStarted","Data":"63d88e22c1e8a97fc152d71c3b89fce148a0d3917ce5f385d6615a8c71fbc29d"}
Jun 03 14:46:35.263940 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:35.263906    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mkzqd" event={"ID":"ad4e12bf-ab2f-4223-b004-8cb8e248d3a4","Type":"ContainerStarted","Data":"3ac115c4e648aef57c12f1246b0a58145dc91bb23270fcb8b7c04824c3acea30"}
Jun 03 14:46:35.264306 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:35.264048    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:46:35.282867 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:46:35.282821    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mkzqd" podStartSLOduration=66.540226791 podStartE2EDuration="1m10.282808917s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:46:31.138951368 +0000 UTC m=+66.655744401" lastFinishedPulling="2026-06-03 14:46:34.88153348 +0000 UTC m=+70.398326527" observedRunningTime="2026-06-03 14:46:35.282247113 +0000 UTC m=+70.799040171" watchObservedRunningTime="2026-06-03 14:46:35.282808917 +0000 UTC m=+70.799602007"
Jun 03 14:47:02.711625 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:02.711585    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:47:02.712032 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:02.711631    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:47:02.712032 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:02.711741    2576 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 03 14:47:02.712032 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:02.711811    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert podName:d40ccee8-3333-411b-8b01-2a2707cfa56f nodeName:}" failed. No retries permitted until 2026-06-03 14:48:06.711796231 +0000 UTC m=+162.228589268 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert") pod "ingress-canary-mcckm" (UID: "d40ccee8-3333-411b-8b01-2a2707cfa56f") : secret "canary-serving-cert" not found
Jun 03 14:47:02.712032 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:02.711746    2576 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 03 14:47:02.712032 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:02.711902    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls podName:54728720-211f-4a83-ab10-ba0fde28f34a nodeName:}" failed. No retries permitted until 2026-06-03 14:48:06.711884754 +0000 UTC m=+162.228677790 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls") pod "dns-default-z5f9m" (UID: "54728720-211f-4a83-ab10-ba0fde28f34a") : secret "dns-default-metrics-tls" not found
Jun 03 14:47:06.267855 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:06.267825    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mkzqd"
Jun 03 14:47:34.729438 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:34.729384    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:47:34.729944 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:34.729533    2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 03 14:47:34.729944 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:34.729596    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs podName:6c806192-8385-493c-acc6-b3dfa7ca4ef4 nodeName:}" failed. No retries permitted until 2026-06-03 14:49:36.729578055 +0000 UTC m=+252.246371098 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs") pod "network-metrics-daemon-fbcfw" (UID: "6c806192-8385-493c-acc6-b3dfa7ca4ef4") : secret "metrics-daemon-secret" not found
Jun 03 14:47:39.652980 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.652946    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"]
Jun 03 14:47:39.654853 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.654832    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.655905 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.655883    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-788bf58df5-h54pq"]
Jun 03 14:47:39.657538 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.657523    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.659072 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.659055    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jun 03 14:47:39.660054 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.660034    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-qq2ws\""
Jun 03 14:47:39.660618 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.660601    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 03 14:47:39.660740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.660670    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jun 03 14:47:39.660934 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.660897    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 03 14:47:39.661600 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.661352    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 03 14:47:39.661600 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.661395    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 03 14:47:39.661833 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.661817    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jun 03 14:47:39.661907 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.661877    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jun 03 14:47:39.662142 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.662110    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x2cnm\""
Jun 03 14:47:39.667891 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.667870    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jun 03 14:47:39.672844 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.672825    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"]
Jun 03 14:47:39.673605 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.673584    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-h54pq"]
Jun 03 14:47:39.763267 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763230    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmt42\" (UniqueName: \"kubernetes.io/projected/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-kube-api-access-wmt42\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763274    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-snapshots\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-serving-cert\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763390    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-tmp\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763417    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763437    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-service-ca-bundle\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763458    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d10cc6e5-f695-4031-90cd-9824659fba3b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.763484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.763474    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kgtm\" (UniqueName: \"kubernetes.io/projected/d10cc6e5-f695-4031-90cd-9824659fba3b-kube-api-access-2kgtm\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.863881 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.863853    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.863881 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.863880    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-service-ca-bundle\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.863905    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d10cc6e5-f695-4031-90cd-9824659fba3b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.864088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.863923    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2kgtm\" (UniqueName: \"kubernetes.io/projected/d10cc6e5-f695-4031-90cd-9824659fba3b-kube-api-access-2kgtm\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.864088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.863944    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wmt42\" (UniqueName: \"kubernetes.io/projected/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-kube-api-access-wmt42\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.863966    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.864088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.863988    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-snapshots\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.864003    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-serving-cert\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.864072    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-tmp\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864468 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:39.864169    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:39.864468 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:39.864239    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls podName:d10cc6e5-f695-4031-90cd-9824659fba3b nodeName:}" failed. No retries permitted until 2026-06-03 14:47:40.364217356 +0000 UTC m=+135.881010392 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9mwdn" (UID: "d10cc6e5-f695-4031-90cd-9824659fba3b") : secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:39.864468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.864448    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-tmp\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864654 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.864629    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-service-ca-bundle\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864721 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.864686    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-snapshots\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.864786 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.864761    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/d10cc6e5-f695-4031-90cd-9824659fba3b-telemetry-config\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.864930 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.864910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-trusted-ca-bundle\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.866522 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.866498    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-serving-cert\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.875993 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.875968    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kgtm\" (UniqueName: \"kubernetes.io/projected/d10cc6e5-f695-4031-90cd-9824659fba3b-kube-api-access-2kgtm\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:39.876240 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.876222    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmt42\" (UniqueName: \"kubernetes.io/projected/7f1c41a6-0b05-4ad0-9346-1bfc1565901e-kube-api-access-wmt42\") pod \"insights-operator-788bf58df5-h54pq\" (UID: \"7f1c41a6-0b05-4ad0-9346-1bfc1565901e\") " pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:39.971632 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:39.971611    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-788bf58df5-h54pq"
Jun 03 14:47:40.090305 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:40.090277    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-788bf58df5-h54pq"]
Jun 03 14:47:40.093250 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:47:40.093227    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f1c41a6_0b05_4ad0_9346_1bfc1565901e.slice/crio-afc34ee171e99ac922474a339b529379c4a2bc5b1765b002c3e98f98a43a026f WatchSource:0}: Error finding container afc34ee171e99ac922474a339b529379c4a2bc5b1765b002c3e98f98a43a026f: Status 404 returned error can't find the container with id afc34ee171e99ac922474a339b529379c4a2bc5b1765b002c3e98f98a43a026f
Jun 03 14:47:40.368510 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:40.368415    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:40.368659 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:40.368564    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:40.368659 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:40.368633    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls podName:d10cc6e5-f695-4031-90cd-9824659fba3b nodeName:}" failed. No retries permitted until 2026-06-03 14:47:41.368615285 +0000 UTC m=+136.885408331 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9mwdn" (UID: "d10cc6e5-f695-4031-90cd-9824659fba3b") : secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:40.387458 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:40.387424    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-h54pq" event={"ID":"7f1c41a6-0b05-4ad0-9346-1bfc1565901e","Type":"ContainerStarted","Data":"afc34ee171e99ac922474a339b529379c4a2bc5b1765b002c3e98f98a43a026f"}
Jun 03 14:47:41.376217 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.376173    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:41.376578 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:41.376318    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:41.376578 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:41.376379    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls podName:d10cc6e5-f695-4031-90cd-9824659fba3b nodeName:}" failed. No retries permitted until 2026-06-03 14:47:43.376364203 +0000 UTC m=+138.893157242 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9mwdn" (UID: "d10cc6e5-f695-4031-90cd-9824659fba3b") : secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:41.529034 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.528999    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"]
Jun 03 14:47:41.530957 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.530942    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"
Jun 03 14:47:41.537218 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.537195    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 03 14:47:41.537325 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.537230    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 03 14:47:41.538244 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.538231    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-7jxnb\""
Jun 03 14:47:41.543310 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.543291    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"]
Jun 03 14:47:41.678314 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.678236    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vmd2\" (UniqueName: \"kubernetes.io/projected/ec092399-223c-4db2-81db-9647b58ae114-kube-api-access-4vmd2\") pod \"volume-data-source-validator-7598fd5bd-tph4g\" (UID: \"ec092399-223c-4db2-81db-9647b58ae114\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"
Jun 03 14:47:41.779327 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.779289    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4vmd2\" (UniqueName: \"kubernetes.io/projected/ec092399-223c-4db2-81db-9647b58ae114-kube-api-access-4vmd2\") pod \"volume-data-source-validator-7598fd5bd-tph4g\" (UID: \"ec092399-223c-4db2-81db-9647b58ae114\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"
Jun 03 14:47:41.788659 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.788638    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vmd2\" (UniqueName: \"kubernetes.io/projected/ec092399-223c-4db2-81db-9647b58ae114-kube-api-access-4vmd2\") pod \"volume-data-source-validator-7598fd5bd-tph4g\" (UID: \"ec092399-223c-4db2-81db-9647b58ae114\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"
Jun 03 14:47:41.838960 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.838934    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"
Jun 03 14:47:41.971436 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:41.971408    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g"]
Jun 03 14:47:42.365772 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:47:42.365707    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec092399_223c_4db2_81db_9647b58ae114.slice/crio-fbb153377cec7fa27032b6ddbaa17de0e53df4cf08e8eb03160580e731824cc9 WatchSource:0}: Error finding container fbb153377cec7fa27032b6ddbaa17de0e53df4cf08e8eb03160580e731824cc9: Status 404 returned error can't find the container with id fbb153377cec7fa27032b6ddbaa17de0e53df4cf08e8eb03160580e731824cc9
Jun 03 14:47:42.391412 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:42.391377    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g" event={"ID":"ec092399-223c-4db2-81db-9647b58ae114","Type":"ContainerStarted","Data":"fbb153377cec7fa27032b6ddbaa17de0e53df4cf08e8eb03160580e731824cc9"}
Jun 03 14:47:43.394079 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.394050    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:43.394749 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:43.394229    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:43.394749 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:43.394299    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls podName:d10cc6e5-f695-4031-90cd-9824659fba3b nodeName:}" failed. No retries permitted until 2026-06-03 14:47:47.394279902 +0000 UTC m=+142.911072943 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9mwdn" (UID: "d10cc6e5-f695-4031-90cd-9824659fba3b") : secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:43.395466 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.395436    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-h54pq" event={"ID":"7f1c41a6-0b05-4ad0-9346-1bfc1565901e","Type":"ContainerStarted","Data":"42d2cacf287de898a2b04a42f2d2f168182a5e8ae94a34a673c04fa46d456677"}
Jun 03 14:47:43.415621 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.415576    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-operator-788bf58df5-h54pq" podStartSLOduration=2.116869793 podStartE2EDuration="4.415563838s" podCreationTimestamp="2026-06-03 14:47:39 +0000 UTC" firstStartedPulling="2026-06-03 14:47:40.094860438 +0000 UTC m=+135.611653470" lastFinishedPulling="2026-06-03 14:47:42.393554479 +0000 UTC m=+137.910347515" observedRunningTime="2026-06-03 14:47:43.414305866 +0000 UTC m=+138.931098923" watchObservedRunningTime="2026-06-03 14:47:43.415563838 +0000 UTC m=+138.932356921"
Jun 03 14:47:43.539407 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.539369    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-zz2j7"]
Jun 03 14:47:43.541828 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.541809    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.545766 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.545747    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 03 14:47:43.546046 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.546028    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 03 14:47:43.546198 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.546156    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 03 14:47:43.546276 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.546158    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hjs7r\""
Jun 03 14:47:43.546615 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.546594    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 03 14:47:43.554790 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.554762    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-zz2j7"]
Jun 03 14:47:43.555265 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.555248    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 03 14:47:43.695929 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.695834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7317b775-d822-4530-b5fb-65c35ca3e8b0-config\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.695929 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.695892    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9695m\" (UniqueName: \"kubernetes.io/projected/7317b775-d822-4530-b5fb-65c35ca3e8b0-kube-api-access-9695m\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.696119 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.695968    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7317b775-d822-4530-b5fb-65c35ca3e8b0-serving-cert\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.696119 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.696014    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7317b775-d822-4530-b5fb-65c35ca3e8b0-trusted-ca\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.797213 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.797178    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9695m\" (UniqueName: \"kubernetes.io/projected/7317b775-d822-4530-b5fb-65c35ca3e8b0-kube-api-access-9695m\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.797357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.797243    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7317b775-d822-4530-b5fb-65c35ca3e8b0-serving-cert\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.797357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.797284    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7317b775-d822-4530-b5fb-65c35ca3e8b0-trusted-ca\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.797357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.797318    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7317b775-d822-4530-b5fb-65c35ca3e8b0-config\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.798095 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.798037    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7317b775-d822-4530-b5fb-65c35ca3e8b0-config\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.798227 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.798209    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/7317b775-d822-4530-b5fb-65c35ca3e8b0-trusted-ca\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.799688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.799667    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7317b775-d822-4530-b5fb-65c35ca3e8b0-serving-cert\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.806594 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.806576    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9695m\" (UniqueName: \"kubernetes.io/projected/7317b775-d822-4530-b5fb-65c35ca3e8b0-kube-api-access-9695m\") pod \"console-operator-86d7c6cc77-zz2j7\" (UID: \"7317b775-d822-4530-b5fb-65c35ca3e8b0\") " pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:43.852450 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:43.852262    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:44.171233 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:44.171209    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-zz2j7"]
Jun 03 14:47:44.173252 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:47:44.173227    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7317b775_d822_4530_b5fb_65c35ca3e8b0.slice/crio-90fa60f6bdbeecb1bc8c32178ab9f8d70983c5d6d2ce8cb31dbaaa29bc8dfa4d WatchSource:0}: Error finding container 90fa60f6bdbeecb1bc8c32178ab9f8d70983c5d6d2ce8cb31dbaaa29bc8dfa4d: Status 404 returned error can't find the container with id 90fa60f6bdbeecb1bc8c32178ab9f8d70983c5d6d2ce8cb31dbaaa29bc8dfa4d
Jun 03 14:47:44.398289 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:44.398200    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" event={"ID":"7317b775-d822-4530-b5fb-65c35ca3e8b0","Type":"ContainerStarted","Data":"90fa60f6bdbeecb1bc8c32178ab9f8d70983c5d6d2ce8cb31dbaaa29bc8dfa4d"}
Jun 03 14:47:44.401095 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:44.401063    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g" event={"ID":"ec092399-223c-4db2-81db-9647b58ae114","Type":"ContainerStarted","Data":"a9af14fde3bfbb762bfd9a4dee17991053b37fdc44028e7903df785a6d4b7b91"}
Jun 03 14:47:44.419096 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:44.419048    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-tph4g" podStartSLOduration=1.71118727 podStartE2EDuration="3.419036226s" podCreationTimestamp="2026-06-03 14:47:41 +0000 UTC" firstStartedPulling="2026-06-03 14:47:42.368298596 +0000 UTC m=+137.885091632" lastFinishedPulling="2026-06-03 14:47:44.076147542 +0000 UTC m=+139.592940588" observedRunningTime="2026-06-03 14:47:44.418221427 +0000 UTC m=+139.935014525" watchObservedRunningTime="2026-06-03 14:47:44.419036226 +0000 UTC m=+139.935829332"
Jun 03 14:47:45.650858 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:45.650829    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ppnw2_2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524/dns-node-resolver/0.log"
Jun 03 14:47:46.251827 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:46.251801    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5hlrw_d5aee60d-1fc5-49d9-b7e3-88955abb0a3f/node-ca/0.log"
Jun 03 14:47:47.408536 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.408503    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/0.log"
Jun 03 14:47:47.408979 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.408548    2576 generic.go:358] "Generic (PLEG): container finished" podID="7317b775-d822-4530-b5fb-65c35ca3e8b0" containerID="3123e60c7c63c6165f33c2e47bb4d1a9b9dee5cb8bdfb0bd415e44eb51307a5b" exitCode=255
Jun 03 14:47:47.408979 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.408624    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" event={"ID":"7317b775-d822-4530-b5fb-65c35ca3e8b0","Type":"ContainerDied","Data":"3123e60c7c63c6165f33c2e47bb4d1a9b9dee5cb8bdfb0bd415e44eb51307a5b"}
Jun 03 14:47:47.408979 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.408858    2576 scope.go:117] "RemoveContainer" containerID="3123e60c7c63c6165f33c2e47bb4d1a9b9dee5cb8bdfb0bd415e44eb51307a5b"
Jun 03 14:47:47.423995 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.423975    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:47.424100 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:47.424087    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:47.424175 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:47.424164    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls podName:d10cc6e5-f695-4031-90cd-9824659fba3b nodeName:}" failed. No retries permitted until 2026-06-03 14:47:55.424122853 +0000 UTC m=+150.940915891 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9mwdn" (UID: "d10cc6e5-f695-4031-90cd-9824659fba3b") : secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:47.659902 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.659825    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7dddbdf9b9-5kt92"]
Jun 03 14:47:47.661689 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.661676    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.664204 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.664175    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jun 03 14:47:47.664349 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.664267    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jun 03 14:47:47.664463 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.664345    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pgjmg\""
Jun 03 14:47:47.664463 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.664426    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jun 03 14:47:47.668716 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.668698    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jun 03 14:47:47.672917 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.672898    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dddbdf9b9-5kt92"]
Jun 03 14:47:47.826846 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.826816    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-installation-pull-secrets\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.827008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.826856    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-bound-sa-token\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.827008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.826881    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0bef055-8950-44cf-b4d6-e6b171055edc-ca-trust-extracted\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.827008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.826910    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-image-registry-private-configuration\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.827008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.826957    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-trusted-ca\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.827008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.827000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-certificates\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.827274 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.827042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.827274 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.827081    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kq6s4\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-kube-api-access-kq6s4\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927380 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927310    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kq6s4\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-kube-api-access-kq6s4\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927380 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927366    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-installation-pull-secrets\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927560 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927411    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-bound-sa-token\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927560 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927444    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0bef055-8950-44cf-b4d6-e6b171055edc-ca-trust-extracted\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927560 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927484    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-image-registry-private-configuration\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927560 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927509    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-trusted-ca\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927560 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927536    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-certificates\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927798 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927575    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.927798 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:47.927678    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 14:47:47.927798 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:47.927692    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dddbdf9b9-5kt92: secret "image-registry-tls" not found
Jun 03 14:47:47.927798 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:47.927752    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls podName:d0bef055-8950-44cf-b4d6-e6b171055edc nodeName:}" failed. No retries permitted until 2026-06-03 14:47:48.42773154 +0000 UTC m=+143.944524588 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls") pod "image-registry-7dddbdf9b9-5kt92" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc") : secret "image-registry-tls" not found
Jun 03 14:47:47.927984 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.927940    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0bef055-8950-44cf-b4d6-e6b171055edc-ca-trust-extracted\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.928278 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.928255    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-certificates\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.928366 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.928351    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-trusted-ca\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.929657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.929631    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-installation-pull-secrets\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.929852 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.929835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-image-registry-private-configuration\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.937662 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.937633    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-bound-sa-token\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:47.937747 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:47.937716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kq6s4\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-kube-api-access-kq6s4\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:48.412023 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:48.411997    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 14:47:48.412424 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:48.412360    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/0.log"
Jun 03 14:47:48.412424 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:48.412393    2576 generic.go:358] "Generic (PLEG): container finished" podID="7317b775-d822-4530-b5fb-65c35ca3e8b0" containerID="055769402f65dafaeb8e967bbe9b9e4c91b9e66c0f54918557d0e0a4828eed59" exitCode=255
Jun 03 14:47:48.412501 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:48.412447    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" event={"ID":"7317b775-d822-4530-b5fb-65c35ca3e8b0","Type":"ContainerDied","Data":"055769402f65dafaeb8e967bbe9b9e4c91b9e66c0f54918557d0e0a4828eed59"}
Jun 03 14:47:48.412501 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:48.412496    2576 scope.go:117] "RemoveContainer" containerID="3123e60c7c63c6165f33c2e47bb4d1a9b9dee5cb8bdfb0bd415e44eb51307a5b"
Jun 03 14:47:48.412675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:48.412652    2576 scope.go:117] "RemoveContainer" containerID="055769402f65dafaeb8e967bbe9b9e4c91b9e66c0f54918557d0e0a4828eed59"
Jun 03 14:47:48.412856 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:48.412834    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-zz2j7_openshift-console-operator(7317b775-d822-4530-b5fb-65c35ca3e8b0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" podUID="7317b775-d822-4530-b5fb-65c35ca3e8b0"
Jun 03 14:47:48.432483 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:48.432462    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:48.432573 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:48.432553    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 14:47:48.432573 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:48.432563    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dddbdf9b9-5kt92: secret "image-registry-tls" not found
Jun 03 14:47:48.432648 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:48.432604    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls podName:d0bef055-8950-44cf-b4d6-e6b171055edc nodeName:}" failed. No retries permitted until 2026-06-03 14:47:49.432591377 +0000 UTC m=+144.949384411 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls") pod "image-registry-7dddbdf9b9-5kt92" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc") : secret "image-registry-tls" not found
Jun 03 14:47:49.415454 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:49.415425    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 14:47:49.415825 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:49.415773    2576 scope.go:117] "RemoveContainer" containerID="055769402f65dafaeb8e967bbe9b9e4c91b9e66c0f54918557d0e0a4828eed59"
Jun 03 14:47:49.415945 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:49.415927    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-zz2j7_openshift-console-operator(7317b775-d822-4530-b5fb-65c35ca3e8b0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" podUID="7317b775-d822-4530-b5fb-65c35ca3e8b0"
Jun 03 14:47:49.439439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:49.439414    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:49.439578 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:49.439544    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 14:47:49.439578 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:49.439561    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dddbdf9b9-5kt92: secret "image-registry-tls" not found
Jun 03 14:47:49.439649 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:49.439607    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls podName:d0bef055-8950-44cf-b4d6-e6b171055edc nodeName:}" failed. No retries permitted until 2026-06-03 14:47:51.439592242 +0000 UTC m=+146.956385275 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls") pod "image-registry-7dddbdf9b9-5kt92" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc") : secret "image-registry-tls" not found
Jun 03 14:47:51.453586 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:51.453541    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:51.454028 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:51.453686    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 14:47:51.454028 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:51.453701    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dddbdf9b9-5kt92: secret "image-registry-tls" not found
Jun 03 14:47:51.454028 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:51.453751    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls podName:d0bef055-8950-44cf-b4d6-e6b171055edc nodeName:}" failed. No retries permitted until 2026-06-03 14:47:55.453735565 +0000 UTC m=+150.970528599 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls") pod "image-registry-7dddbdf9b9-5kt92" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc") : secret "image-registry-tls" not found
Jun 03 14:47:53.853391 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:53.853355    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:53.853391 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:53.853399    2576 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:47:53.853790 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:53.853727    2576 scope.go:117] "RemoveContainer" containerID="055769402f65dafaeb8e967bbe9b9e4c91b9e66c0f54918557d0e0a4828eed59"
Jun 03 14:47:53.853911 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:53.853882    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-zz2j7_openshift-console-operator(7317b775-d822-4530-b5fb-65c35ca3e8b0)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" podUID="7317b775-d822-4530-b5fb-65c35ca3e8b0"
Jun 03 14:47:55.486774 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:55.486740    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:47:55.487218 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:55.486789    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:47:55.487218 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:55.486881    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 14:47:55.487218 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:55.486891    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dddbdf9b9-5kt92: secret "image-registry-tls" not found
Jun 03 14:47:55.487218 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:55.486923    2576 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:55.487218 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:55.486937    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls podName:d0bef055-8950-44cf-b4d6-e6b171055edc nodeName:}" failed. No retries permitted until 2026-06-03 14:48:03.486923656 +0000 UTC m=+159.003716691 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls") pod "image-registry-7dddbdf9b9-5kt92" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc") : secret "image-registry-tls" not found
Jun 03 14:47:55.487218 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:55.487003    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls podName:d10cc6e5-f695-4031-90cd-9824659fba3b nodeName:}" failed. No retries permitted until 2026-06-03 14:48:11.48698327 +0000 UTC m=+167.003776305 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-69b6cbdb88-9mwdn" (UID: "d10cc6e5-f695-4031-90cd-9824659fba3b") : secret "cluster-monitoring-operator-tls" not found
Jun 03 14:47:56.926490 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:56.926455    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-sv47q"]
Jun 03 14:47:56.929186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:56.929161    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:56.931639 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:56.931610    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-pdklw\""
Jun 03 14:47:56.932159 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:56.932146    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 03 14:47:56.932709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:56.932694    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 03 14:47:56.943024 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:56.943001    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sv47q"]
Jun 03 14:47:57.099793 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.099760    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fsb4q\" (UniqueName: \"kubernetes.io/projected/43cc2ba3-2e08-4c3d-964b-db460ad9b027-kube-api-access-fsb4q\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.099793 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.099796    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.100040 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.099890    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43cc2ba3-2e08-4c3d-964b-db460ad9b027-crio-socket\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.100040 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.099962    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43cc2ba3-2e08-4c3d-964b-db460ad9b027-data-volume\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.100040 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.099986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43cc2ba3-2e08-4c3d-964b-db460ad9b027-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.200819 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.200791    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-fsb4q\" (UniqueName: \"kubernetes.io/projected/43cc2ba3-2e08-4c3d-964b-db460ad9b027-kube-api-access-fsb4q\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.200982 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.200827    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.200982 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.200880    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43cc2ba3-2e08-4c3d-964b-db460ad9b027-crio-socket\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.200982 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.200916    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43cc2ba3-2e08-4c3d-964b-db460ad9b027-data-volume\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.200982 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.200940    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43cc2ba3-2e08-4c3d-964b-db460ad9b027-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.201220 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.201008    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/43cc2ba3-2e08-4c3d-964b-db460ad9b027-crio-socket\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.201220 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:57.201031    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 14:47:57.201220 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:57.201109    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls podName:43cc2ba3-2e08-4c3d-964b-db460ad9b027 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:57.701087938 +0000 UTC m=+153.217880982 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv47q" (UID: "43cc2ba3-2e08-4c3d-964b-db460ad9b027") : secret "insights-runtime-extractor-tls" not found
Jun 03 14:47:57.201365 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.201249    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/43cc2ba3-2e08-4c3d-964b-db460ad9b027-data-volume\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.201429 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.201412    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/43cc2ba3-2e08-4c3d-964b-db460ad9b027-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.211780 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.211758    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fsb4q\" (UniqueName: \"kubernetes.io/projected/43cc2ba3-2e08-4c3d-964b-db460ad9b027-kube-api-access-fsb4q\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.438911 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.438880    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-685df94d57-mc6qb"]
Jun 03 14:47:57.441037 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.441018    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.444751 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.444731    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-wv6z7\""
Jun 03 14:47:57.444824 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.444731    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jun 03 14:47:57.446675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.446657    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jun 03 14:47:57.446756 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.446683    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jun 03 14:47:57.446756 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.446696    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jun 03 14:47:57.452853 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.452805    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-mc6qb"]
Jun 03 14:47:57.604233 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.604176    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prgtr\" (UniqueName: \"kubernetes.io/projected/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-kube-api-access-prgtr\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.604427 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.604301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-signing-key\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.604427 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.604396    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-signing-cabundle\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.705735 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.705629    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-prgtr\" (UniqueName: \"kubernetes.io/projected/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-kube-api-access-prgtr\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.705735 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.705709    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:57.705735 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.705742    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-signing-key\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.705955 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.705842    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-signing-cabundle\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.705955 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:57.705863    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 14:47:57.706022 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:57.705999    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls podName:43cc2ba3-2e08-4c3d-964b-db460ad9b027 nodeName:}" failed. No retries permitted until 2026-06-03 14:47:58.705977303 +0000 UTC m=+154.222770341 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv47q" (UID: "43cc2ba3-2e08-4c3d-964b-db460ad9b027") : secret "insights-runtime-extractor-tls" not found
Jun 03 14:47:57.706461 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.706442    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-signing-cabundle\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.708370 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.708347    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-signing-key\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.715038 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.715016    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prgtr\" (UniqueName: \"kubernetes.io/projected/b8fde437-9d4d-4d5e-9e67-5c152b45fd73-kube-api-access-prgtr\") pod \"service-ca-685df94d57-mc6qb\" (UID: \"b8fde437-9d4d-4d5e-9e67-5c152b45fd73\") " pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.750035 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.750005    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-685df94d57-mc6qb"
Jun 03 14:47:57.868724 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:57.868699    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-685df94d57-mc6qb"]
Jun 03 14:47:57.871008 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:47:57.870981    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8fde437_9d4d_4d5e_9e67_5c152b45fd73.slice/crio-7e5e6245ffd5a9ec0f43e0513c00d697e941f1915c3e678f2407fa4dfb449061 WatchSource:0}: Error finding container 7e5e6245ffd5a9ec0f43e0513c00d697e941f1915c3e678f2407fa4dfb449061: Status 404 returned error can't find the container with id 7e5e6245ffd5a9ec0f43e0513c00d697e941f1915c3e678f2407fa4dfb449061
Jun 03 14:47:58.432537 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:58.432502    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-mc6qb" event={"ID":"b8fde437-9d4d-4d5e-9e67-5c152b45fd73","Type":"ContainerStarted","Data":"7e5e6245ffd5a9ec0f43e0513c00d697e941f1915c3e678f2407fa4dfb449061"}
Jun 03 14:47:58.713602 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:47:58.713565    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:47:58.713784 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:58.713736    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 14:47:58.713842 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:47:58.713810    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls podName:43cc2ba3-2e08-4c3d-964b-db460ad9b027 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:00.713786918 +0000 UTC m=+156.230580024 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv47q" (UID: "43cc2ba3-2e08-4c3d-964b-db460ad9b027") : secret "insights-runtime-extractor-tls" not found
Jun 03 14:48:00.438921 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:00.438882    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-685df94d57-mc6qb" event={"ID":"b8fde437-9d4d-4d5e-9e67-5c152b45fd73","Type":"ContainerStarted","Data":"08a1ad656f799382322fe7d85cbec4c451a11d2e420a536e291dc5dfcadfe074"}
Jun 03 14:48:00.464150 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:00.464096    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-service-ca/service-ca-685df94d57-mc6qb" podStartSLOduration=1.48950522 podStartE2EDuration="3.464083062s" podCreationTimestamp="2026-06-03 14:47:57 +0000 UTC" firstStartedPulling="2026-06-03 14:47:57.872645917 +0000 UTC m=+153.389438950" lastFinishedPulling="2026-06-03 14:47:59.847223742 +0000 UTC m=+155.364016792" observedRunningTime="2026-06-03 14:48:00.462187503 +0000 UTC m=+155.978980557" watchObservedRunningTime="2026-06-03 14:48:00.464083062 +0000 UTC m=+155.980876117"
Jun 03 14:48:00.731320 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:00.731284    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:48:00.731493 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:00.731425    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 14:48:00.731493 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:00.731487    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls podName:43cc2ba3-2e08-4c3d-964b-db460ad9b027 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:04.731472227 +0000 UTC m=+160.248265264 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv47q" (UID: "43cc2ba3-2e08-4c3d-964b-db460ad9b027") : secret "insights-runtime-extractor-tls" not found
Jun 03 14:48:01.896728 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:01.896655    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-z5f9m" podUID="54728720-211f-4a83-ab10-ba0fde28f34a"
Jun 03 14:48:01.903817 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:01.903791    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-ingress-canary/ingress-canary-mcckm" podUID="d40ccee8-3333-411b-8b01-2a2707cfa56f"
Jun 03 14:48:02.443658 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:02.443572    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:48:02.443840 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:02.443577    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:48:03.050261 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:03.050225    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-fbcfw" podUID="6c806192-8385-493c-acc6-b3dfa7ca4ef4"
Jun 03 14:48:03.554901 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:03.554870    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:03.555076 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:03.555001    2576 projected.go:264] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jun 03 14:48:03.555076 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:03.555017    2576 projected.go:194] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7dddbdf9b9-5kt92: secret "image-registry-tls" not found
Jun 03 14:48:03.555076 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:03.555065    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls podName:d0bef055-8950-44cf-b4d6-e6b171055edc nodeName:}" failed. No retries permitted until 2026-06-03 14:48:19.555050226 +0000 UTC m=+175.071843266 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls") pod "image-registry-7dddbdf9b9-5kt92" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc") : secret "image-registry-tls" not found
Jun 03 14:48:04.764481 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:04.764441    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:48:04.764881 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:04.764596    2576 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jun 03 14:48:04.764881 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:04.764655    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls podName:43cc2ba3-2e08-4c3d-964b-db460ad9b027 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:12.764639621 +0000 UTC m=+168.281432670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls") pod "insights-runtime-extractor-sv47q" (UID: "43cc2ba3-2e08-4c3d-964b-db460ad9b027") : secret "insights-runtime-extractor-tls" not found
Jun 03 14:48:06.039518 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.039487    2576 scope.go:117] "RemoveContainer" containerID="055769402f65dafaeb8e967bbe9b9e4c91b9e66c0f54918557d0e0a4828eed59"
Jun 03 14:48:06.455211 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.455184    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 14:48:06.455373 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.455250    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" event={"ID":"7317b775-d822-4530-b5fb-65c35ca3e8b0","Type":"ContainerStarted","Data":"fd77b45a38602b91263cacbecca197bdc5d9a4a728d473f241e1457094ed8102"}
Jun 03 14:48:06.455540 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.455518    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:48:06.489100 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.489058    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7" podStartSLOduration=20.951341601 podStartE2EDuration="23.489043957s" podCreationTimestamp="2026-06-03 14:47:43 +0000 UTC" firstStartedPulling="2026-06-03 14:47:44.174927095 +0000 UTC m=+139.691720131" lastFinishedPulling="2026-06-03 14:47:46.712629451 +0000 UTC m=+142.229422487" observedRunningTime="2026-06-03 14:48:06.488343581 +0000 UTC m=+162.005136636" watchObservedRunningTime="2026-06-03 14:48:06.489043957 +0000 UTC m=+162.005837012"
Jun 03 14:48:06.778629 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.778536    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:48:06.778629 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.778588    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:48:06.780858 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.780830    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/54728720-211f-4a83-ab10-ba0fde28f34a-metrics-tls\") pod \"dns-default-z5f9m\" (UID: \"54728720-211f-4a83-ab10-ba0fde28f34a\") " pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:48:06.781150 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.781111    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d40ccee8-3333-411b-8b01-2a2707cfa56f-cert\") pod \"ingress-canary-mcckm\" (UID: \"d40ccee8-3333-411b-8b01-2a2707cfa56f\") " pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:48:06.947438 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.947402    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-ljvdn\""
Jun 03 14:48:06.947588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.947471    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-dkhrx\""
Jun 03 14:48:06.955299 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.955282    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:48:06.955368 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:06.955284    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mcckm"
Jun 03 14:48:07.021953 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:07.021738    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-zz2j7"
Jun 03 14:48:07.104006 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:07.103698    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mcckm"]
Jun 03 14:48:07.106207 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:07.106182    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd40ccee8_3333_411b_8b01_2a2707cfa56f.slice/crio-ff243239f48070b61addf9001742d07d0a2e2c2c1b070b3da1a946643590c2db WatchSource:0}: Error finding container ff243239f48070b61addf9001742d07d0a2e2c2c1b070b3da1a946643590c2db: Status 404 returned error can't find the container with id ff243239f48070b61addf9001742d07d0a2e2c2c1b070b3da1a946643590c2db
Jun 03 14:48:07.121246 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:07.121224    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-z5f9m"]
Jun 03 14:48:07.123982 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:07.123958    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54728720_211f_4a83_ab10_ba0fde28f34a.slice/crio-891384ea92c0b202c9968156f1b68108e311ae96ddebea8579dbce0c5ba2de96 WatchSource:0}: Error finding container 891384ea92c0b202c9968156f1b68108e311ae96ddebea8579dbce0c5ba2de96: Status 404 returned error can't find the container with id 891384ea92c0b202c9968156f1b68108e311ae96ddebea8579dbce0c5ba2de96
Jun 03 14:48:07.458857 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:07.458820    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcckm" event={"ID":"d40ccee8-3333-411b-8b01-2a2707cfa56f","Type":"ContainerStarted","Data":"ff243239f48070b61addf9001742d07d0a2e2c2c1b070b3da1a946643590c2db"}
Jun 03 14:48:07.459866 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:07.459827    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5f9m" event={"ID":"54728720-211f-4a83-ab10-ba0fde28f34a","Type":"ContainerStarted","Data":"891384ea92c0b202c9968156f1b68108e311ae96ddebea8579dbce0c5ba2de96"}
Jun 03 14:48:09.465974 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:09.465941    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5f9m" event={"ID":"54728720-211f-4a83-ab10-ba0fde28f34a","Type":"ContainerStarted","Data":"02ba4616ac448bd572c9448f9a4f8274f78b4e03d148d0dd7e5dc5af30fc0ef8"}
Jun 03 14:48:09.465974 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:09.465976    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-z5f9m" event={"ID":"54728720-211f-4a83-ab10-ba0fde28f34a","Type":"ContainerStarted","Data":"89d94f4198bdc8016bc97db87e072b10874cd68e2bc2992f7e57b79432f7d0c7"}
Jun 03 14:48:09.466349 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:09.466062    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:48:09.484201 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:09.484161    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-z5f9m" podStartSLOduration=129.742139652 podStartE2EDuration="2m11.484148921s" podCreationTimestamp="2026-06-03 14:45:58 +0000 UTC" firstStartedPulling="2026-06-03 14:48:07.12576656 +0000 UTC m=+162.642559600" lastFinishedPulling="2026-06-03 14:48:08.86777583 +0000 UTC m=+164.384568869" observedRunningTime="2026-06-03 14:48:09.483442739 +0000 UTC m=+165.000235795" watchObservedRunningTime="2026-06-03 14:48:09.484148921 +0000 UTC m=+165.000941970"
Jun 03 14:48:10.470092 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:10.470055    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mcckm" event={"ID":"d40ccee8-3333-411b-8b01-2a2707cfa56f","Type":"ContainerStarted","Data":"678c5b6dd6cbf3f82a01fd42223282652a75b00837ea6808496ab56d8aba567d"}
Jun 03 14:48:10.489014 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:10.488970    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mcckm" podStartSLOduration=130.107574381 podStartE2EDuration="2m12.488956326s" podCreationTimestamp="2026-06-03 14:45:58 +0000 UTC" firstStartedPulling="2026-06-03 14:48:07.108110914 +0000 UTC m=+162.624903949" lastFinishedPulling="2026-06-03 14:48:09.489492855 +0000 UTC m=+165.006285894" observedRunningTime="2026-06-03 14:48:10.48834958 +0000 UTC m=+166.005142635" watchObservedRunningTime="2026-06-03 14:48:10.488956326 +0000 UTC m=+166.005749380"
Jun 03 14:48:11.518360 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:11.518331    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:48:11.520800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:11.520762    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/d10cc6e5-f695-4031-90cd-9824659fba3b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-69b6cbdb88-9mwdn\" (UID: \"d10cc6e5-f695-4031-90cd-9824659fba3b\") " pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:48:11.765722 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:11.765690    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"
Jun 03 14:48:11.888815 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:11.888780    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn"]
Jun 03 14:48:11.891658 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:11.891627    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd10cc6e5_f695_4031_90cd_9824659fba3b.slice/crio-a83eaa3d0f1e1cdc1bc43a9022ea61654a49ab785b94d9fe590005a508685f0f WatchSource:0}: Error finding container a83eaa3d0f1e1cdc1bc43a9022ea61654a49ab785b94d9fe590005a508685f0f: Status 404 returned error can't find the container with id a83eaa3d0f1e1cdc1bc43a9022ea61654a49ab785b94d9fe590005a508685f0f
Jun 03 14:48:12.475897 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:12.475862    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn" event={"ID":"d10cc6e5-f695-4031-90cd-9824659fba3b","Type":"ContainerStarted","Data":"a83eaa3d0f1e1cdc1bc43a9022ea61654a49ab785b94d9fe590005a508685f0f"}
Jun 03 14:48:12.828703 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:12.828627    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:48:12.830820 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:12.830798    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/43cc2ba3-2e08-4c3d-964b-db460ad9b027-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-sv47q\" (UID: \"43cc2ba3-2e08-4c3d-964b-db460ad9b027\") " pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:48:12.837942 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:12.837920    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-sv47q"
Jun 03 14:48:12.969239 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:12.969202    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-sv47q"]
Jun 03 14:48:12.973176 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:12.973088    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43cc2ba3_2e08_4c3d_964b_db460ad9b027.slice/crio-d00462dad6612ce7cbce309c4bb7945e5bd3b5911c17c7e30cec5099b84baee6 WatchSource:0}: Error finding container d00462dad6612ce7cbce309c4bb7945e5bd3b5911c17c7e30cec5099b84baee6: Status 404 returned error can't find the container with id d00462dad6612ce7cbce309c4bb7945e5bd3b5911c17c7e30cec5099b84baee6
Jun 03 14:48:13.480333 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:13.480294    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv47q" event={"ID":"43cc2ba3-2e08-4c3d-964b-db460ad9b027","Type":"ContainerStarted","Data":"f906f0a3e29a02370bf8452f56ae8aa2ba80cf2a19122050bc13b38e4b8b9664"}
Jun 03 14:48:13.480333 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:13.480337    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv47q" event={"ID":"43cc2ba3-2e08-4c3d-964b-db460ad9b027","Type":"ContainerStarted","Data":"d00462dad6612ce7cbce309c4bb7945e5bd3b5911c17c7e30cec5099b84baee6"}
Jun 03 14:48:14.484420 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:14.484382    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv47q" event={"ID":"43cc2ba3-2e08-4c3d-964b-db460ad9b027","Type":"ContainerStarted","Data":"b9889cdd53b89a7037da1848e992298fb587f79a36dab9eb78bba0c390d8b479"}
Jun 03 14:48:14.485824 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:14.485797    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn" event={"ID":"d10cc6e5-f695-4031-90cd-9824659fba3b","Type":"ContainerStarted","Data":"aaac968737f6efcd43de729e34b276d1bf7c58a66188f4b9c3a0c977781c4475"}
Jun 03 14:48:14.504831 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:14.504787    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-69b6cbdb88-9mwdn" podStartSLOduration=33.581346338 podStartE2EDuration="35.504774983s" podCreationTimestamp="2026-06-03 14:47:39 +0000 UTC" firstStartedPulling="2026-06-03 14:48:11.893929241 +0000 UTC m=+167.410722275" lastFinishedPulling="2026-06-03 14:48:13.817357883 +0000 UTC m=+169.334150920" observedRunningTime="2026-06-03 14:48:14.504575093 +0000 UTC m=+170.021368149" watchObservedRunningTime="2026-06-03 14:48:14.504774983 +0000 UTC m=+170.021568038"
Jun 03 14:48:16.494346 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:16.494308    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-sv47q" event={"ID":"43cc2ba3-2e08-4c3d-964b-db460ad9b027","Type":"ContainerStarted","Data":"719947d1d169ed51fbf4f6ff98321d86f17869f765e62da79ae8d115d4203e52"}
Jun 03 14:48:16.513694 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:16.513649    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-sv47q" podStartSLOduration=17.889854924 podStartE2EDuration="20.513634159s" podCreationTimestamp="2026-06-03 14:47:56 +0000 UTC" firstStartedPulling="2026-06-03 14:48:13.047251842 +0000 UTC m=+168.564044882" lastFinishedPulling="2026-06-03 14:48:15.671031071 +0000 UTC m=+171.187824117" observedRunningTime="2026-06-03 14:48:16.513356063 +0000 UTC m=+172.030149118" watchObservedRunningTime="2026-06-03 14:48:16.513634159 +0000 UTC m=+172.030427213"
Jun 03 14:48:18.038842 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:18.038802    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:48:19.472581 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:19.472547    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-z5f9m"
Jun 03 14:48:19.583783 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:19.583751    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:19.586100 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:19.586072    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"image-registry-7dddbdf9b9-5kt92\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") " pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:19.770542 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:19.770453    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:19.896355 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:19.896288    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7dddbdf9b9-5kt92"]
Jun 03 14:48:19.899739 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:19.899711    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0bef055_8950_44cf_b4d6_e6b171055edc.slice/crio-b6bcd910e987011a3aaabc769b5c359da226420522882421cec17e5baf91f6d7 WatchSource:0}: Error finding container b6bcd910e987011a3aaabc769b5c359da226420522882421cec17e5baf91f6d7: Status 404 returned error can't find the container with id b6bcd910e987011a3aaabc769b5c359da226420522882421cec17e5baf91f6d7
Jun 03 14:48:20.457813 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.457779    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dddbdf9b9-5kt92"]
Jun 03 14:48:20.505440 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.505408    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92" event={"ID":"d0bef055-8950-44cf-b4d6-e6b171055edc","Type":"ContainerStarted","Data":"e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911"}
Jun 03 14:48:20.505828 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.505445    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92" event={"ID":"d0bef055-8950-44cf-b4d6-e6b171055edc","Type":"ContainerStarted","Data":"b6bcd910e987011a3aaabc769b5c359da226420522882421cec17e5baf91f6d7"}
Jun 03 14:48:20.505828 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.505557    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:20.512852 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.512822    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-75f7c59bfb-6b5qh"]
Jun 03 14:48:20.515788 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.515769    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.526307 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.526285    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75f7c59bfb-6b5qh"]
Jun 03 14:48:20.529632 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.529600    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92" podStartSLOduration=33.529587355 podStartE2EDuration="33.529587355s" podCreationTimestamp="2026-06-03 14:47:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:48:20.528766937 +0000 UTC m=+176.045559997" watchObservedRunningTime="2026-06-03 14:48:20.529587355 +0000 UTC m=+176.046380410"
Jun 03 14:48:20.607781 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.607753    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6016ff8-2d60-469e-b6b0-640da22361f6-installation-pull-secrets\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.607781 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.607782    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-bound-sa-token\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.607989 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.607834    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6016ff8-2d60-469e-b6b0-640da22361f6-registry-certificates\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.607989 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.607855    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6016ff8-2d60-469e-b6b0-640da22361f6-ca-trust-extracted\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.608077 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.608049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6016ff8-2d60-469e-b6b0-640da22361f6-image-registry-private-configuration\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.608184 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.608161    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-registry-tls\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.608247 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.608231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6016ff8-2d60-469e-b6b0-640da22361f6-trusted-ca\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.608306 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.608266    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ttmx5\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-kube-api-access-ttmx5\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709235 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709144    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-registry-tls\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709235 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709194    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6016ff8-2d60-469e-b6b0-640da22361f6-trusted-ca\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709235 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709226    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ttmx5\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-kube-api-access-ttmx5\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709510 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709279    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6016ff8-2d60-469e-b6b0-640da22361f6-installation-pull-secrets\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709510 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709306    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-bound-sa-token\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709510 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709358    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6016ff8-2d60-469e-b6b0-640da22361f6-registry-certificates\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709510 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709380    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6016ff8-2d60-469e-b6b0-640da22361f6-ca-trust-extracted\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.709510 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709439    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6016ff8-2d60-469e-b6b0-640da22361f6-image-registry-private-configuration\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.710045 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.709964    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f6016ff8-2d60-469e-b6b0-640da22361f6-ca-trust-extracted\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.710251 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.710227    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f6016ff8-2d60-469e-b6b0-640da22361f6-trusted-ca\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.710386 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.710362    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f6016ff8-2d60-469e-b6b0-640da22361f6-registry-certificates\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.711719 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.711692    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-registry-tls\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.711819 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.711699    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f6016ff8-2d60-469e-b6b0-640da22361f6-installation-pull-secrets\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.711892 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.711874    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f6016ff8-2d60-469e-b6b0-640da22361f6-image-registry-private-configuration\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.719516 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.719493    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-bound-sa-token\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.719605 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.719548    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ttmx5\" (UniqueName: \"kubernetes.io/projected/f6016ff8-2d60-469e-b6b0-640da22361f6-kube-api-access-ttmx5\") pod \"image-registry-75f7c59bfb-6b5qh\" (UID: \"f6016ff8-2d60-469e-b6b0-640da22361f6\") " pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.824394 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.824366    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:20.944390 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:20.944361    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-75f7c59bfb-6b5qh"]
Jun 03 14:48:20.947784 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:20.947756    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6016ff8_2d60_469e_b6b0_640da22361f6.slice/crio-88d40cd6fe53e4f14304bea914f383bfb5f3f8457c1a3b85d0b3d8f8ccdd6722 WatchSource:0}: Error finding container 88d40cd6fe53e4f14304bea914f383bfb5f3f8457c1a3b85d0b3d8f8ccdd6722: Status 404 returned error can't find the container with id 88d40cd6fe53e4f14304bea914f383bfb5f3f8457c1a3b85d0b3d8f8ccdd6722
Jun 03 14:48:21.509639 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:21.509606    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh" event={"ID":"f6016ff8-2d60-469e-b6b0-640da22361f6","Type":"ContainerStarted","Data":"7ce3ff7b56c88503009be59cadcf2c96f8e87fee6b772b49519fcf56bcb08633"}
Jun 03 14:48:21.509639 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:21.509641    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh" event={"ID":"f6016ff8-2d60-469e-b6b0-640da22361f6","Type":"ContainerStarted","Data":"88d40cd6fe53e4f14304bea914f383bfb5f3f8457c1a3b85d0b3d8f8ccdd6722"}
Jun 03 14:48:21.536155 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:21.534931    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh" podStartSLOduration=1.534914026 podStartE2EDuration="1.534914026s" podCreationTimestamp="2026-06-03 14:48:20 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:48:21.532979763 +0000 UTC m=+177.049772820" watchObservedRunningTime="2026-06-03 14:48:21.534914026 +0000 UTC m=+177.051707082"
Jun 03 14:48:22.512672 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:22.512634    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:28.748053 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.748015    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-r67qr"]
Jun 03 14:48:28.751919 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.751899    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.755603 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.755580    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-x862p\""
Jun 03 14:48:28.755743 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.755578    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 03 14:48:28.755743 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.755587    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 03 14:48:28.756146 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.756120    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 03 14:48:28.763755 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.763736    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-r67qr"]
Jun 03 14:48:28.783103 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.783080    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"]
Jun 03 14:48:28.785225 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.785211    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.787496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.787474    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-g67j6"]
Jun 03 14:48:28.787739 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.787719    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\""
Jun 03 14:48:28.787846 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.787774    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\""
Jun 03 14:48:28.787846 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.787792    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-27kmc\""
Jun 03 14:48:28.788111 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.788095    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\""
Jun 03 14:48:28.789889 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.789874    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.792243 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.792220    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 03 14:48:28.792347 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.792230    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 03 14:48:28.792400 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.792382    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 03 14:48:28.792506 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.792491    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xzc4b\""
Jun 03 14:48:28.800053 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.799962    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"]
Jun 03 14:48:28.876165 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876136    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beeab172-f2f6-402a-ad04-8fe9f8cebf04-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.876316 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876171    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73140bba-fedb-47be-bc7f-3362ea597efc-metrics-client-ca\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876316 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-sys\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876316 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.876316 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876313    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.876477 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876338    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bmwg\" (UniqueName: \"kubernetes.io/projected/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-api-access-2bmwg\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.876477 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876369    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cx8ps\" (UniqueName: \"kubernetes.io/projected/beeab172-f2f6-402a-ad04-8fe9f8cebf04-kube-api-access-cx8ps\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.876477 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-wtmp\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876477 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.876477 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876449    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-tls\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876663 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876481    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.876663 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876522    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-textfile\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876663 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876540    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876663 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876563    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.876663 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876603    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-accelerators-collector-config\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876663 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876628    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.876868 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876663    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-root\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.876868 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876704    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.876868 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.876768    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzsfb\" (UniqueName: \"kubernetes.io/projected/73140bba-fedb-47be-bc7f-3362ea597efc-kube-api-access-hzsfb\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.978118 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978083    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.978118 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978121    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-textfile\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.978343 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978154    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.978343 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978179    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.978343 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978229    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-accelerators-collector-config\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.978497 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978466    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-textfile\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.978640 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978606    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.978712 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978658    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-root\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.978712 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978686    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.978811 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978720    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzsfb\" (UniqueName: \"kubernetes.io/projected/73140bba-fedb-47be-bc7f-3362ea597efc-kube-api-access-hzsfb\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.978811 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978750    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beeab172-f2f6-402a-ad04-8fe9f8cebf04-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.978811 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:28.978767    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 03 14:48:28.978811 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978776    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73140bba-fedb-47be-bc7f-3362ea597efc-metrics-client-ca\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978808    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-accelerators-collector-config\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978819    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-sys\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978847    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978871    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978898    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2bmwg\" (UniqueName: \"kubernetes.io/projected/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-api-access-2bmwg\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978936    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cx8ps\" (UniqueName: \"kubernetes.io/projected/beeab172-f2f6-402a-ad04-8fe9f8cebf04-kube-api-access-cx8ps\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978968    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-wtmp\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.979001 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.978997    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.979423 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979038    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-tls\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.979423 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979182    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.979423 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979328    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-volume-directive-shadow\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.979423 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979392    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-root\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.979628 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979460    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/beeab172-f2f6-402a-ad04-8fe9f8cebf04-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.979742 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979720    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-wtmp\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.979916 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979894    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-metrics-client-ca\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.980383 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.979910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/73140bba-fedb-47be-bc7f-3362ea597efc-sys\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.980383 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:28.980097    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls podName:beeab172-f2f6-402a-ad04-8fe9f8cebf04 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:29.480072953 +0000 UTC m=+184.996865993 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-r67qr" (UID: "beeab172-f2f6-402a-ad04-8fe9f8cebf04") : secret "openshift-state-metrics-tls" not found
Jun 03 14:48:28.980383 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.980360    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/73140bba-fedb-47be-bc7f-3362ea597efc-metrics-client-ca\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.981897 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.981877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-tls\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.982048 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.981899    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/73140bba-fedb-47be-bc7f-3362ea597efc-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.982153 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.981958    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.982311 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.982290    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.982746 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.982732    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-state-metrics-tls\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:28.990075 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.990055    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzsfb\" (UniqueName: \"kubernetes.io/projected/73140bba-fedb-47be-bc7f-3362ea597efc-kube-api-access-hzsfb\") pod \"node-exporter-g67j6\" (UID: \"73140bba-fedb-47be-bc7f-3362ea597efc\") " pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:28.990467 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.990447    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cx8ps\" (UniqueName: \"kubernetes.io/projected/beeab172-f2f6-402a-ad04-8fe9f8cebf04-kube-api-access-cx8ps\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:28.991273 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:28.991255    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bmwg\" (UniqueName: \"kubernetes.io/projected/7421bfa0-3cfc-4579-b0d9-64aea57e5ff8-kube-api-access-2bmwg\") pod \"kube-state-metrics-8469c486bb-mlkkt\" (UID: \"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8\") " pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:29.095996 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.095925    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"
Jun 03 14:48:29.102675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.102647    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-g67j6"
Jun 03 14:48:29.113960 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:29.113905    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73140bba_fedb_47be_bc7f_3362ea597efc.slice/crio-478f66f43005836381bfd69e274a3ff2f8184aedbd45bd868b5c842d981f8a87 WatchSource:0}: Error finding container 478f66f43005836381bfd69e274a3ff2f8184aedbd45bd868b5c842d981f8a87: Status 404 returned error can't find the container with id 478f66f43005836381bfd69e274a3ff2f8184aedbd45bd868b5c842d981f8a87
Jun 03 14:48:29.237973 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.237940    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt"]
Jun 03 14:48:29.240461 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:29.240427    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7421bfa0_3cfc_4579_b0d9_64aea57e5ff8.slice/crio-65d6dfccb5eb2db65ce343c14a9e65154bf5292ab54f5848f63865aec1bae7e6 WatchSource:0}: Error finding container 65d6dfccb5eb2db65ce343c14a9e65154bf5292ab54f5848f63865aec1bae7e6: Status 404 returned error can't find the container with id 65d6dfccb5eb2db65ce343c14a9e65154bf5292ab54f5848f63865aec1bae7e6
Jun 03 14:48:29.484666 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.484637    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:29.484839 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:29.484764    2576 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found
Jun 03 14:48:29.484839 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:29.484821    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls podName:beeab172-f2f6-402a-ad04-8fe9f8cebf04 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:30.484804443 +0000 UTC m=+186.001597489 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls") pod "openshift-state-metrics-85658796db-r67qr" (UID: "beeab172-f2f6-402a-ad04-8fe9f8cebf04") : secret "openshift-state-metrics-tls" not found
Jun 03 14:48:29.530351 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.530296    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt" event={"ID":"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8","Type":"ContainerStarted","Data":"65d6dfccb5eb2db65ce343c14a9e65154bf5292ab54f5848f63865aec1bae7e6"}
Jun 03 14:48:29.531370 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.531347    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g67j6" event={"ID":"73140bba-fedb-47be-bc7f-3362ea597efc","Type":"ContainerStarted","Data":"478f66f43005836381bfd69e274a3ff2f8184aedbd45bd868b5c842d981f8a87"}
Jun 03 14:48:29.818641 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.818498    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:48:29.822275 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.822250    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.824987 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.824628    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 14:48:29.824987 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.824771    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 14:48:29.824987 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.824922    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 14:48:29.825236 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.825050    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 14:48:29.825705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.825315    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 14:48:29.825705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.825359    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 14:48:29.825705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.825393    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 14:48:29.825705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.825450    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9j8fs\""
Jun 03 14:48:29.825705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.825548    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 14:48:29.825705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.825645    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 14:48:29.835653 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.835631    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:48:29.990081 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990049    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990260 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990103    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990260 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990169    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990260 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990204    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cbszl\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-kube-api-access-cbszl\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990260 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990246    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-out\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990271    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990331    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990394    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990689 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990479    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-web-config\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990689 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990511    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:29.990689 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:29.990538    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092043 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.091949    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092043 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092007    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-cbszl\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-kube-api-access-cbszl\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092288 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092047    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-out\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092288 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092073    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092288 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092148    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092288 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092212    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092288 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092240    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092288 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092265    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092288 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092290    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-web-config\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092614 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092319    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092614 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092342    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092614 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092366    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.092614 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.092397    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.093325 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:30.092933    2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 03 14:48:30.093325 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:30.093002    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls podName:0e8dcc1e-a906-4ac7-b52e-8f51311060b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:30.592982491 +0000 UTC m=+186.109775540 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6") : secret "alertmanager-main-tls" not found
Jun 03 14:48:30.093886 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.093860    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.095557 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:30.094583    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle podName:0e8dcc1e-a906-4ac7-b52e-8f51311060b6 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:30.59456203 +0000 UTC m=+186.111355065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6") : configmap references non-existent config key: ca-bundle.crt
Jun 03 14:48:30.095557 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.095195    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.096149 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.096073    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-out\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.096149 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.096115    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.097923 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.097882    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-volume\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.098540 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.098496    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.099599 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.099370    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.099599 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.099531    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.099766 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.099746    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.112875 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.112851    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-web-config\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.125448 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.125404    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cbszl\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-kube-api-access-cbszl\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.496598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.496562    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:30.499281 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.499253    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/beeab172-f2f6-402a-ad04-8fe9f8cebf04-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-r67qr\" (UID: \"beeab172-f2f6-402a-ad04-8fe9f8cebf04\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:30.535400 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.535365    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g67j6" event={"ID":"73140bba-fedb-47be-bc7f-3362ea597efc","Type":"ContainerStarted","Data":"0f3922aab079d67a7818b03121c209f2d4d00cb009902a049ef9df78cbdb2a2f"}
Jun 03 14:48:30.562831 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.562801    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr"
Jun 03 14:48:30.597782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.597758    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.597914 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.597826    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.598718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.598687    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.600476 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.600457    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.735669 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.735392    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:48:30.737267 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.737242    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"]
Jun 03 14:48:30.744568 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.744545    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.747856 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.747679    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 03 14:48:30.747946 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.747934    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 03 14:48:30.749950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.748398    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-87vv2ch15lt8i\""
Jun 03 14:48:30.749950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.748489    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-zqpbl\""
Jun 03 14:48:30.749950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.748595    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 03 14:48:30.749950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.748697    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 03 14:48:30.749950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.748893    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 03 14:48:30.753030 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.752685    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"]
Jun 03 14:48:30.772951 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.772850    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-r67qr"]
Jun 03 14:48:30.779238 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:30.779202    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbeeab172_f2f6_402a_ad04_8fe9f8cebf04.slice/crio-4b5adc4e3698c38e30782aad00229faaaf2997431b9d464468465a76384da361 WatchSource:0}: Error finding container 4b5adc4e3698c38e30782aad00229faaaf2997431b9d464468465a76384da361: Status 404 returned error can't find the container with id 4b5adc4e3698c38e30782aad00229faaaf2997431b9d464468465a76384da361
Jun 03 14:48:30.907494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907387    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.907494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907421    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.907494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907464    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-tls\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.907965 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907498    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s55z2\" (UniqueName: \"kubernetes.io/projected/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-kube-api-access-s55z2\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.907965 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907558    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-grpc-tls\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.907965 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907594    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.907965 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907635    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-metrics-client-ca\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.907965 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.907698    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:30.921162 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:30.920832    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:48:30.926537 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:30.926491    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e8dcc1e_a906_4ac7_b52e_8f51311060b6.slice/crio-d99daeb53b5b5f69961920831fbaca94ae264524c16796e8ddbff5a0ed672d00 WatchSource:0}: Error finding container d99daeb53b5b5f69961920831fbaca94ae264524c16796e8ddbff5a0ed672d00: Status 404 returned error can't find the container with id d99daeb53b5b5f69961920831fbaca94ae264524c16796e8ddbff5a0ed672d00
Jun 03 14:48:31.008648 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008616    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.008810 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008658    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-metrics-client-ca\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.008810 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008718    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.008810 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008770    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.008810 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008794    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.008972 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008825    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-tls\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.008972 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008854    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-s55z2\" (UniqueName: \"kubernetes.io/projected/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-kube-api-access-s55z2\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.008972 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.008903    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-grpc-tls\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.009611 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.009584    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-metrics-client-ca\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.012566 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.012052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.012566 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.012288    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.012566 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.012526    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-grpc-tls\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.012566 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.012553    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.012823 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.012672    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.014735 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.014710    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-secret-thanos-querier-tls\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.017664 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.017639    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s55z2\" (UniqueName: \"kubernetes.io/projected/d5850d7f-56be-4188-ae4c-133f8bbfd3c0-kube-api-access-s55z2\") pod \"thanos-querier-6b47fb5ff-5g5mz\" (UID: \"d5850d7f-56be-4188-ae4c-133f8bbfd3c0\") " pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.070724 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.070704    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:31.198008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.197978    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"]
Jun 03 14:48:31.201306 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:31.201280    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5850d7f_56be_4188_ae4c_133f8bbfd3c0.slice/crio-dd56054ec4c29e1c1a17357f5986e39c4fa25b5207475e7eb2be93a7993faaf8 WatchSource:0}: Error finding container dd56054ec4c29e1c1a17357f5986e39c4fa25b5207475e7eb2be93a7993faaf8: Status 404 returned error can't find the container with id dd56054ec4c29e1c1a17357f5986e39c4fa25b5207475e7eb2be93a7993faaf8
Jun 03 14:48:31.539967 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.539876    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt" event={"ID":"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8","Type":"ContainerStarted","Data":"5aafb324334203a047f75fc422b8c8e2c17bdf3d69468f8314dc12366862775f"}
Jun 03 14:48:31.539967 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.539922    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt" event={"ID":"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8","Type":"ContainerStarted","Data":"6db1494d19505a3051df68bc71a8180430bc63cdf98eb304fd7bb5698ee16162"}
Jun 03 14:48:31.539967 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.539937    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt" event={"ID":"7421bfa0-3cfc-4579-b0d9-64aea57e5ff8","Type":"ContainerStarted","Data":"198acad9f8077eefc719dff7bea6259208182f92b7b90b6f31908be2a293b1ed"}
Jun 03 14:48:31.540912 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.540886    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" event={"ID":"d5850d7f-56be-4188-ae4c-133f8bbfd3c0","Type":"ContainerStarted","Data":"dd56054ec4c29e1c1a17357f5986e39c4fa25b5207475e7eb2be93a7993faaf8"}
Jun 03 14:48:31.542014 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.541991    2576 generic.go:358] "Generic (PLEG): container finished" podID="73140bba-fedb-47be-bc7f-3362ea597efc" containerID="0f3922aab079d67a7818b03121c209f2d4d00cb009902a049ef9df78cbdb2a2f" exitCode=0
Jun 03 14:48:31.542100 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.542049    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g67j6" event={"ID":"73140bba-fedb-47be-bc7f-3362ea597efc","Type":"ContainerDied","Data":"0f3922aab079d67a7818b03121c209f2d4d00cb009902a049ef9df78cbdb2a2f"}
Jun 03 14:48:31.543026 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.543005    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerStarted","Data":"d99daeb53b5b5f69961920831fbaca94ae264524c16796e8ddbff5a0ed672d00"}
Jun 03 14:48:31.544591 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.544573    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr" event={"ID":"beeab172-f2f6-402a-ad04-8fe9f8cebf04","Type":"ContainerStarted","Data":"be98a3e0b99876b87c52c20f7d1dac32419c0353d9159081ac90341c2b8bb50d"}
Jun 03 14:48:31.544691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.544595    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr" event={"ID":"beeab172-f2f6-402a-ad04-8fe9f8cebf04","Type":"ContainerStarted","Data":"74c5cca17ef6eb60990c89a4c8391f4d532ea008015351987fd4bc1c0543429d"}
Jun 03 14:48:31.544691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.544604    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr" event={"ID":"beeab172-f2f6-402a-ad04-8fe9f8cebf04","Type":"ContainerStarted","Data":"4b5adc4e3698c38e30782aad00229faaaf2997431b9d464468465a76384da361"}
Jun 03 14:48:31.560454 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:31.560417    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-8469c486bb-mlkkt" podStartSLOduration=2.138779449 podStartE2EDuration="3.560406379s" podCreationTimestamp="2026-06-03 14:48:28 +0000 UTC" firstStartedPulling="2026-06-03 14:48:29.242347393 +0000 UTC m=+184.759140427" lastFinishedPulling="2026-06-03 14:48:30.663974321 +0000 UTC m=+186.180767357" observedRunningTime="2026-06-03 14:48:31.559530109 +0000 UTC m=+187.076323168" watchObservedRunningTime="2026-06-03 14:48:31.560406379 +0000 UTC m=+187.077199434"
Jun 03 14:48:32.550289 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:32.550256    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g67j6" event={"ID":"73140bba-fedb-47be-bc7f-3362ea597efc","Type":"ContainerStarted","Data":"915f5ae8f35ffa79f822a63cc81332fd693eeb39af76eb5fb6174d14ebeab528"}
Jun 03 14:48:32.550718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:32.550296    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-g67j6" event={"ID":"73140bba-fedb-47be-bc7f-3362ea597efc","Type":"ContainerStarted","Data":"24ce6020128134fdc0937b8200a70e33b86a67b5eb7220bf64edeaacf280560c"}
Jun 03 14:48:32.552381 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:32.552352    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr" event={"ID":"beeab172-f2f6-402a-ad04-8fe9f8cebf04","Type":"ContainerStarted","Data":"bae03add10ff840c9e4bfff8e9dbcf458e0da735df85db1540ffbc8b625ae1ae"}
Jun 03 14:48:32.572207 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:32.572165    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-g67j6" podStartSLOduration=3.425179877 podStartE2EDuration="4.572151186s" podCreationTimestamp="2026-06-03 14:48:28 +0000 UTC" firstStartedPulling="2026-06-03 14:48:29.115375599 +0000 UTC m=+184.632168636" lastFinishedPulling="2026-06-03 14:48:30.262346913 +0000 UTC m=+185.779139945" observedRunningTime="2026-06-03 14:48:32.570810267 +0000 UTC m=+188.087603322" watchObservedRunningTime="2026-06-03 14:48:32.572151186 +0000 UTC m=+188.088944237"
Jun 03 14:48:32.591276 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:32.591236    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-r67qr" podStartSLOduration=3.388626249 podStartE2EDuration="4.591221224s" podCreationTimestamp="2026-06-03 14:48:28 +0000 UTC" firstStartedPulling="2026-06-03 14:48:30.939635267 +0000 UTC m=+186.456428299" lastFinishedPulling="2026-06-03 14:48:32.142230241 +0000 UTC m=+187.659023274" observedRunningTime="2026-06-03 14:48:32.589678146 +0000 UTC m=+188.106471203" watchObservedRunningTime="2026-06-03 14:48:32.591221224 +0000 UTC m=+188.108014301"
Jun 03 14:48:33.528796 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.528767    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"]
Jun 03 14:48:33.550987 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.550956    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"]
Jun 03 14:48:33.551402 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.551069    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:33.553835 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.553815    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-6xsrc\""
Jun 03 14:48:33.553835 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.553816    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 03 14:48:33.556819 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.556783    2576 generic.go:358] "Generic (PLEG): container finished" podID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerID="61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179" exitCode=0
Jun 03 14:48:33.556928 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.556875    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179"}
Jun 03 14:48:33.734096 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.734061    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a20a3bc-6662-4c39-b474-299d3e6191b0-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-z8wwp\" (UID: \"3a20a3bc-6662-4c39-b474-299d3e6191b0\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:33.836356 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:33.836251    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a20a3bc-6662-4c39-b474-299d3e6191b0-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-z8wwp\" (UID: \"3a20a3bc-6662-4c39-b474-299d3e6191b0\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:33.836538 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:33.836404    2576 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found
Jun 03 14:48:33.836538 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:33.836486    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3a20a3bc-6662-4c39-b474-299d3e6191b0-monitoring-plugin-cert podName:3a20a3bc-6662-4c39-b474-299d3e6191b0 nodeName:}" failed. No retries permitted until 2026-06-03 14:48:34.336463137 +0000 UTC m=+189.853256175 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/3a20a3bc-6662-4c39-b474-299d3e6191b0-monitoring-plugin-cert") pod "monitoring-plugin-5768fcc9dd-z8wwp" (UID: "3a20a3bc-6662-4c39-b474-299d3e6191b0") : secret "monitoring-plugin-cert" not found
Jun 03 14:48:34.340819 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:34.340789    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a20a3bc-6662-4c39-b474-299d3e6191b0-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-z8wwp\" (UID: \"3a20a3bc-6662-4c39-b474-299d3e6191b0\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:34.343018 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:34.342993    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3a20a3bc-6662-4c39-b474-299d3e6191b0-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-z8wwp\" (UID: \"3a20a3bc-6662-4c39-b474-299d3e6191b0\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:34.461942 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:34.461912    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:34.562197 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:34.562164    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" event={"ID":"d5850d7f-56be-4188-ae4c-133f8bbfd3c0","Type":"ContainerStarted","Data":"782bd3aebc95ddfe5ed080acc26a047d033789e375b13b6eb2aea883ea123426"}
Jun 03 14:48:34.562600 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:34.562207    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" event={"ID":"d5850d7f-56be-4188-ae4c-133f8bbfd3c0","Type":"ContainerStarted","Data":"dc3591f788fd5b00343eae262f644a31f5d6088b4ebaf8ea23527ac3ed0bfc0e"}
Jun 03 14:48:34.562600 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:34.562219    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" event={"ID":"d5850d7f-56be-4188-ae4c-133f8bbfd3c0","Type":"ContainerStarted","Data":"dbbee9041ef25322dbe3a7fda9fbf95cab326250cfba2611869b716decf70414"}
Jun 03 14:48:34.591632 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:34.591605    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"]
Jun 03 14:48:34.594061 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:34.594034    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a20a3bc_6662_4c39_b474_299d3e6191b0.slice/crio-c8cb21a308f936b9f0153e72cc3be1030073c596f9a181a18dddcdb2c75ca72f WatchSource:0}: Error finding container c8cb21a308f936b9f0153e72cc3be1030073c596f9a181a18dddcdb2c75ca72f: Status 404 returned error can't find the container with id c8cb21a308f936b9f0153e72cc3be1030073c596f9a181a18dddcdb2c75ca72f
Jun 03 14:48:35.568596 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:35.568565    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" event={"ID":"d5850d7f-56be-4188-ae4c-133f8bbfd3c0","Type":"ContainerStarted","Data":"172280660c0bb96f2c927f7632515a66e300b3845f2cb434d33b2f530738b04a"}
Jun 03 14:48:35.570631 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:35.570600    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp" event={"ID":"3a20a3bc-6662-4c39-b474-299d3e6191b0","Type":"ContainerStarted","Data":"c8cb21a308f936b9f0153e72cc3be1030073c596f9a181a18dddcdb2c75ca72f"}
Jun 03 14:48:36.575892 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.575866    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerStarted","Data":"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"}
Jun 03 14:48:36.578738 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.578706    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" event={"ID":"d5850d7f-56be-4188-ae4c-133f8bbfd3c0","Type":"ContainerStarted","Data":"2dcc0a7c59e68f4b289e5d1480fc0ac3bb2d57cf4f44382cc7dc66e8f3137838"}
Jun 03 14:48:36.578840 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.578745    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" event={"ID":"d5850d7f-56be-4188-ae4c-133f8bbfd3c0","Type":"ContainerStarted","Data":"7dbd9cf576c7659c5076c9a11d8126095adb96249214b10d25b452eb7c85dccf"}
Jun 03 14:48:36.579284 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.579106    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:36.580791 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.580767    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp" event={"ID":"3a20a3bc-6662-4c39-b474-299d3e6191b0","Type":"ContainerStarted","Data":"162224798fbe8cb283282f3e98e7c6781fe21ebeeb354b58f14f72ca4999bd28"}
Jun 03 14:48:36.581014 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.580978    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:36.582299 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.582262    2576 patch_prober.go:28] interesting pod/monitoring-plugin-5768fcc9dd-z8wwp container/monitoring-plugin namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.134.0.19:9443/health\": dial tcp 10.134.0.19:9443: connect: connection refused" start-of-body=
Jun 03 14:48:36.582383 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.582311    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp" podUID="3a20a3bc-6662-4c39-b474-299d3e6191b0" containerName="monitoring-plugin" probeResult="failure" output="Get \"https://10.134.0.19:9443/health\": dial tcp 10.134.0.19:9443: connect: connection refused"
Jun 03 14:48:36.607163 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.606647    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz" podStartSLOduration=2.321979002 podStartE2EDuration="6.60663402s" podCreationTimestamp="2026-06-03 14:48:30 +0000 UTC" firstStartedPulling="2026-06-03 14:48:31.203049513 +0000 UTC m=+186.719842546" lastFinishedPulling="2026-06-03 14:48:35.48770453 +0000 UTC m=+191.004497564" observedRunningTime="2026-06-03 14:48:36.604794264 +0000 UTC m=+192.121587319" watchObservedRunningTime="2026-06-03 14:48:36.60663402 +0000 UTC m=+192.123427074"
Jun 03 14:48:36.645151 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:36.645092    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp" podStartSLOduration=1.739137222 podStartE2EDuration="3.645077372s" podCreationTimestamp="2026-06-03 14:48:33 +0000 UTC" firstStartedPulling="2026-06-03 14:48:34.596000024 +0000 UTC m=+190.112793061" lastFinishedPulling="2026-06-03 14:48:36.501940163 +0000 UTC m=+192.018733211" observedRunningTime="2026-06-03 14:48:36.643545058 +0000 UTC m=+192.160338127" watchObservedRunningTime="2026-06-03 14:48:36.645077372 +0000 UTC m=+192.161870426"
Jun 03 14:48:37.586351 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:37.586313    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerStarted","Data":"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"}
Jun 03 14:48:37.586725 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:37.586357    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerStarted","Data":"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"}
Jun 03 14:48:37.586725 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:37.586374    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerStarted","Data":"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"}
Jun 03 14:48:37.586725 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:37.586385    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerStarted","Data":"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"}
Jun 03 14:48:37.586725 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:37.586394    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerStarted","Data":"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"}
Jun 03 14:48:37.590149 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:37.590110    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-z8wwp"
Jun 03 14:48:37.618907 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:37.618858    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.043306453 podStartE2EDuration="8.618845724s" podCreationTimestamp="2026-06-03 14:48:29 +0000 UTC" firstStartedPulling="2026-06-03 14:48:30.92870657 +0000 UTC m=+186.445499606" lastFinishedPulling="2026-06-03 14:48:36.504245841 +0000 UTC m=+192.021038877" observedRunningTime="2026-06-03 14:48:37.617612583 +0000 UTC m=+193.134405640" watchObservedRunningTime="2026-06-03 14:48:37.618845724 +0000 UTC m=+193.135638778"
Jun 03 14:48:39.514231 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.514203    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bcc8c8987-fgvvj"]
Jun 03 14:48:39.529658 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.529631    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.530875 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.530849    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bcc8c8987-fgvvj"]
Jun 03 14:48:39.532360 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.532333    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jun 03 14:48:39.532499 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.532338    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jun 03 14:48:39.532499 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.532465    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-g78wj\""
Jun 03 14:48:39.532593 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.532576    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jun 03 14:48:39.533480 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.533461    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jun 03 14:48:39.533587 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.533559    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jun 03 14:48:39.533587 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.533581    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jun 03 14:48:39.533792 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.533777    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jun 03 14:48:39.538535 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.538512    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jun 03 14:48:39.687184 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.687151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-oauth-serving-cert\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.687184 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.687188    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-567fh\" (UniqueName: \"kubernetes.io/projected/a6428f96-bf18-47c8-889a-d2014a89ee4a-kube-api-access-567fh\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.687390 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.687231    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-service-ca\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.687390 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.687309    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-serving-cert\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.687390 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.687329    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-oauth-config\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.687496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.687419    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-config\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.687496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.687438    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-trusted-ca-bundle\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.788665 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.788588    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-serving-cert\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.788665 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.788622    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-oauth-config\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.788891 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.788671    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-config\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.788891 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.788688    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-trusted-ca-bundle\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.788891 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.788708    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-oauth-serving-cert\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.788891 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.788754    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-567fh\" (UniqueName: \"kubernetes.io/projected/a6428f96-bf18-47c8-889a-d2014a89ee4a-kube-api-access-567fh\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.788891 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.788793    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-service-ca\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.789526 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.789502    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-oauth-serving-cert\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.789638 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.789570    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-service-ca\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.789638 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.789590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-trusted-ca-bundle\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.789743 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.789716    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-config\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.791162 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.791142    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-serving-cert\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.791236 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.791163    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-oauth-config\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.797194 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.797170    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-567fh\" (UniqueName: \"kubernetes.io/projected/a6428f96-bf18-47c8-889a-d2014a89ee4a-kube-api-access-567fh\") pod \"console-6bcc8c8987-fgvvj\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") " pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.840634 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.840604    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:39.962183 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:39.962157    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bcc8c8987-fgvvj"]
Jun 03 14:48:39.964513 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:39.964491    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda6428f96_bf18_47c8_889a_d2014a89ee4a.slice/crio-c3dd9fcf4b6180a91394e585507423eefad295c49ebcbf14ecf712ee53060b72 WatchSource:0}: Error finding container c3dd9fcf4b6180a91394e585507423eefad295c49ebcbf14ecf712ee53060b72: Status 404 returned error can't find the container with id c3dd9fcf4b6180a91394e585507423eefad295c49ebcbf14ecf712ee53060b72
Jun 03 14:48:40.596422 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:40.596385    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc8c8987-fgvvj" event={"ID":"a6428f96-bf18-47c8-889a-d2014a89ee4a","Type":"ContainerStarted","Data":"c3dd9fcf4b6180a91394e585507423eefad295c49ebcbf14ecf712ee53060b72"}
Jun 03 14:48:41.516213 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:41.516183    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:42.591936 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:42.591915    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6b47fb5ff-5g5mz"
Jun 03 14:48:43.519509 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:43.519480    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-75f7c59bfb-6b5qh"
Jun 03 14:48:43.607726 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:43.607687    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc8c8987-fgvvj" event={"ID":"a6428f96-bf18-47c8-889a-d2014a89ee4a","Type":"ContainerStarted","Data":"d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b"}
Jun 03 14:48:43.626076 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:43.626029    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-6bcc8c8987-fgvvj" podStartSLOduration=2.01093222 podStartE2EDuration="4.626015847s" podCreationTimestamp="2026-06-03 14:48:39 +0000 UTC" firstStartedPulling="2026-06-03 14:48:39.966467652 +0000 UTC m=+195.483260685" lastFinishedPulling="2026-06-03 14:48:42.581551275 +0000 UTC m=+198.098344312" observedRunningTime="2026-06-03 14:48:43.624840405 +0000 UTC m=+199.141633461" watchObservedRunningTime="2026-06-03 14:48:43.626015847 +0000 UTC m=+199.142808902"
Jun 03 14:48:44.417934 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.417899    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bcc8c8987-fgvvj"]
Jun 03 14:48:44.445398 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.445367    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-f79dfc856-fhk76"]
Jun 03 14:48:44.447697 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.447681    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.458107 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.458086    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f79dfc856-fhk76"]
Jun 03 14:48:44.534483 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.534450    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bdcsn\" (UniqueName: \"kubernetes.io/projected/ca5c7c60-2b12-40ee-af04-4577a37b6703-kube-api-access-bdcsn\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.534657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.534505    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-service-ca\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.534657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.534584    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-serving-cert\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.534657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.534604    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-trusted-ca-bundle\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.534657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.534623    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-oauth-config\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.534657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.534638    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-config\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.534823 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.534668    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-oauth-serving-cert\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.635161 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.635112    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bdcsn\" (UniqueName: \"kubernetes.io/projected/ca5c7c60-2b12-40ee-af04-4577a37b6703-kube-api-access-bdcsn\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.635598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.635189    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-service-ca\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.635598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.635241    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-serving-cert\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.635598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.635260    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-trusted-ca-bundle\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.635598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.635285    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-oauth-config\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.635598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.635356    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-config\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.635598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.635425    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-oauth-serving-cert\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.636171 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.636121    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-config\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.636273 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.636241    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-trusted-ca-bundle\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.636389 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.636371    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-oauth-serving-cert\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.636500 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.636481    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-service-ca\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.637787 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.637765    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-serving-cert\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.638117 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.638102    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-oauth-config\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.642724 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.642704    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bdcsn\" (UniqueName: \"kubernetes.io/projected/ca5c7c60-2b12-40ee-af04-4577a37b6703-kube-api-access-bdcsn\") pod \"console-f79dfc856-fhk76\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") " pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.757224 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.757193    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:44.880855 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:44.880832    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f79dfc856-fhk76"]
Jun 03 14:48:44.883080 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:48:44.883052    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca5c7c60_2b12_40ee_af04_4577a37b6703.slice/crio-a8103a69fe17570127e568a9834251c67b8ab3357bc6aefa4631ae1217d6dcd8 WatchSource:0}: Error finding container a8103a69fe17570127e568a9834251c67b8ab3357bc6aefa4631ae1217d6dcd8: Status 404 returned error can't find the container with id a8103a69fe17570127e568a9834251c67b8ab3357bc6aefa4631ae1217d6dcd8
Jun 03 14:48:45.619336 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:45.619295    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dfc856-fhk76" event={"ID":"ca5c7c60-2b12-40ee-af04-4577a37b6703","Type":"ContainerStarted","Data":"38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a"}
Jun 03 14:48:45.619550 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:45.619346    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dfc856-fhk76" event={"ID":"ca5c7c60-2b12-40ee-af04-4577a37b6703","Type":"ContainerStarted","Data":"a8103a69fe17570127e568a9834251c67b8ab3357bc6aefa4631ae1217d6dcd8"}
Jun 03 14:48:45.636274 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:45.636227    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-f79dfc856-fhk76" podStartSLOduration=1.6362097310000001 podStartE2EDuration="1.636209731s" podCreationTimestamp="2026-06-03 14:48:44 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:48:45.636044625 +0000 UTC m=+201.152837673" watchObservedRunningTime="2026-06-03 14:48:45.636209731 +0000 UTC m=+201.153002787"
Jun 03 14:48:46.528267 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.528223    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92" podUID="d0bef055-8950-44cf-b4d6-e6b171055edc" containerName="registry" containerID="cri-o://e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911" gracePeriod=30
Jun 03 14:48:46.765403 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.765381    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:46.856031 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.855950    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-bound-sa-token\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856031 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.855995    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-certificates\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856031 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856022    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-trusted-ca\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856207    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0bef055-8950-44cf-b4d6-e6b171055edc-ca-trust-extracted\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856292    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kq6s4\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-kube-api-access-kq6s4\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856401 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856328    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-image-registry-private-configuration\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856401 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856372    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-installation-pull-secrets\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856401 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856398    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") pod \"d0bef055-8950-44cf-b4d6-e6b171055edc\" (UID: \"d0bef055-8950-44cf-b4d6-e6b171055edc\") "
Jun 03 14:48:46.856534 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856404    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:48:46.856534 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856483    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:48:46.856711 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856685    2576 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-certificates\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:46.856827 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.856713    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/d0bef055-8950-44cf-b4d6-e6b171055edc-trusted-ca\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:46.858572 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.858545    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:48:46.858698 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.858641    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:48:46.858857 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.858832    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-kube-api-access-kq6s4" (OuterVolumeSpecName: "kube-api-access-kq6s4") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "kube-api-access-kq6s4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:48:46.858911 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.858878    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:48:46.858964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.858948    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:48:46.864642 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.864616    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0bef055-8950-44cf-b4d6-e6b171055edc-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "d0bef055-8950-44cf-b4d6-e6b171055edc" (UID: "d0bef055-8950-44cf-b4d6-e6b171055edc"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:48:46.957758 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.957735    2576 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-bound-sa-token\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:46.957758 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.957756    2576 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/d0bef055-8950-44cf-b4d6-e6b171055edc-ca-trust-extracted\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:46.957882 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.957766    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kq6s4\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-kube-api-access-kq6s4\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:46.957882 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.957778    2576 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-image-registry-private-configuration\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:46.957882 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.957787    2576 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/d0bef055-8950-44cf-b4d6-e6b171055edc-installation-pull-secrets\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:46.957882 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:46.957795    2576 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/d0bef055-8950-44cf-b4d6-e6b171055edc-registry-tls\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:48:47.626105 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.626071    2576 generic.go:358] "Generic (PLEG): container finished" podID="d0bef055-8950-44cf-b4d6-e6b171055edc" containerID="e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911" exitCode=0
Jun 03 14:48:47.626294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.626161    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92"
Jun 03 14:48:47.626294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.626159    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92" event={"ID":"d0bef055-8950-44cf-b4d6-e6b171055edc","Type":"ContainerDied","Data":"e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911"}
Jun 03 14:48:47.626294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.626200    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7dddbdf9b9-5kt92" event={"ID":"d0bef055-8950-44cf-b4d6-e6b171055edc","Type":"ContainerDied","Data":"b6bcd910e987011a3aaabc769b5c359da226420522882421cec17e5baf91f6d7"}
Jun 03 14:48:47.626294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.626219    2576 scope.go:117] "RemoveContainer" containerID="e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911"
Jun 03 14:48:47.633660 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.633640    2576 scope.go:117] "RemoveContainer" containerID="e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911"
Jun 03 14:48:47.633910 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:48:47.633880    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911\": container with ID starting with e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911 not found: ID does not exist" containerID="e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911"
Jun 03 14:48:47.634012 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.633906    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911"} err="failed to get container status \"e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911\": rpc error: code = NotFound desc = could not find container \"e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911\": container with ID starting with e5da5e4cf117ff742521a9aa40de50bbb0c8bc857ece0beb132e7accd1810911 not found: ID does not exist"
Jun 03 14:48:47.646609 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.646588    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7dddbdf9b9-5kt92"]
Jun 03 14:48:47.654956 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:47.654939    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7dddbdf9b9-5kt92"]
Jun 03 14:48:49.042724 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:49.042691    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0bef055-8950-44cf-b4d6-e6b171055edc" path="/var/lib/kubelet/pods/d0bef055-8950-44cf-b4d6-e6b171055edc/volumes"
Jun 03 14:48:49.841676 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:49.841644    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:48:54.758202 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:54.758168    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:54.758560 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:54.758250    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:54.763021 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:54.763002    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:48:55.653164 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:48:55.653113    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:49:03.671921 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:03.671887    2576 generic.go:358] "Generic (PLEG): container finished" podID="7f1c41a6-0b05-4ad0-9346-1bfc1565901e" containerID="42d2cacf287de898a2b04a42f2d2f168182a5e8ae94a34a673c04fa46d456677" exitCode=0
Jun 03 14:49:03.672359 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:03.671956    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-h54pq" event={"ID":"7f1c41a6-0b05-4ad0-9346-1bfc1565901e","Type":"ContainerDied","Data":"42d2cacf287de898a2b04a42f2d2f168182a5e8ae94a34a673c04fa46d456677"}
Jun 03 14:49:03.672359 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:03.672351    2576 scope.go:117] "RemoveContainer" containerID="42d2cacf287de898a2b04a42f2d2f168182a5e8ae94a34a673c04fa46d456677"
Jun 03 14:49:04.534691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:04.534664    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5f9m_54728720-211f-4a83-ab10-ba0fde28f34a/dns/0.log"
Jun 03 14:49:04.540440 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:04.540420    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5f9m_54728720-211f-4a83-ab10-ba0fde28f34a/kube-rbac-proxy/0.log"
Jun 03 14:49:04.676414 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:04.676383    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-788bf58df5-h54pq" event={"ID":"7f1c41a6-0b05-4ad0-9346-1bfc1565901e","Type":"ContainerStarted","Data":"805ba86def905d3d4002241704b0b11fa1156e8e5d049516bc9a5ac61ea2d5b3"}
Jun 03 14:49:05.105783 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:05.105757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ppnw2_2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524/dns-node-resolver/0.log"
Jun 03 14:49:10.639337 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.639274    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-6bcc8c8987-fgvvj" podUID="a6428f96-bf18-47c8-889a-d2014a89ee4a" containerName="console" containerID="cri-o://d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b" gracePeriod=15
Jun 03 14:49:10.878320 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.878299    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bcc8c8987-fgvvj_a6428f96-bf18-47c8-889a-d2014a89ee4a/console/0.log"
Jun 03 14:49:10.878433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.878358    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:49:10.964863 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.964830    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-serving-cert\") pod \"a6428f96-bf18-47c8-889a-d2014a89ee4a\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") "
Jun 03 14:49:10.965032 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.964906    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-service-ca\") pod \"a6428f96-bf18-47c8-889a-d2014a89ee4a\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") "
Jun 03 14:49:10.965099 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965027    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-567fh\" (UniqueName: \"kubernetes.io/projected/a6428f96-bf18-47c8-889a-d2014a89ee4a-kube-api-access-567fh\") pod \"a6428f96-bf18-47c8-889a-d2014a89ee4a\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") "
Jun 03 14:49:10.965099 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965075    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-config\") pod \"a6428f96-bf18-47c8-889a-d2014a89ee4a\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") "
Jun 03 14:49:10.965230 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965107    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-oauth-config\") pod \"a6428f96-bf18-47c8-889a-d2014a89ee4a\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") "
Jun 03 14:49:10.965230 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965144    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-trusted-ca-bundle\") pod \"a6428f96-bf18-47c8-889a-d2014a89ee4a\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") "
Jun 03 14:49:10.965230 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965181    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-oauth-serving-cert\") pod \"a6428f96-bf18-47c8-889a-d2014a89ee4a\" (UID: \"a6428f96-bf18-47c8-889a-d2014a89ee4a\") "
Jun 03 14:49:10.965382 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965300    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-service-ca" (OuterVolumeSpecName: "service-ca") pod "a6428f96-bf18-47c8-889a-d2014a89ee4a" (UID: "a6428f96-bf18-47c8-889a-d2014a89ee4a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:49:10.965511 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965488    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-service-ca\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:10.965631 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965576    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-config" (OuterVolumeSpecName: "console-config") pod "a6428f96-bf18-47c8-889a-d2014a89ee4a" (UID: "a6428f96-bf18-47c8-889a-d2014a89ee4a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:49:10.965708 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965683    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a6428f96-bf18-47c8-889a-d2014a89ee4a" (UID: "a6428f96-bf18-47c8-889a-d2014a89ee4a"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:49:10.965765 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.965700    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a6428f96-bf18-47c8-889a-d2014a89ee4a" (UID: "a6428f96-bf18-47c8-889a-d2014a89ee4a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:49:10.967225 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.967185    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a6428f96-bf18-47c8-889a-d2014a89ee4a" (UID: "a6428f96-bf18-47c8-889a-d2014a89ee4a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:10.967225 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.967206    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a6428f96-bf18-47c8-889a-d2014a89ee4a" (UID: "a6428f96-bf18-47c8-889a-d2014a89ee4a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:10.967340 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:10.967252    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a6428f96-bf18-47c8-889a-d2014a89ee4a-kube-api-access-567fh" (OuterVolumeSpecName: "kube-api-access-567fh") pod "a6428f96-bf18-47c8-889a-d2014a89ee4a" (UID: "a6428f96-bf18-47c8-889a-d2014a89ee4a"). InnerVolumeSpecName "kube-api-access-567fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:49:11.065864 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.065838    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-oauth-serving-cert\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:11.065864 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.065861    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-serving-cert\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:11.066003 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.065870    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-567fh\" (UniqueName: \"kubernetes.io/projected/a6428f96-bf18-47c8-889a-d2014a89ee4a-kube-api-access-567fh\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:11.066003 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.065880    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:11.066003 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.065888    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a6428f96-bf18-47c8-889a-d2014a89ee4a-console-oauth-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:11.066003 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.065897    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a6428f96-bf18-47c8-889a-d2014a89ee4a-trusted-ca-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:11.697212 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.697185    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bcc8c8987-fgvvj_a6428f96-bf18-47c8-889a-d2014a89ee4a/console/0.log"
Jun 03 14:49:11.697675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.697227    2576 generic.go:358] "Generic (PLEG): container finished" podID="a6428f96-bf18-47c8-889a-d2014a89ee4a" containerID="d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b" exitCode=2
Jun 03 14:49:11.697675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.697261    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc8c8987-fgvvj" event={"ID":"a6428f96-bf18-47c8-889a-d2014a89ee4a","Type":"ContainerDied","Data":"d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b"}
Jun 03 14:49:11.697675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.697296    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bcc8c8987-fgvvj"
Jun 03 14:49:11.697675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.697311    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bcc8c8987-fgvvj" event={"ID":"a6428f96-bf18-47c8-889a-d2014a89ee4a","Type":"ContainerDied","Data":"c3dd9fcf4b6180a91394e585507423eefad295c49ebcbf14ecf712ee53060b72"}
Jun 03 14:49:11.697675 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.697332    2576 scope.go:117] "RemoveContainer" containerID="d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b"
Jun 03 14:49:11.705225 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.705196    2576 scope.go:117] "RemoveContainer" containerID="d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b"
Jun 03 14:49:11.705509 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:11.705477    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b\": container with ID starting with d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b not found: ID does not exist" containerID="d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b"
Jun 03 14:49:11.705591 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.705518    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b"} err="failed to get container status \"d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b\": rpc error: code = NotFound desc = could not find container \"d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b\": container with ID starting with d245db223b7e7902c94a6568d23eadd26b8fd084a937aa238be75b5fabab023b not found: ID does not exist"
Jun 03 14:49:11.714604 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.714577    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6bcc8c8987-fgvvj"]
Jun 03 14:49:11.717946 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:11.717924    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6bcc8c8987-fgvvj"]
Jun 03 14:49:13.043067 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:13.043035    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a6428f96-bf18-47c8-889a-d2014a89ee4a" path="/var/lib/kubelet/pods/a6428f96-bf18-47c8-889a-d2014a89ee4a/volumes"
Jun 03 14:49:36.789626 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:36.789590    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:49:36.791885 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:36.791861    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6c806192-8385-493c-acc6-b3dfa7ca4ef4-metrics-certs\") pod \"network-metrics-daemon-fbcfw\" (UID: \"6c806192-8385-493c-acc6-b3dfa7ca4ef4\") " pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:49:36.942456 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:36.942425    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-fk4zz\""
Jun 03 14:49:36.950585 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:36.950559    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fbcfw"
Jun 03 14:49:37.070544 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:37.070322    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fbcfw"]
Jun 03 14:49:37.073175 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:49:37.073149    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c806192_8385_493c_acc6_b3dfa7ca4ef4.slice/crio-8435b1f8e5f24702625c2e8d747b9f1cfb30114a93979426b39b568a5c93b054 WatchSource:0}: Error finding container 8435b1f8e5f24702625c2e8d747b9f1cfb30114a93979426b39b568a5c93b054: Status 404 returned error can't find the container with id 8435b1f8e5f24702625c2e8d747b9f1cfb30114a93979426b39b568a5c93b054
Jun 03 14:49:37.772477 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:37.772443    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbcfw" event={"ID":"6c806192-8385-493c-acc6-b3dfa7ca4ef4","Type":"ContainerStarted","Data":"8435b1f8e5f24702625c2e8d747b9f1cfb30114a93979426b39b568a5c93b054"}
Jun 03 14:49:38.779244 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:38.779198    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbcfw" event={"ID":"6c806192-8385-493c-acc6-b3dfa7ca4ef4","Type":"ContainerStarted","Data":"d74d4681457060427ef3f6107813b86694adc497fb9305aa908e298a5ef2d453"}
Jun 03 14:49:38.779622 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:38.779266    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fbcfw" event={"ID":"6c806192-8385-493c-acc6-b3dfa7ca4ef4","Type":"ContainerStarted","Data":"212d6036dabe71a0dc77cbc8644acd5984f7b020a9e14c54a1a04aa082d03719"}
Jun 03 14:49:38.794860 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:38.794818    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fbcfw" podStartSLOduration=252.466254989 podStartE2EDuration="4m13.794806186s" podCreationTimestamp="2026-06-03 14:45:25 +0000 UTC" firstStartedPulling="2026-06-03 14:49:37.07495549 +0000 UTC m=+252.591748523" lastFinishedPulling="2026-06-03 14:49:38.403506679 +0000 UTC m=+253.920299720" observedRunningTime="2026-06-03 14:49:38.794088937 +0000 UTC m=+254.310882006" watchObservedRunningTime="2026-06-03 14:49:38.794806186 +0000 UTC m=+254.311599240"
Jun 03 14:49:47.165073 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.164984    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-84c59b48d5-7w5x4"]
Jun 03 14:49:47.165475 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.165455    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a6428f96-bf18-47c8-889a-d2014a89ee4a" containerName="console"
Jun 03 14:49:47.165537 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.165480    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="a6428f96-bf18-47c8-889a-d2014a89ee4a" containerName="console"
Jun 03 14:49:47.165537 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.165508    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0bef055-8950-44cf-b4d6-e6b171055edc" containerName="registry"
Jun 03 14:49:47.165537 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.165517    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0bef055-8950-44cf-b4d6-e6b171055edc" containerName="registry"
Jun 03 14:49:47.165639 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.165599    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="a6428f96-bf18-47c8-889a-d2014a89ee4a" containerName="console"
Jun 03 14:49:47.165639 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.165612    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="d0bef055-8950-44cf-b4d6-e6b171055edc" containerName="registry"
Jun 03 14:49:47.167777 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.167761    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.183725 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.183703    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c59b48d5-7w5x4"]
Jun 03 14:49:47.276921 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.276891    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-trusted-ca-bundle\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.277082 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.276925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzzwr\" (UniqueName: \"kubernetes.io/projected/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-kube-api-access-hzzwr\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.277082 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.276948    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-oauth-serving-cert\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.277082 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.277036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-service-ca\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.277283 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.277095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-serving-cert\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.277283 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.277117    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-config\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.277283 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.277191    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-oauth-config\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.378495 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.378460    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-service-ca\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.378662 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.378513    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-serving-cert\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.378662 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.378630    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-config\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.378771 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.378662    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-oauth-config\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.378771 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.378697    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-trusted-ca-bundle\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.378771 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.378724    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hzzwr\" (UniqueName: \"kubernetes.io/projected/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-kube-api-access-hzzwr\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.378771 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.378754    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-oauth-serving-cert\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.379318 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.379291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-service-ca\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.379498 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.379291    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-config\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.379498 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.379443    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-oauth-serving-cert\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.379680 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.379654    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-trusted-ca-bundle\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.381120 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.381091    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-serving-cert\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.381246 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.381184    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-oauth-config\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.386370 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.386352    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzzwr\" (UniqueName: \"kubernetes.io/projected/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-kube-api-access-hzzwr\") pod \"console-84c59b48d5-7w5x4\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") " pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.477583 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.477558    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:47.605977 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.605884    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-84c59b48d5-7w5x4"]
Jun 03 14:49:47.608736 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:49:47.608706    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod769ae5d2_15c1_4d7f_b738_f646b10fdaa2.slice/crio-e15827e7da732e627f5fb23304428a0d9dc126ed36373bf9ae7b221bcdddddff WatchSource:0}: Error finding container e15827e7da732e627f5fb23304428a0d9dc126ed36373bf9ae7b221bcdddddff: Status 404 returned error can't find the container with id e15827e7da732e627f5fb23304428a0d9dc126ed36373bf9ae7b221bcdddddff
Jun 03 14:49:47.805618 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.805531    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c59b48d5-7w5x4" event={"ID":"769ae5d2-15c1-4d7f-b738-f646b10fdaa2","Type":"ContainerStarted","Data":"3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c"}
Jun 03 14:49:47.805618 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.805570    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c59b48d5-7w5x4" event={"ID":"769ae5d2-15c1-4d7f-b738-f646b10fdaa2","Type":"ContainerStarted","Data":"e15827e7da732e627f5fb23304428a0d9dc126ed36373bf9ae7b221bcdddddff"}
Jun 03 14:49:47.824465 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:47.824422    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-84c59b48d5-7w5x4" podStartSLOduration=0.824409914 podStartE2EDuration="824.409914ms" podCreationTimestamp="2026-06-03 14:49:47 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:49:47.822683586 +0000 UTC m=+263.339476642" watchObservedRunningTime="2026-06-03 14:49:47.824409914 +0000 UTC m=+263.341202969"
Jun 03 14:49:49.072798 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.072763    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:49:49.073239 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.073197    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="alertmanager" containerID="cri-o://717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a" gracePeriod=120
Jun 03 14:49:49.073330 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.073268    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-metric" containerID="cri-o://333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a" gracePeriod=120
Jun 03 14:49:49.073330 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.073294    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy" containerID="cri-o://d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946" gracePeriod=120
Jun 03 14:49:49.073431 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.073358    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="prom-label-proxy" containerID="cri-o://241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b" gracePeriod=120
Jun 03 14:49:49.073431 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.073303    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="config-reloader" containerID="cri-o://616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5" gracePeriod=120
Jun 03 14:49:49.073544 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.073269    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-web" containerID="cri-o://81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239" gracePeriod=120
Jun 03 14:49:49.816244 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816214    2576 generic.go:358] "Generic (PLEG): container finished" podID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerID="241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b" exitCode=0
Jun 03 14:49:49.816244 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816240    2576 generic.go:358] "Generic (PLEG): container finished" podID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerID="d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946" exitCode=0
Jun 03 14:49:49.816244 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816247    2576 generic.go:358] "Generic (PLEG): container finished" podID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerID="616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5" exitCode=0
Jun 03 14:49:49.816244 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816253    2576 generic.go:358] "Generic (PLEG): container finished" podID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerID="717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a" exitCode=0
Jun 03 14:49:49.816491 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816288    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"}
Jun 03 14:49:49.816491 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816321    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"}
Jun 03 14:49:49.816491 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816332    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"}
Jun 03 14:49:49.816491 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:49.816341    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"}
Jun 03 14:49:50.318632 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.318611    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:50.404483 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404420    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-metrics-client-ca\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.404483 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404462    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-web-config\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.404633 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404491    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-cluster-tls-config\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.404633 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404512    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.404633 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404529    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-volume\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.404772 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404676    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-web\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.404772 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404678    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:49:50.404772 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404732    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-tls-assets\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.404915 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404833    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-out\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.405709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.404998    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cbszl\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-kube-api-access-cbszl\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.405709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.405056    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-main-db\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.405709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.405086    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.405709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.405120    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.405709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.405172    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle\") pod \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\" (UID: \"0e8dcc1e-a906-4ac7-b52e-8f51311060b6\") "
Jun 03 14:49:50.405709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.405456    2576 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-metrics-client-ca\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.406525 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.406270    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:49:50.407189 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.407160    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:49:50.407370 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.407345    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-volume" (OuterVolumeSpecName: "config-volume") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:50.408421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.408308    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:49:50.408421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.408328    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:50.408421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.408354    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:50.408421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.408397    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-out" (OuterVolumeSpecName: "config-out") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:49:50.408826 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.408794    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-kube-api-access-cbszl" (OuterVolumeSpecName: "kube-api-access-cbszl") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "kube-api-access-cbszl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:49:50.409554 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.409532    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:50.409770 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.409745    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:50.411838 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.411808    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:50.418724 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.418705    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-web-config" (OuterVolumeSpecName: "web-config") pod "0e8dcc1e-a906-4ac7-b52e-8f51311060b6" (UID: "0e8dcc1e-a906-4ac7-b52e-8f51311060b6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:49:50.506504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506471    2576 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-cluster-tls-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506504    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506516    2576 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-volume\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506525    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506534    2576 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-tls-assets\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506544    2576 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-config-out\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506552    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cbszl\" (UniqueName: \"kubernetes.io/projected/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-kube-api-access-cbszl\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506561    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-main-db\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506575    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-main-tls\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506587    2576 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506596    2576 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.506688 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.506605    2576 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0e8dcc1e-a906-4ac7-b52e-8f51311060b6-web-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:49:50.821872 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.821838    2576 generic.go:358] "Generic (PLEG): container finished" podID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerID="333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a" exitCode=0
Jun 03 14:49:50.821872 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.821866    2576 generic.go:358] "Generic (PLEG): container finished" podID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerID="81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239" exitCode=0
Jun 03 14:49:50.822046 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.821919    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"}
Jun 03 14:49:50.822046 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.821959    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"}
Jun 03 14:49:50.822046 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.821965    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:50.822046 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.821979    2576 scope.go:117] "RemoveContainer" containerID="241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"
Jun 03 14:49:50.822230 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.821970    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0e8dcc1e-a906-4ac7-b52e-8f51311060b6","Type":"ContainerDied","Data":"d99daeb53b5b5f69961920831fbaca94ae264524c16796e8ddbff5a0ed672d00"}
Jun 03 14:49:50.830590 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.830542    2576 scope.go:117] "RemoveContainer" containerID="333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"
Jun 03 14:49:50.837301 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.837283    2576 scope.go:117] "RemoveContainer" containerID="d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"
Jun 03 14:49:50.843483 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.843458    2576 scope.go:117] "RemoveContainer" containerID="81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"
Jun 03 14:49:50.845977 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.845957    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:49:50.849235 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.849213    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:49:50.850865 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.850842    2576 scope.go:117] "RemoveContainer" containerID="616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"
Jun 03 14:49:50.856928 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.856912    2576 scope.go:117] "RemoveContainer" containerID="717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"
Jun 03 14:49:50.863167 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.863150    2576 scope.go:117] "RemoveContainer" containerID="61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179"
Jun 03 14:49:50.869191 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.869176    2576 scope.go:117] "RemoveContainer" containerID="241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"
Jun 03 14:49:50.869406 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:50.869390    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b\": container with ID starting with 241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b not found: ID does not exist" containerID="241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"
Jun 03 14:49:50.869455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.869413    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"} err="failed to get container status \"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b\": rpc error: code = NotFound desc = could not find container \"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b\": container with ID starting with 241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b not found: ID does not exist"
Jun 03 14:49:50.869455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.869430    2576 scope.go:117] "RemoveContainer" containerID="333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"
Jun 03 14:49:50.869627 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:50.869611    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a\": container with ID starting with 333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a not found: ID does not exist" containerID="333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"
Jun 03 14:49:50.869678 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.869631    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"} err="failed to get container status \"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a\": rpc error: code = NotFound desc = could not find container \"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a\": container with ID starting with 333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a not found: ID does not exist"
Jun 03 14:49:50.869678 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.869644    2576 scope.go:117] "RemoveContainer" containerID="d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"
Jun 03 14:49:50.869891 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:50.869871    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946\": container with ID starting with d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946 not found: ID does not exist" containerID="d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"
Jun 03 14:49:50.869931 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.869896    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"} err="failed to get container status \"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946\": rpc error: code = NotFound desc = could not find container \"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946\": container with ID starting with d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946 not found: ID does not exist"
Jun 03 14:49:50.869931 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.869911    2576 scope.go:117] "RemoveContainer" containerID="81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"
Jun 03 14:49:50.870123 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:50.870106    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239\": container with ID starting with 81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239 not found: ID does not exist" containerID="81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"
Jun 03 14:49:50.870123 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870156    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"} err="failed to get container status \"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239\": rpc error: code = NotFound desc = could not find container \"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239\": container with ID starting with 81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239 not found: ID does not exist"
Jun 03 14:49:50.870123 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870178    2576 scope.go:117] "RemoveContainer" containerID="616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"
Jun 03 14:49:50.870413 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:50.870398    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5\": container with ID starting with 616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5 not found: ID does not exist" containerID="616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"
Jun 03 14:49:50.870450 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870419    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"} err="failed to get container status \"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5\": rpc error: code = NotFound desc = could not find container \"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5\": container with ID starting with 616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5 not found: ID does not exist"
Jun 03 14:49:50.870450 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870433    2576 scope.go:117] "RemoveContainer" containerID="717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"
Jun 03 14:49:50.870664 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:50.870645    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a\": container with ID starting with 717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a not found: ID does not exist" containerID="717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"
Jun 03 14:49:50.870705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870671    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"} err="failed to get container status \"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a\": rpc error: code = NotFound desc = could not find container \"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a\": container with ID starting with 717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a not found: ID does not exist"
Jun 03 14:49:50.870705 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870686    2576 scope.go:117] "RemoveContainer" containerID="61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179"
Jun 03 14:49:50.870886 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:49:50.870871    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179\": container with ID starting with 61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179 not found: ID does not exist" containerID="61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179"
Jun 03 14:49:50.870942 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870893    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179"} err="failed to get container status \"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179\": rpc error: code = NotFound desc = could not find container \"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179\": container with ID starting with 61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179 not found: ID does not exist"
Jun 03 14:49:50.870942 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.870913    2576 scope.go:117] "RemoveContainer" containerID="241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"
Jun 03 14:49:50.871160 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871124    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b"} err="failed to get container status \"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b\": rpc error: code = NotFound desc = could not find container \"241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b\": container with ID starting with 241bca0e2f58c8a01579a6505fb77b77901939e4430a4a0eb371a38a4c637f1b not found: ID does not exist"
Jun 03 14:49:50.871202 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871162    2576 scope.go:117] "RemoveContainer" containerID="333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"
Jun 03 14:49:50.871358 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871344    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a"} err="failed to get container status \"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a\": rpc error: code = NotFound desc = could not find container \"333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a\": container with ID starting with 333c2cf70ec4d0b1839b9566d30037610d1f9627d7333333ce6816ad390f891a not found: ID does not exist"
Jun 03 14:49:50.871405 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871359    2576 scope.go:117] "RemoveContainer" containerID="d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"
Jun 03 14:49:50.871546 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871529    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946"} err="failed to get container status \"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946\": rpc error: code = NotFound desc = could not find container \"d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946\": container with ID starting with d62d8c3919888b2718400b510e13051f0bb336cc12f9cf445cd9af53c2681946 not found: ID does not exist"
Jun 03 14:49:50.871597 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871547    2576 scope.go:117] "RemoveContainer" containerID="81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"
Jun 03 14:49:50.871739 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871721    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239"} err="failed to get container status \"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239\": rpc error: code = NotFound desc = could not find container \"81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239\": container with ID starting with 81cb15b829502bf9e0af08bd2b9f304c739f28d1737690951aeb058f5a222239 not found: ID does not exist"
Jun 03 14:49:50.871781 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871740    2576 scope.go:117] "RemoveContainer" containerID="616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"
Jun 03 14:49:50.871905 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871893    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5"} err="failed to get container status \"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5\": rpc error: code = NotFound desc = could not find container \"616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5\": container with ID starting with 616cbae097c96c2589c8554ad90d98dd8cf43c10cea16c8d614c0129814034c5 not found: ID does not exist"
Jun 03 14:49:50.871951 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.871907    2576 scope.go:117] "RemoveContainer" containerID="717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"
Jun 03 14:49:50.872052 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.872037    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a"} err="failed to get container status \"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a\": rpc error: code = NotFound desc = could not find container \"717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a\": container with ID starting with 717cbf0e7707c74603b41fd62a2a7c435bc581d592f7bc4ea3244a7284f2dd7a not found: ID does not exist"
Jun 03 14:49:50.872165 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.872052    2576 scope.go:117] "RemoveContainer" containerID="61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179"
Jun 03 14:49:50.872275 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.872259    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179"} err="failed to get container status \"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179\": rpc error: code = NotFound desc = could not find container \"61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179\": container with ID starting with 61c065e17b50e7a0dad1cc163c607583a664f961419e732722831c0641a49179 not found: ID does not exist"
Jun 03 14:49:50.884066 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884040    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:49:50.884441 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884427    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="alertmanager"
Jun 03 14:49:50.884494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884442    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="alertmanager"
Jun 03 14:49:50.884494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884454    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="config-reloader"
Jun 03 14:49:50.884494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884459    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="config-reloader"
Jun 03 14:49:50.884494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884465    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-web"
Jun 03 14:49:50.884494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884471    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-web"
Jun 03 14:49:50.884494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884477    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="prom-label-proxy"
Jun 03 14:49:50.884494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884485    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="prom-label-proxy"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884498    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-metric"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884504    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-metric"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884517    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884522    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884530    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="init-config-reloader"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884535    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="init-config-reloader"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884585    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884594    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-metric"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884600    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="prom-label-proxy"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884607    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="config-reloader"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884615    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="kube-rbac-proxy-web"
Jun 03 14:49:50.884692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.884622    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" containerName="alertmanager"
Jun 03 14:49:50.888239 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.888224    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:50.890946 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.890920    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 03 14:49:50.891047 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.890981    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 03 14:49:50.891112 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.891045    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 03 14:49:50.891112 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.891045    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 03 14:49:50.891112 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.891088    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 03 14:49:50.891369 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.891232    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9j8fs\""
Jun 03 14:49:50.891369 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.891314    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 03 14:49:50.891369 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.891317    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 03 14:49:50.891612 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.891320    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 03 14:49:50.895997 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.895980    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 03 14:49:50.899088 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:50.899069    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:49:51.009906 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.009874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010071 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.009916    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010071 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.009936    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010071 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.009986    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tdjk\" (UniqueName: \"kubernetes.io/projected/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-kube-api-access-2tdjk\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010071 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010024    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010071 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010047    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010071 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010067    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-config-out\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010087    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-web-config\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010173    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010195    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010211    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.010294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.010232    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.042847 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.042820    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0e8dcc1e-a906-4ac7-b52e-8f51311060b6" path="/var/lib/kubelet/pods/0e8dcc1e-a906-4ac7-b52e-8f51311060b6/volumes"
Jun 03 14:49:51.111194 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111104    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111194 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111168    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111194 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111194    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111211    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2tdjk\" (UniqueName: \"kubernetes.io/projected/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-kube-api-access-2tdjk\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111238    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111257    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111277    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-config-out\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111305    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-web-config\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111341    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111370    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111393    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111412    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111440    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.111948 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.111758    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.112854 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.112791    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.113054 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.113028    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.114555 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.114488    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-web-config\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.114555 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.114495    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.114715 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.114625    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-tls-assets\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.114715 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.114674    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.114715 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.114706    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.114850 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.114770    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-config-out\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.115251 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.115228    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.115741 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.115724    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-config-volume\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.115935 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.115918    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.118873 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.118855    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tdjk\" (UniqueName: \"kubernetes.io/projected/6bdcc783-2c20-4425-a95a-9bc15b1a0e39-kube-api-access-2tdjk\") pod \"alertmanager-main-0\" (UID: \"6bdcc783-2c20-4425-a95a-9bc15b1a0e39\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.198036 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.198013    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 03 14:49:51.340924 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.340739    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 03 14:49:51.343789 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:49:51.343755    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bdcc783_2c20_4425_a95a_9bc15b1a0e39.slice/crio-3c1c0c1c2489d8ced71fa55a6d51f0228f33f5e9549902dc4f2a369901649a12 WatchSource:0}: Error finding container 3c1c0c1c2489d8ced71fa55a6d51f0228f33f5e9549902dc4f2a369901649a12: Status 404 returned error can't find the container with id 3c1c0c1c2489d8ced71fa55a6d51f0228f33f5e9549902dc4f2a369901649a12
Jun 03 14:49:51.828427 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.828390    2576 generic.go:358] "Generic (PLEG): container finished" podID="6bdcc783-2c20-4425-a95a-9bc15b1a0e39" containerID="6fe093af4a9c4ff6bde040f225a05963a46f2faa9edd923f8708771300103ee5" exitCode=0
Jun 03 14:49:51.828604 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.828464    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerDied","Data":"6fe093af4a9c4ff6bde040f225a05963a46f2faa9edd923f8708771300103ee5"}
Jun 03 14:49:51.828604 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:51.828490    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerStarted","Data":"3c1c0c1c2489d8ced71fa55a6d51f0228f33f5e9549902dc4f2a369901649a12"}
Jun 03 14:49:52.834667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:52.834624    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerStarted","Data":"4b9879a4ada881e97e54b8f51c816adf515304c35642426d57e85f2ec3a831ff"}
Jun 03 14:49:52.834667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:52.834668    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerStarted","Data":"a6e6a877b0bdf01fd7d947b88cf8a19e73e7c83c5f624749ba5af767af09b7b1"}
Jun 03 14:49:52.835056 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:52.834681    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerStarted","Data":"afa53b2a192b9ff007301c4b1fca04d4a086a974da0aec1392082637d99c265a"}
Jun 03 14:49:52.835056 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:52.834695    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerStarted","Data":"525b615f0e9007198ca7c997c64c141ec779cd87197d369dd9e6905dc6075c99"}
Jun 03 14:49:52.835056 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:52.834707    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerStarted","Data":"e18d858dedc632698c83af7eb4f042d847e29b38411f8648c90102e89e947dde"}
Jun 03 14:49:52.835056 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:52.834719    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"6bdcc783-2c20-4425-a95a-9bc15b1a0e39","Type":"ContainerStarted","Data":"cc0179b3ec0d2fa704099726a5262e65dc5aef40faa4977e06dd6aaf09b64f37"}
Jun 03 14:49:52.863465 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:52.863407    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.863389654 podStartE2EDuration="2.863389654s" podCreationTimestamp="2026-06-03 14:49:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:49:52.861841953 +0000 UTC m=+268.378635029" watchObservedRunningTime="2026-06-03 14:49:52.863389654 +0000 UTC m=+268.380182712"
Jun 03 14:49:57.478003 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:57.477966    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:57.478483 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:57.478056    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:57.482751 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:57.482728    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:57.854271 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:57.854194    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:49:57.902425 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:49:57.902391    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f79dfc856-fhk76"]
Jun 03 14:50:22.927666 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:22.927627    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-f79dfc856-fhk76" podUID="ca5c7c60-2b12-40ee-af04-4577a37b6703" containerName="console" containerID="cri-o://38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a" gracePeriod=15
Jun 03 14:50:23.165691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.165670    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f79dfc856-fhk76_ca5c7c60-2b12-40ee-af04-4577a37b6703/console/0.log"
Jun 03 14:50:23.165813 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.165731    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:50:23.183009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.182952    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-trusted-ca-bundle\") pod \"ca5c7c60-2b12-40ee-af04-4577a37b6703\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") "
Jun 03 14:50:23.183009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.182995    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-oauth-config\") pod \"ca5c7c60-2b12-40ee-af04-4577a37b6703\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") "
Jun 03 14:50:23.183175 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183025    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-config\") pod \"ca5c7c60-2b12-40ee-af04-4577a37b6703\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") "
Jun 03 14:50:23.183175 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183046    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-service-ca\") pod \"ca5c7c60-2b12-40ee-af04-4577a37b6703\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") "
Jun 03 14:50:23.183175 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183102    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-oauth-serving-cert\") pod \"ca5c7c60-2b12-40ee-af04-4577a37b6703\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") "
Jun 03 14:50:23.183331 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183180    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-serving-cert\") pod \"ca5c7c60-2b12-40ee-af04-4577a37b6703\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") "
Jun 03 14:50:23.183331 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183210    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bdcsn\" (UniqueName: \"kubernetes.io/projected/ca5c7c60-2b12-40ee-af04-4577a37b6703-kube-api-access-bdcsn\") pod \"ca5c7c60-2b12-40ee-af04-4577a37b6703\" (UID: \"ca5c7c60-2b12-40ee-af04-4577a37b6703\") "
Jun 03 14:50:23.183853 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183811    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ca5c7c60-2b12-40ee-af04-4577a37b6703" (UID: "ca5c7c60-2b12-40ee-af04-4577a37b6703"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:50:23.183853 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183840    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-config" (OuterVolumeSpecName: "console-config") pod "ca5c7c60-2b12-40ee-af04-4577a37b6703" (UID: "ca5c7c60-2b12-40ee-af04-4577a37b6703"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:50:23.184027 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.183938    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ca5c7c60-2b12-40ee-af04-4577a37b6703" (UID: "ca5c7c60-2b12-40ee-af04-4577a37b6703"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:50:23.184090 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.184021    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-service-ca" (OuterVolumeSpecName: "service-ca") pod "ca5c7c60-2b12-40ee-af04-4577a37b6703" (UID: "ca5c7c60-2b12-40ee-af04-4577a37b6703"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:50:23.186954 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.186925    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca5c7c60-2b12-40ee-af04-4577a37b6703-kube-api-access-bdcsn" (OuterVolumeSpecName: "kube-api-access-bdcsn") pod "ca5c7c60-2b12-40ee-af04-4577a37b6703" (UID: "ca5c7c60-2b12-40ee-af04-4577a37b6703"). InnerVolumeSpecName "kube-api-access-bdcsn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:50:23.187266 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.187241    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ca5c7c60-2b12-40ee-af04-4577a37b6703" (UID: "ca5c7c60-2b12-40ee-af04-4577a37b6703"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:50:23.187622 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.187591    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ca5c7c60-2b12-40ee-af04-4577a37b6703" (UID: "ca5c7c60-2b12-40ee-af04-4577a37b6703"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:50:23.283899 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.283853    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-serving-cert\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:50:23.283899 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.283895    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bdcsn\" (UniqueName: \"kubernetes.io/projected/ca5c7c60-2b12-40ee-af04-4577a37b6703-kube-api-access-bdcsn\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:50:23.283899 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.283905    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-trusted-ca-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:50:23.283899 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.283914    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-oauth-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:50:23.284232 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.283924    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-console-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:50:23.284232 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.283934    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-service-ca\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:50:23.284232 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.283941    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ca5c7c60-2b12-40ee-af04-4577a37b6703-oauth-serving-cert\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:50:23.929275 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.929251    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-f79dfc856-fhk76_ca5c7c60-2b12-40ee-af04-4577a37b6703/console/0.log"
Jun 03 14:50:23.929718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.929288    2576 generic.go:358] "Generic (PLEG): container finished" podID="ca5c7c60-2b12-40ee-af04-4577a37b6703" containerID="38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a" exitCode=2
Jun 03 14:50:23.929718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.929324    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dfc856-fhk76" event={"ID":"ca5c7c60-2b12-40ee-af04-4577a37b6703","Type":"ContainerDied","Data":"38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a"}
Jun 03 14:50:23.929718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.929350    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f79dfc856-fhk76"
Jun 03 14:50:23.929718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.929373    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f79dfc856-fhk76" event={"ID":"ca5c7c60-2b12-40ee-af04-4577a37b6703","Type":"ContainerDied","Data":"a8103a69fe17570127e568a9834251c67b8ab3357bc6aefa4631ae1217d6dcd8"}
Jun 03 14:50:23.929718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.929396    2576 scope.go:117] "RemoveContainer" containerID="38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a"
Jun 03 14:50:23.938011 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.937995    2576 scope.go:117] "RemoveContainer" containerID="38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a"
Jun 03 14:50:23.938280 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:50:23.938261    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a\": container with ID starting with 38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a not found: ID does not exist" containerID="38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a"
Jun 03 14:50:23.938346 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.938288    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a"} err="failed to get container status \"38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a\": rpc error: code = NotFound desc = could not find container \"38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a\": container with ID starting with 38c7f980621ff285b99dfea803ee003f6328c796207a87838378f2dfffeb6e9a not found: ID does not exist"
Jun 03 14:50:23.950430 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.950409    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f79dfc856-fhk76"]
Jun 03 14:50:23.956044 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:23.956024    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f79dfc856-fhk76"]
Jun 03 14:50:24.916307 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:24.916284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 14:50:24.916474 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:24.916284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 14:50:24.920083 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:24.920060    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:50:24.920083 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:24.920079    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:50:24.926668 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:24.926650    2576 kubelet.go:1628] "Image garbage collection succeeded"
Jun 03 14:50:25.042892 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:50:25.042765    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca5c7c60-2b12-40ee-af04-4577a37b6703" path="/var/lib/kubelet/pods/ca5c7c60-2b12-40ee-af04-4577a37b6703/volumes"
Jun 03 14:53:42.665580 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.665543    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-vlqpg"]
Jun 03 14:53:42.666063 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.665884    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca5c7c60-2b12-40ee-af04-4577a37b6703" containerName="console"
Jun 03 14:53:42.666063 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.665897    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca5c7c60-2b12-40ee-af04-4577a37b6703" containerName="console"
Jun 03 14:53:42.666063 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.665958    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="ca5c7c60-2b12-40ee-af04-4577a37b6703" containerName="console"
Jun 03 14:53:42.668712 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.668695    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.671388 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.671354    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 03 14:53:42.684512 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.684490    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vlqpg"]
Jun 03 14:53:42.792036 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.791998    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c62b226-cb13-4d18-8a23-a722f29f8cbd-kubelet-config\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.792271 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.792050    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c62b226-cb13-4d18-8a23-a722f29f8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.792271 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.792095    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c62b226-cb13-4d18-8a23-a722f29f8cbd-dbus\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.892770 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.892744    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c62b226-cb13-4d18-8a23-a722f29f8cbd-kubelet-config\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.892924 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.892791    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c62b226-cb13-4d18-8a23-a722f29f8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.892924 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.892812    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c62b226-cb13-4d18-8a23-a722f29f8cbd-dbus\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.892924 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.892876    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/5c62b226-cb13-4d18-8a23-a722f29f8cbd-kubelet-config\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.893032 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.892947    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/5c62b226-cb13-4d18-8a23-a722f29f8cbd-dbus\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.894847 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.894824    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/5c62b226-cb13-4d18-8a23-a722f29f8cbd-original-pull-secret\") pod \"global-pull-secret-syncer-vlqpg\" (UID: \"5c62b226-cb13-4d18-8a23-a722f29f8cbd\") " pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:42.977500 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:42.977474    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-vlqpg"
Jun 03 14:53:43.097435 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:43.097415    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-vlqpg"]
Jun 03 14:53:43.100052 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:53:43.100016    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c62b226_cb13_4d18_8a23_a722f29f8cbd.slice/crio-be0c35e9ee74f881e4c8c08e69a89303b085347f9f2ac199368902b1c7295fb9 WatchSource:0}: Error finding container be0c35e9ee74f881e4c8c08e69a89303b085347f9f2ac199368902b1c7295fb9: Status 404 returned error can't find the container with id be0c35e9ee74f881e4c8c08e69a89303b085347f9f2ac199368902b1c7295fb9
Jun 03 14:53:43.101952 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:43.101938    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 14:53:43.495785 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:43.495751    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vlqpg" event={"ID":"5c62b226-cb13-4d18-8a23-a722f29f8cbd","Type":"ContainerStarted","Data":"be0c35e9ee74f881e4c8c08e69a89303b085347f9f2ac199368902b1c7295fb9"}
Jun 03 14:53:48.517653 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.517616    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-vlqpg" event={"ID":"5c62b226-cb13-4d18-8a23-a722f29f8cbd","Type":"ContainerStarted","Data":"4a75fc57b2922d743dc79a5f1bd7dffbe68bfd9b3a2b11ae2ad66444e2fa5c6b"}
Jun 03 14:53:48.533656 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.533608    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-vlqpg" podStartSLOduration=1.905337436 podStartE2EDuration="6.533596016s" podCreationTimestamp="2026-06-03 14:53:42 +0000 UTC" firstStartedPulling="2026-06-03 14:53:43.102054414 +0000 UTC m=+498.618847447" lastFinishedPulling="2026-06-03 14:53:47.730312991 +0000 UTC m=+503.247106027" observedRunningTime="2026-06-03 14:53:48.533455578 +0000 UTC m=+504.050248635" watchObservedRunningTime="2026-06-03 14:53:48.533596016 +0000 UTC m=+504.050389071"
Jun 03 14:53:48.780290 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.780213    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console/console-56bf699cb8-kz5w5"]
Jun 03 14:53:48.783880 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.783858    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.795098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.795072    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56bf699cb8-kz5w5"]
Jun 03 14:53:48.845990 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.845953    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-oauth-serving-cert\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.846162 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.846000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a20082-bc9b-4c88-9179-905bab87f604-console-serving-cert\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.846162 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.846023    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2a20082-bc9b-4c88-9179-905bab87f604-console-oauth-config\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.846162 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.846094    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msp52\" (UniqueName: \"kubernetes.io/projected/f2a20082-bc9b-4c88-9179-905bab87f604-kube-api-access-msp52\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.846296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.846159    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-service-ca\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.846296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.846215    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-console-config\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.846296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.846251    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-trusted-ca-bundle\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.947495 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.947457    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-msp52\" (UniqueName: \"kubernetes.io/projected/f2a20082-bc9b-4c88-9179-905bab87f604-kube-api-access-msp52\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.947677 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.947516    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-service-ca\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.947677 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.947549    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-console-config\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.947677 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.947579    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-trusted-ca-bundle\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.947677 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.947640    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-oauth-serving-cert\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.947677 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.947674    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a20082-bc9b-4c88-9179-905bab87f604-console-serving-cert\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.947920 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.947698    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2a20082-bc9b-4c88-9179-905bab87f604-console-oauth-config\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.948390 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.948365    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-console-config\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.948504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.948365    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-service-ca\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.948504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.948457    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-oauth-serving-cert\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.948762 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.948744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f2a20082-bc9b-4c88-9179-905bab87f604-trusted-ca-bundle\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.950075 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.950051    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f2a20082-bc9b-4c88-9179-905bab87f604-console-oauth-config\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.950211 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.950193    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f2a20082-bc9b-4c88-9179-905bab87f604-console-serving-cert\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:48.956196 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:48.956175    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-msp52\" (UniqueName: \"kubernetes.io/projected/f2a20082-bc9b-4c88-9179-905bab87f604-kube-api-access-msp52\") pod \"console-56bf699cb8-kz5w5\" (UID: \"f2a20082-bc9b-4c88-9179-905bab87f604\") " pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:49.093437 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:49.093350    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:49.221407 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:49.221358    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56bf699cb8-kz5w5"]
Jun 03 14:53:49.223695 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:53:49.223669    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2a20082_bc9b_4c88_9179_905bab87f604.slice/crio-d73866abb945e8624427451856a38c2f2e14ac363c48f11b0f78471acf4437c8 WatchSource:0}: Error finding container d73866abb945e8624427451856a38c2f2e14ac363c48f11b0f78471acf4437c8: Status 404 returned error can't find the container with id d73866abb945e8624427451856a38c2f2e14ac363c48f11b0f78471acf4437c8
Jun 03 14:53:49.521731 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:49.521696    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bf699cb8-kz5w5" event={"ID":"f2a20082-bc9b-4c88-9179-905bab87f604","Type":"ContainerStarted","Data":"0301710aae437769b216b7e7829a7d76d213f8540d736395a9610f13327fc57a"}
Jun 03 14:53:49.522149 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:49.521737    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56bf699cb8-kz5w5" event={"ID":"f2a20082-bc9b-4c88-9179-905bab87f604","Type":"ContainerStarted","Data":"d73866abb945e8624427451856a38c2f2e14ac363c48f11b0f78471acf4437c8"}
Jun 03 14:53:49.541979 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:49.541936    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console/console-56bf699cb8-kz5w5" podStartSLOduration=1.541923119 podStartE2EDuration="1.541923119s" podCreationTimestamp="2026-06-03 14:53:48 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:53:49.541420201 +0000 UTC m=+505.058213256" watchObservedRunningTime="2026-06-03 14:53:49.541923119 +0000 UTC m=+505.058716176"
Jun 03 14:53:59.093973 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:59.093934    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:59.094383 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:59.093986    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:59.098616 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:59.098593    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:59.558455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:59.558429    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56bf699cb8-kz5w5"
Jun 03 14:53:59.603548 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:53:59.603524    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c59b48d5-7w5x4"]
Jun 03 14:54:17.831307 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.831230    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"]
Jun 03 14:54:17.834171 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.834155    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.837113 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.837082    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 14:54:17.837113 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.837092    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztk72\""
Jun 03 14:54:17.838159 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.838140    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 14:54:17.842287 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.842268    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"]
Jun 03 14:54:17.889871 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.889845    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.889992 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.889900    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.889992 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.889958    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mck7c\" (UniqueName: \"kubernetes.io/projected/59e66a44-ad79-4668-a882-cb0ccc50d1d6-kube-api-access-mck7c\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.990882 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.990853    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.991011 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.990903    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mck7c\" (UniqueName: \"kubernetes.io/projected/59e66a44-ad79-4668-a882-cb0ccc50d1d6-kube-api-access-mck7c\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.991011 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.990937    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.991229 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.991211    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-bundle\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:17.991317 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:17.991299    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-util\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:18.000492 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:18.000468    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mck7c\" (UniqueName: \"kubernetes.io/projected/59e66a44-ad79-4668-a882-cb0ccc50d1d6-kube-api-access-mck7c\") pod \"2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") " pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:18.144353 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:18.144295    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:18.270790 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:18.270764    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"]
Jun 03 14:54:18.272802 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:54:18.272775    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e66a44_ad79_4668_a882_cb0ccc50d1d6.slice/crio-7d65b67d2b82cfe55f50d288a1dbcaa43a90f255063e13c4fc0979977a623bb2 WatchSource:0}: Error finding container 7d65b67d2b82cfe55f50d288a1dbcaa43a90f255063e13c4fc0979977a623bb2: Status 404 returned error can't find the container with id 7d65b67d2b82cfe55f50d288a1dbcaa43a90f255063e13c4fc0979977a623bb2
Jun 03 14:54:18.609514 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:18.609481    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2" event={"ID":"59e66a44-ad79-4668-a882-cb0ccc50d1d6","Type":"ContainerStarted","Data":"7d65b67d2b82cfe55f50d288a1dbcaa43a90f255063e13c4fc0979977a623bb2"}
Jun 03 14:54:24.624072 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:24.624010    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-console/console-84c59b48d5-7w5x4" podUID="769ae5d2-15c1-4d7f-b738-f646b10fdaa2" containerName="console" containerID="cri-o://3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c" gracePeriod=15
Jun 03 14:54:26.141870 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:54:26.141832    2576 cadvisor_stats_provider.go:525] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59e66a44_ad79_4668_a882_cb0ccc50d1d6.slice/crio-conmon-db3c1778b9a9c9695dc21a2a44ef26bba25f656a26b2177a72a199bde596710f.scope\": RecentStats: unable to find data in memory cache]"
Jun 03 14:54:26.165740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.165717    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84c59b48d5-7w5x4_769ae5d2-15c1-4d7f-b738-f646b10fdaa2/console/0.log"
Jun 03 14:54:26.165875 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.165792    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:54:26.264122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264021    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-trusted-ca-bundle\") pod \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") "
Jun 03 14:54:26.264122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264091    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-config\") pod \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") "
Jun 03 14:54:26.264122 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264122    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-oauth-serving-cert\") pod \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") "
Jun 03 14:54:26.264432 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264218    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-service-ca\") pod \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") "
Jun 03 14:54:26.264432 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264277    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hzzwr\" (UniqueName: \"kubernetes.io/projected/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-kube-api-access-hzzwr\") pod \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") "
Jun 03 14:54:26.264432 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264311    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-serving-cert\") pod \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") "
Jun 03 14:54:26.264432 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264337    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-oauth-config\") pod \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\" (UID: \"769ae5d2-15c1-4d7f-b738-f646b10fdaa2\") "
Jun 03 14:54:26.264630 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264462    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-config" (OuterVolumeSpecName: "console-config") pod "769ae5d2-15c1-4d7f-b738-f646b10fdaa2" (UID: "769ae5d2-15c1-4d7f-b738-f646b10fdaa2"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:54:26.264630 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264536    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "769ae5d2-15c1-4d7f-b738-f646b10fdaa2" (UID: "769ae5d2-15c1-4d7f-b738-f646b10fdaa2"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:54:26.264630 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264549    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "769ae5d2-15c1-4d7f-b738-f646b10fdaa2" (UID: "769ae5d2-15c1-4d7f-b738-f646b10fdaa2"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:54:26.264630 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264557    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-service-ca" (OuterVolumeSpecName: "service-ca") pod "769ae5d2-15c1-4d7f-b738-f646b10fdaa2" (UID: "769ae5d2-15c1-4d7f-b738-f646b10fdaa2"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:54:26.264775 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264633    2576 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-trusted-ca-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:26.264775 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264653    2576 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:26.264775 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264665    2576 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-oauth-serving-cert\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:26.264775 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.264673    2576 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-service-ca\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:26.266691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.266662    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-kube-api-access-hzzwr" (OuterVolumeSpecName: "kube-api-access-hzzwr") pod "769ae5d2-15c1-4d7f-b738-f646b10fdaa2" (UID: "769ae5d2-15c1-4d7f-b738-f646b10fdaa2"). InnerVolumeSpecName "kube-api-access-hzzwr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:54:26.266691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.266664    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "769ae5d2-15c1-4d7f-b738-f646b10fdaa2" (UID: "769ae5d2-15c1-4d7f-b738-f646b10fdaa2"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:54:26.266828 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.266757    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "769ae5d2-15c1-4d7f-b738-f646b10fdaa2" (UID: "769ae5d2-15c1-4d7f-b738-f646b10fdaa2"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 03 14:54:26.365678 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.365626    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hzzwr\" (UniqueName: \"kubernetes.io/projected/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-kube-api-access-hzzwr\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:26.365678 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.365674    2576 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-serving-cert\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:26.365678 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.365687    2576 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/769ae5d2-15c1-4d7f-b738-f646b10fdaa2-console-oauth-config\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:26.633087 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.633008    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-84c59b48d5-7w5x4_769ae5d2-15c1-4d7f-b738-f646b10fdaa2/console/0.log"
Jun 03 14:54:26.633087 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.633051    2576 generic.go:358] "Generic (PLEG): container finished" podID="769ae5d2-15c1-4d7f-b738-f646b10fdaa2" containerID="3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c" exitCode=2
Jun 03 14:54:26.633305 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.633114    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-84c59b48d5-7w5x4"
Jun 03 14:54:26.633305 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.633160    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c59b48d5-7w5x4" event={"ID":"769ae5d2-15c1-4d7f-b738-f646b10fdaa2","Type":"ContainerDied","Data":"3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c"}
Jun 03 14:54:26.633305 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.633195    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-84c59b48d5-7w5x4" event={"ID":"769ae5d2-15c1-4d7f-b738-f646b10fdaa2","Type":"ContainerDied","Data":"e15827e7da732e627f5fb23304428a0d9dc126ed36373bf9ae7b221bcdddddff"}
Jun 03 14:54:26.633305 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.633213    2576 scope.go:117] "RemoveContainer" containerID="3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c"
Jun 03 14:54:26.634723 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.634700    2576 generic.go:358] "Generic (PLEG): container finished" podID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerID="db3c1778b9a9c9695dc21a2a44ef26bba25f656a26b2177a72a199bde596710f" exitCode=0
Jun 03 14:54:26.634820 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.634762    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2" event={"ID":"59e66a44-ad79-4668-a882-cb0ccc50d1d6","Type":"ContainerDied","Data":"db3c1778b9a9c9695dc21a2a44ef26bba25f656a26b2177a72a199bde596710f"}
Jun 03 14:54:26.642228 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.642214    2576 scope.go:117] "RemoveContainer" containerID="3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c"
Jun 03 14:54:26.642459 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:54:26.642442    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c\": container with ID starting with 3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c not found: ID does not exist" containerID="3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c"
Jun 03 14:54:26.642506 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.642467    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c"} err="failed to get container status \"3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c\": rpc error: code = NotFound desc = could not find container \"3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c\": container with ID starting with 3e1145178d24cc818a3afb86e5f6306a33c516cd4e0f0fc01a8259fd6303ca4c not found: ID does not exist"
Jun 03 14:54:26.673003 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.672959    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-console/console-84c59b48d5-7w5x4"]
Jun 03 14:54:26.674818 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:26.674800    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-84c59b48d5-7w5x4"]
Jun 03 14:54:27.042925 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:27.042887    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="769ae5d2-15c1-4d7f-b738-f646b10fdaa2" path="/var/lib/kubelet/pods/769ae5d2-15c1-4d7f-b738-f646b10fdaa2/volumes"
Jun 03 14:54:31.653185 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:31.653153    2576 generic.go:358] "Generic (PLEG): container finished" podID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerID="8067ff0fe39c6213a893685352d40a83dfc23c24800b605e1a6d025f591fbfc5" exitCode=0
Jun 03 14:54:31.653569 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:31.653255    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2" event={"ID":"59e66a44-ad79-4668-a882-cb0ccc50d1d6","Type":"ContainerDied","Data":"8067ff0fe39c6213a893685352d40a83dfc23c24800b605e1a6d025f591fbfc5"}
Jun 03 14:54:40.684678 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:40.684602    2576 generic.go:358] "Generic (PLEG): container finished" podID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerID="5bdcb2a4ee8bc92df9703015f810a383eace5ba11991d073843c109dc7e3b032" exitCode=0
Jun 03 14:54:40.685019 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:40.684679    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2" event={"ID":"59e66a44-ad79-4668-a882-cb0ccc50d1d6","Type":"ContainerDied","Data":"5bdcb2a4ee8bc92df9703015f810a383eace5ba11991d073843c109dc7e3b032"}
Jun 03 14:54:41.815702 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:41.815681    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:41.906146 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:41.906098    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-util\") pod \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") "
Jun 03 14:54:41.906297 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:41.906158    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-bundle\") pod \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") "
Jun 03 14:54:41.906297 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:41.906216    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mck7c\" (UniqueName: \"kubernetes.io/projected/59e66a44-ad79-4668-a882-cb0ccc50d1d6-kube-api-access-mck7c\") pod \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\" (UID: \"59e66a44-ad79-4668-a882-cb0ccc50d1d6\") "
Jun 03 14:54:41.906770 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:41.906745    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-bundle" (OuterVolumeSpecName: "bundle") pod "59e66a44-ad79-4668-a882-cb0ccc50d1d6" (UID: "59e66a44-ad79-4668-a882-cb0ccc50d1d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:54:41.908350 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:41.908327    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/59e66a44-ad79-4668-a882-cb0ccc50d1d6-kube-api-access-mck7c" (OuterVolumeSpecName: "kube-api-access-mck7c") pod "59e66a44-ad79-4668-a882-cb0ccc50d1d6" (UID: "59e66a44-ad79-4668-a882-cb0ccc50d1d6"). InnerVolumeSpecName "kube-api-access-mck7c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:54:41.911012 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:41.910989    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-util" (OuterVolumeSpecName: "util") pod "59e66a44-ad79-4668-a882-cb0ccc50d1d6" (UID: "59e66a44-ad79-4668-a882-cb0ccc50d1d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:54:42.007386 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:42.007360    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mck7c\" (UniqueName: \"kubernetes.io/projected/59e66a44-ad79-4668-a882-cb0ccc50d1d6-kube-api-access-mck7c\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:42.007386 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:42.007384    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:42.007593 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:42.007394    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/59e66a44-ad79-4668-a882-cb0ccc50d1d6-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:42.693272 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:42.693233    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2" event={"ID":"59e66a44-ad79-4668-a882-cb0ccc50d1d6","Type":"ContainerDied","Data":"7d65b67d2b82cfe55f50d288a1dbcaa43a90f255063e13c4fc0979977a623bb2"}
Jun 03 14:54:42.693272 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:42.693275    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d65b67d2b82cfe55f50d288a1dbcaa43a90f255063e13c4fc0979977a623bb2"
Jun 03 14:54:42.693474 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:42.693300    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2bb52b92bd31ddf2ebbc335370ac517be50e61a93c2fe375393413c19dkv7n2"
Jun 03 14:54:45.615471 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.615422    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"]
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.615913    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerName="util"
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.615932    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerName="util"
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.615962    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerName="pull"
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.615970    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerName="pull"
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.615982    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerName="extract"
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.615991    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerName="extract"
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.616011    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="769ae5d2-15c1-4d7f-b738-f646b10fdaa2" containerName="console"
Jun 03 14:54:45.616070 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.616019    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="769ae5d2-15c1-4d7f-b738-f646b10fdaa2" containerName="console"
Jun 03 14:54:45.616493 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.616086    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="59e66a44-ad79-4668-a882-cb0ccc50d1d6" containerName="extract"
Jun 03 14:54:45.616493 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.616099    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="769ae5d2-15c1-4d7f-b738-f646b10fdaa2" containerName="console"
Jun 03 14:54:45.618871 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.618853    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:45.623930 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.623906    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-4lx2f\""
Jun 03 14:54:45.624395 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.624375    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\""
Jun 03 14:54:45.624480 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.624375    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\""
Jun 03 14:54:45.634155 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.632016    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"]
Jun 03 14:54:45.738831 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.738794    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7af243-bdfb-4432-bd62-383f491bd9b3-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-8wppf\" (UID: \"bc7af243-bdfb-4432-bd62-383f491bd9b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:45.738831 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.738835    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n7xmf\" (UniqueName: \"kubernetes.io/projected/bc7af243-bdfb-4432-bd62-383f491bd9b3-kube-api-access-n7xmf\") pod \"cert-manager-operator-controller-manager-54b9655956-8wppf\" (UID: \"bc7af243-bdfb-4432-bd62-383f491bd9b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:45.839388 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.839341    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7af243-bdfb-4432-bd62-383f491bd9b3-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-8wppf\" (UID: \"bc7af243-bdfb-4432-bd62-383f491bd9b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:45.839569 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.839407    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n7xmf\" (UniqueName: \"kubernetes.io/projected/bc7af243-bdfb-4432-bd62-383f491bd9b3-kube-api-access-n7xmf\") pod \"cert-manager-operator-controller-manager-54b9655956-8wppf\" (UID: \"bc7af243-bdfb-4432-bd62-383f491bd9b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:45.839827 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.839803    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bc7af243-bdfb-4432-bd62-383f491bd9b3-tmp\") pod \"cert-manager-operator-controller-manager-54b9655956-8wppf\" (UID: \"bc7af243-bdfb-4432-bd62-383f491bd9b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:45.849120 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.849100    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n7xmf\" (UniqueName: \"kubernetes.io/projected/bc7af243-bdfb-4432-bd62-383f491bd9b3-kube-api-access-n7xmf\") pod \"cert-manager-operator-controller-manager-54b9655956-8wppf\" (UID: \"bc7af243-bdfb-4432-bd62-383f491bd9b3\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:45.928672 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:45.928597    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"
Jun 03 14:54:46.060948 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:46.060914    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf"]
Jun 03 14:54:46.064631 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:54:46.064603    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc7af243_bdfb_4432_bd62_383f491bd9b3.slice/crio-b3dc5de5c4dc61235f636225f99b52ccca45a7140580d0c1c03c961b8831d15a WatchSource:0}: Error finding container b3dc5de5c4dc61235f636225f99b52ccca45a7140580d0c1c03c961b8831d15a: Status 404 returned error can't find the container with id b3dc5de5c4dc61235f636225f99b52ccca45a7140580d0c1c03c961b8831d15a
Jun 03 14:54:46.706488 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:46.706454    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf" event={"ID":"bc7af243-bdfb-4432-bd62-383f491bd9b3","Type":"ContainerStarted","Data":"b3dc5de5c4dc61235f636225f99b52ccca45a7140580d0c1c03c961b8831d15a"}
Jun 03 14:54:48.714453 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:48.714419    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf" event={"ID":"bc7af243-bdfb-4432-bd62-383f491bd9b3","Type":"ContainerStarted","Data":"2e2bbf768b35781df23ffb00b4a77891b90f3b51dcda464a1f5f8ead4d0b4c46"}
Jun 03 14:54:48.760537 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:48.760491    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-54b9655956-8wppf" podStartSLOduration=1.859953822 podStartE2EDuration="3.760477352s" podCreationTimestamp="2026-06-03 14:54:45 +0000 UTC" firstStartedPulling="2026-06-03 14:54:46.067090622 +0000 UTC m=+561.583883654" lastFinishedPulling="2026-06-03 14:54:47.967614134 +0000 UTC m=+563.484407184" observedRunningTime="2026-06-03 14:54:48.759294462 +0000 UTC m=+564.276087517" watchObservedRunningTime="2026-06-03 14:54:48.760477352 +0000 UTC m=+564.277270408"
Jun 03 14:54:49.923506 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:49.923472    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"]
Jun 03 14:54:49.927043 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:49.927027    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:49.933468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:49.933434    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 14:54:49.933538 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:49.933435    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 14:54:49.938817 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:49.938796    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztk72\""
Jun 03 14:54:49.942630 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:49.942573    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"]
Jun 03 14:54:50.075359 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.075324    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.075359 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.075360    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jr8lt\" (UniqueName: \"kubernetes.io/projected/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-kube-api-access-jr8lt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.075591 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.075493    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.176407 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.176324    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.176407 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.176367    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jr8lt\" (UniqueName: \"kubernetes.io/projected/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-kube-api-access-jr8lt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.176588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.176408    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.176725 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.176703    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.176794 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.176765    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.186115 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.186091    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jr8lt\" (UniqueName: \"kubernetes.io/projected/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-kube-api-access-jr8lt\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.235877 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.235851    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:50.360289 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:54:50.360254    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dbb0ed6_d0c8_406f_870a_e32a19df3bc9.slice/crio-ff320ccc4c45495ebf062c4e8f6e1d21e3056fc9495d4d6812988326108cc6ce WatchSource:0}: Error finding container ff320ccc4c45495ebf062c4e8f6e1d21e3056fc9495d4d6812988326108cc6ce: Status 404 returned error can't find the container with id ff320ccc4c45495ebf062c4e8f6e1d21e3056fc9495d4d6812988326108cc6ce
Jun 03 14:54:50.361274 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.361246    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"]
Jun 03 14:54:50.635537 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.635497    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k4mqd"]
Jun 03 14:54:50.639013 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.638997    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:50.643243 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.643222    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 03 14:54:50.643357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.643295    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-p88q7\""
Jun 03 14:54:50.643357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.643305    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 03 14:54:50.650360 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.650333    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k4mqd"]
Jun 03 14:54:50.723342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.723258    2576 generic.go:358] "Generic (PLEG): container finished" podID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerID="4dd1a5883e75689706c7e6ebf7557ce4c5a6dffd4d8be4f32cb00c07ca407cad" exitCode=0
Jun 03 14:54:50.723342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.723332    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b" event={"ID":"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9","Type":"ContainerDied","Data":"4dd1a5883e75689706c7e6ebf7557ce4c5a6dffd4d8be4f32cb00c07ca407cad"}
Jun 03 14:54:50.723547 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.723360    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b" event={"ID":"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9","Type":"ContainerStarted","Data":"ff320ccc4c45495ebf062c4e8f6e1d21e3056fc9495d4d6812988326108cc6ce"}
Jun 03 14:54:50.782055 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.782011    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gj67w\" (UniqueName: \"kubernetes.io/projected/ac9df53e-3877-443f-ac57-4262ed99f332-kube-api-access-gj67w\") pod \"cert-manager-webhook-587ccfb98-k4mqd\" (UID: \"ac9df53e-3877-443f-ac57-4262ed99f332\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:50.782229 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.782068    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9df53e-3877-443f-ac57-4262ed99f332-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k4mqd\" (UID: \"ac9df53e-3877-443f-ac57-4262ed99f332\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:50.882550 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.882514    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gj67w\" (UniqueName: \"kubernetes.io/projected/ac9df53e-3877-443f-ac57-4262ed99f332-kube-api-access-gj67w\") pod \"cert-manager-webhook-587ccfb98-k4mqd\" (UID: \"ac9df53e-3877-443f-ac57-4262ed99f332\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:50.882714 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.882557    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9df53e-3877-443f-ac57-4262ed99f332-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k4mqd\" (UID: \"ac9df53e-3877-443f-ac57-4262ed99f332\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:50.894354 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.894327    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ac9df53e-3877-443f-ac57-4262ed99f332-bound-sa-token\") pod \"cert-manager-webhook-587ccfb98-k4mqd\" (UID: \"ac9df53e-3877-443f-ac57-4262ed99f332\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:50.894455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.894415    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gj67w\" (UniqueName: \"kubernetes.io/projected/ac9df53e-3877-443f-ac57-4262ed99f332-kube-api-access-gj67w\") pod \"cert-manager-webhook-587ccfb98-k4mqd\" (UID: \"ac9df53e-3877-443f-ac57-4262ed99f332\") " pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:50.960827 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:50.960801    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:51.085313 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:54:51.085276    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podac9df53e_3877_443f_ac57_4262ed99f332.slice/crio-c9405a7a23e3c8f8e82621688cf4d812cd7b47a5d258430bc4f1e10a75a81ef7 WatchSource:0}: Error finding container c9405a7a23e3c8f8e82621688cf4d812cd7b47a5d258430bc4f1e10a75a81ef7: Status 404 returned error can't find the container with id c9405a7a23e3c8f8e82621688cf4d812cd7b47a5d258430bc4f1e10a75a81ef7
Jun 03 14:54:51.089617 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:51.089596    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-587ccfb98-k4mqd"]
Jun 03 14:54:51.727528 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:51.727493    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd" event={"ID":"ac9df53e-3877-443f-ac57-4262ed99f332","Type":"ContainerStarted","Data":"c9405a7a23e3c8f8e82621688cf4d812cd7b47a5d258430bc4f1e10a75a81ef7"}
Jun 03 14:54:52.864963 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:52.863839    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-djq79"]
Jun 03 14:54:52.868257 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:52.868231    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:52.871657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:52.871625    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-qsnw6\""
Jun 03 14:54:52.876574 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:52.876547    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-djq79"]
Jun 03 14:54:52.899747 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:52.899715    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7455\" (UniqueName: \"kubernetes.io/projected/8986dbed-98ce-45a1-a2bf-f2a55ce5eb72-kube-api-access-d7455\") pod \"cert-manager-cainjector-68b757865b-djq79\" (UID: \"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:52.899897 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:52.899759    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8986dbed-98ce-45a1-a2bf-f2a55ce5eb72-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-djq79\" (UID: \"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:53.000280 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:53.000245    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-d7455\" (UniqueName: \"kubernetes.io/projected/8986dbed-98ce-45a1-a2bf-f2a55ce5eb72-kube-api-access-d7455\") pod \"cert-manager-cainjector-68b757865b-djq79\" (UID: \"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:53.000446 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:53.000293    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8986dbed-98ce-45a1-a2bf-f2a55ce5eb72-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-djq79\" (UID: \"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:53.008860 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:53.008835    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7455\" (UniqueName: \"kubernetes.io/projected/8986dbed-98ce-45a1-a2bf-f2a55ce5eb72-kube-api-access-d7455\") pod \"cert-manager-cainjector-68b757865b-djq79\" (UID: \"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:53.008993 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:53.008910    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8986dbed-98ce-45a1-a2bf-f2a55ce5eb72-bound-sa-token\") pod \"cert-manager-cainjector-68b757865b-djq79\" (UID: \"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72\") " pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:53.184217 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:53.184180    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-68b757865b-djq79"
Jun 03 14:54:53.328317 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:53.328284    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-68b757865b-djq79"]
Jun 03 14:54:53.329909 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:54:53.329885    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8986dbed_98ce_45a1_a2bf_f2a55ce5eb72.slice/crio-40e4840888a34c46a44167086eaeb020ccefc029cc4a85d75ad6eccb7083d1d9 WatchSource:0}: Error finding container 40e4840888a34c46a44167086eaeb020ccefc029cc4a85d75ad6eccb7083d1d9: Status 404 returned error can't find the container with id 40e4840888a34c46a44167086eaeb020ccefc029cc4a85d75ad6eccb7083d1d9
Jun 03 14:54:53.737392 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:53.737353    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-djq79" event={"ID":"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72","Type":"ContainerStarted","Data":"40e4840888a34c46a44167086eaeb020ccefc029cc4a85d75ad6eccb7083d1d9"}
Jun 03 14:54:54.743098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:54.743059    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b" event={"ID":"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9","Type":"ContainerStarted","Data":"7a8c4d2333f35c0200af263da536041576f0e2b2be25f01456de9f6191b821c7"}
Jun 03 14:54:55.747428 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:55.747376    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd" event={"ID":"ac9df53e-3877-443f-ac57-4262ed99f332","Type":"ContainerStarted","Data":"fff4d65d29ca8bcf691983e61d6cab4f8885379acb738dc2203dc89379bef40b"}
Jun 03 14:54:55.747868 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:55.747477    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:54:55.748929 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:55.748901    2576 generic.go:358] "Generic (PLEG): container finished" podID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerID="7a8c4d2333f35c0200af263da536041576f0e2b2be25f01456de9f6191b821c7" exitCode=0
Jun 03 14:54:55.749037 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:55.748978    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b" event={"ID":"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9","Type":"ContainerDied","Data":"7a8c4d2333f35c0200af263da536041576f0e2b2be25f01456de9f6191b821c7"}
Jun 03 14:54:55.770938 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:55.770901    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd" podStartSLOduration=1.628984579 podStartE2EDuration="5.770890019s" podCreationTimestamp="2026-06-03 14:54:50 +0000 UTC" firstStartedPulling="2026-06-03 14:54:51.086993832 +0000 UTC m=+566.603786865" lastFinishedPulling="2026-06-03 14:54:55.228899268 +0000 UTC m=+570.745692305" observedRunningTime="2026-06-03 14:54:55.767889166 +0000 UTC m=+571.284682221" watchObservedRunningTime="2026-06-03 14:54:55.770890019 +0000 UTC m=+571.287683070"
Jun 03 14:54:56.753953 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:56.753915    2576 generic.go:358] "Generic (PLEG): container finished" podID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerID="d7177769e326191ce5ec690b09d92c727fc9d7e0dd3e23eec04986d139d1bbe8" exitCode=0
Jun 03 14:54:56.754362 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:56.754000    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b" event={"ID":"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9","Type":"ContainerDied","Data":"d7177769e326191ce5ec690b09d92c727fc9d7e0dd3e23eec04986d139d1bbe8"}
Jun 03 14:54:57.759386 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.759343    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-68b757865b-djq79" event={"ID":"8986dbed-98ce-45a1-a2bf-f2a55ce5eb72","Type":"ContainerStarted","Data":"2c1eb0a10133efa79d2062e13e084397d32be12c5084f419b8f534fc4ea7180d"}
Jun 03 14:54:57.779501 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.779451    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-68b757865b-djq79" podStartSLOduration=1.777023195 podStartE2EDuration="5.779436903s" podCreationTimestamp="2026-06-03 14:54:52 +0000 UTC" firstStartedPulling="2026-06-03 14:54:53.331790581 +0000 UTC m=+568.848583614" lastFinishedPulling="2026-06-03 14:54:57.334204272 +0000 UTC m=+572.850997322" observedRunningTime="2026-06-03 14:54:57.778497705 +0000 UTC m=+573.295290760" watchObservedRunningTime="2026-06-03 14:54:57.779436903 +0000 UTC m=+573.296229959"
Jun 03 14:54:57.891960 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.891938    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:54:57.941433 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.941409    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-util\") pod \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") "
Jun 03 14:54:57.941533 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.941477    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jr8lt\" (UniqueName: \"kubernetes.io/projected/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-kube-api-access-jr8lt\") pod \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") "
Jun 03 14:54:57.941533 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.941515    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-bundle\") pod \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\" (UID: \"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9\") "
Jun 03 14:54:57.941910 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.941880    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-bundle" (OuterVolumeSpecName: "bundle") pod "1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" (UID: "1dbb0ed6-d0c8-406f-870a-e32a19df3bc9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:54:57.943514 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.943493    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-kube-api-access-jr8lt" (OuterVolumeSpecName: "kube-api-access-jr8lt") pod "1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" (UID: "1dbb0ed6-d0c8-406f-870a-e32a19df3bc9"). InnerVolumeSpecName "kube-api-access-jr8lt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:54:57.946860 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:57.946836    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-util" (OuterVolumeSpecName: "util") pod "1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" (UID: "1dbb0ed6-d0c8-406f-870a-e32a19df3bc9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:54:58.042792 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:58.042717    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:58.042792 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:58.042751    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jr8lt\" (UniqueName: \"kubernetes.io/projected/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-kube-api-access-jr8lt\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:58.042792 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:58.042765    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1dbb0ed6-d0c8-406f-870a-e32a19df3bc9-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:54:58.763997 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:58.763958    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b" event={"ID":"1dbb0ed6-d0c8-406f-870a-e32a19df3bc9","Type":"ContainerDied","Data":"ff320ccc4c45495ebf062c4e8f6e1d21e3056fc9495d4d6812988326108cc6ce"}
Jun 03 14:54:58.763997 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:58.763997    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff320ccc4c45495ebf062c4e8f6e1d21e3056fc9495d4d6812988326108cc6ce"
Jun 03 14:54:58.764446 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:54:58.764095    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87f5j42b"
Jun 03 14:55:01.756800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:01.756765    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-587ccfb98-k4mqd"
Jun 03 14:55:09.799509 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799476    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bvs8m"]
Jun 03 14:55:09.799861 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799830    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerName="pull"
Jun 03 14:55:09.799861 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799842    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerName="pull"
Jun 03 14:55:09.799861 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799854    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerName="util"
Jun 03 14:55:09.799861 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799859    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerName="util"
Jun 03 14:55:09.800007 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799867    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerName="extract"
Jun 03 14:55:09.800007 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799874    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerName="extract"
Jun 03 14:55:09.800007 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.799949    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="1dbb0ed6-d0c8-406f-870a-e32a19df3bc9" containerName="extract"
Jun 03 14:55:09.802327 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.802307    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:09.806079 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.806055    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-jps57\""
Jun 03 14:55:09.817782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.817757    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bvs8m"]
Jun 03 14:55:09.843723 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.843690    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e194a6d5-0e22-4768-97f7-d6358f5beef3-bound-sa-token\") pod \"cert-manager-79c8d999ff-bvs8m\" (UID: \"e194a6d5-0e22-4768-97f7-d6358f5beef3\") " pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:09.843815 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.843745    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/e194a6d5-0e22-4768-97f7-d6358f5beef3-kube-api-access-dk7jt\") pod \"cert-manager-79c8d999ff-bvs8m\" (UID: \"e194a6d5-0e22-4768-97f7-d6358f5beef3\") " pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:09.945148 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.945083    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e194a6d5-0e22-4768-97f7-d6358f5beef3-bound-sa-token\") pod \"cert-manager-79c8d999ff-bvs8m\" (UID: \"e194a6d5-0e22-4768-97f7-d6358f5beef3\") " pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:09.945289 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.945191    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/e194a6d5-0e22-4768-97f7-d6358f5beef3-kube-api-access-dk7jt\") pod \"cert-manager-79c8d999ff-bvs8m\" (UID: \"e194a6d5-0e22-4768-97f7-d6358f5beef3\") " pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:09.953726 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.953695    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e194a6d5-0e22-4768-97f7-d6358f5beef3-bound-sa-token\") pod \"cert-manager-79c8d999ff-bvs8m\" (UID: \"e194a6d5-0e22-4768-97f7-d6358f5beef3\") " pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:09.953820 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:09.953806    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dk7jt\" (UniqueName: \"kubernetes.io/projected/e194a6d5-0e22-4768-97f7-d6358f5beef3-kube-api-access-dk7jt\") pod \"cert-manager-79c8d999ff-bvs8m\" (UID: \"e194a6d5-0e22-4768-97f7-d6358f5beef3\") " pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:10.116336 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:10.116236    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-bvs8m"
Jun 03 14:55:10.240232 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:10.240211    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-bvs8m"]
Jun 03 14:55:10.242437 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:55:10.242398    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode194a6d5_0e22_4768_97f7_d6358f5beef3.slice/crio-ab94386378fb0eb2ca1e91d52cc520d3022f3c54b01ae342a0c1415912b1440b WatchSource:0}: Error finding container ab94386378fb0eb2ca1e91d52cc520d3022f3c54b01ae342a0c1415912b1440b: Status 404 returned error can't find the container with id ab94386378fb0eb2ca1e91d52cc520d3022f3c54b01ae342a0c1415912b1440b
Jun 03 14:55:10.812217 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:10.812182    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bvs8m" event={"ID":"e194a6d5-0e22-4768-97f7-d6358f5beef3","Type":"ContainerStarted","Data":"5960f439418cfc42869059ecf7c5938b9a42c5f49c82425e3836c2a48a7f0309"}
Jun 03 14:55:10.812217 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:10.812221    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-bvs8m" event={"ID":"e194a6d5-0e22-4768-97f7-d6358f5beef3","Type":"ContainerStarted","Data":"ab94386378fb0eb2ca1e91d52cc520d3022f3c54b01ae342a0c1415912b1440b"}
Jun 03 14:55:10.831042 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:10.830994    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-bvs8m" podStartSLOduration=1.8309806910000002 podStartE2EDuration="1.830980691s" podCreationTimestamp="2026-06-03 14:55:09 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:55:10.830519006 +0000 UTC m=+586.347312060" watchObservedRunningTime="2026-06-03 14:55:10.830980691 +0000 UTC m=+586.347773746"
Jun 03 14:55:15.758502 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.758469    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"]
Jun 03 14:55:15.777998 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.777967    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"]
Jun 03 14:55:15.778116 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.778050    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.780667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.780644    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 14:55:15.780667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.780665    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 14:55:15.782062 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.782039    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztk72\""
Jun 03 14:55:15.897531 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.897497    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.897531 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.897536    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.897759 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.897598    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vsndh\" (UniqueName: \"kubernetes.io/projected/4979738e-bb00-464e-b291-841df3c76db9-kube-api-access-vsndh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.998256 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.998222    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.998424 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.998266    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.998424 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.998323    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-vsndh\" (UniqueName: \"kubernetes.io/projected/4979738e-bb00-464e-b291-841df3c76db9-kube-api-access-vsndh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.998601 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.998582    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-bundle\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:15.998669 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:15.998611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-util\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:16.006559 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:16.006541    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vsndh\" (UniqueName: \"kubernetes.io/projected/4979738e-bb00-464e-b291-841df3c76db9-kube-api-access-vsndh\") pod \"410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") " pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:16.088201 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:16.088124    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:16.212781 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:16.212754    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"]
Jun 03 14:55:16.215044 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:55:16.215015    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4979738e_bb00_464e_b291_841df3c76db9.slice/crio-346a9de6a561b5d5bd7f8bec6184409479e7755fbfc6080711d8d38f1fe8d586 WatchSource:0}: Error finding container 346a9de6a561b5d5bd7f8bec6184409479e7755fbfc6080711d8d38f1fe8d586: Status 404 returned error can't find the container with id 346a9de6a561b5d5bd7f8bec6184409479e7755fbfc6080711d8d38f1fe8d586
Jun 03 14:55:16.834436 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:16.834403    2576 generic.go:358] "Generic (PLEG): container finished" podID="4979738e-bb00-464e-b291-841df3c76db9" containerID="3fa2a68b2fffc9b597855d87fd3c6a0680b1355a5c1eac7db96f62ef67420fba" exitCode=0
Jun 03 14:55:16.835006 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:16.834470    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq" event={"ID":"4979738e-bb00-464e-b291-841df3c76db9","Type":"ContainerDied","Data":"3fa2a68b2fffc9b597855d87fd3c6a0680b1355a5c1eac7db96f62ef67420fba"}
Jun 03 14:55:16.835006 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:16.834491    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq" event={"ID":"4979738e-bb00-464e-b291-841df3c76db9","Type":"ContainerStarted","Data":"346a9de6a561b5d5bd7f8bec6184409479e7755fbfc6080711d8d38f1fe8d586"}
Jun 03 14:55:17.840144 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:17.840040    2576 generic.go:358] "Generic (PLEG): container finished" podID="4979738e-bb00-464e-b291-841df3c76db9" containerID="70ee8df4383ffc89b5f75c922b75850c4c57898161e990a38d135e4ae693390d" exitCode=0
Jun 03 14:55:17.840144 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:17.840078    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq" event={"ID":"4979738e-bb00-464e-b291-841df3c76db9","Type":"ContainerDied","Data":"70ee8df4383ffc89b5f75c922b75850c4c57898161e990a38d135e4ae693390d"}
Jun 03 14:55:18.845150 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:18.845100    2576 generic.go:358] "Generic (PLEG): container finished" podID="4979738e-bb00-464e-b291-841df3c76db9" containerID="30c6b9a5292e44f26c050882d439650aae3fd9d249a0bfe68b8457864ca67e90" exitCode=0
Jun 03 14:55:18.845550 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:18.845171    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq" event={"ID":"4979738e-bb00-464e-b291-841df3c76db9","Type":"ContainerDied","Data":"30c6b9a5292e44f26c050882d439650aae3fd9d249a0bfe68b8457864ca67e90"}
Jun 03 14:55:19.971413 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:19.971392    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:20.037504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.037474    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vsndh\" (UniqueName: \"kubernetes.io/projected/4979738e-bb00-464e-b291-841df3c76db9-kube-api-access-vsndh\") pod \"4979738e-bb00-464e-b291-841df3c76db9\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") "
Jun 03 14:55:20.037504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.037511    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-bundle\") pod \"4979738e-bb00-464e-b291-841df3c76db9\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") "
Jun 03 14:55:20.037742 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.037532    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-util\") pod \"4979738e-bb00-464e-b291-841df3c76db9\" (UID: \"4979738e-bb00-464e-b291-841df3c76db9\") "
Jun 03 14:55:20.038242 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.038216    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-bundle" (OuterVolumeSpecName: "bundle") pod "4979738e-bb00-464e-b291-841df3c76db9" (UID: "4979738e-bb00-464e-b291-841df3c76db9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:55:20.039642 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.039615    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4979738e-bb00-464e-b291-841df3c76db9-kube-api-access-vsndh" (OuterVolumeSpecName: "kube-api-access-vsndh") pod "4979738e-bb00-464e-b291-841df3c76db9" (UID: "4979738e-bb00-464e-b291-841df3c76db9"). InnerVolumeSpecName "kube-api-access-vsndh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:55:20.043489 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.043451    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-util" (OuterVolumeSpecName: "util") pod "4979738e-bb00-464e-b291-841df3c76db9" (UID: "4979738e-bb00-464e-b291-841df3c76db9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:55:20.138242 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.138121    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vsndh\" (UniqueName: \"kubernetes.io/projected/4979738e-bb00-464e-b291-841df3c76db9-kube-api-access-vsndh\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:55:20.138242 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.138172    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:55:20.138242 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.138183    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4979738e-bb00-464e-b291-841df3c76db9-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:55:20.854441 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.854403    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq" event={"ID":"4979738e-bb00-464e-b291-841df3c76db9","Type":"ContainerDied","Data":"346a9de6a561b5d5bd7f8bec6184409479e7755fbfc6080711d8d38f1fe8d586"}
Jun 03 14:55:20.854441 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.854441    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="346a9de6a561b5d5bd7f8bec6184409479e7755fbfc6080711d8d38f1fe8d586"
Jun 03 14:55:20.854441 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:20.854448    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/410e69f41462d9d02a48f76ad929b5f41ed146182df7ab38cf9ce4e1cd2tbpq"
Jun 03 14:55:24.943589 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:24.943563    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 14:55:24.943982 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:24.943728    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 14:55:24.947015 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:24.946992    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:55:24.947303 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:24.947289    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 14:55:28.496479 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496444    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"]
Jun 03 14:55:28.500108 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496783    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979738e-bb00-464e-b291-841df3c76db9" containerName="util"
Jun 03 14:55:28.500108 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496795    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979738e-bb00-464e-b291-841df3c76db9" containerName="util"
Jun 03 14:55:28.500108 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496808    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979738e-bb00-464e-b291-841df3c76db9" containerName="pull"
Jun 03 14:55:28.500108 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496813    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979738e-bb00-464e-b291-841df3c76db9" containerName="pull"
Jun 03 14:55:28.500108 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496823    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4979738e-bb00-464e-b291-841df3c76db9" containerName="extract"
Jun 03 14:55:28.500108 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496829    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="4979738e-bb00-464e-b291-841df3c76db9" containerName="extract"
Jun 03 14:55:28.500108 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.496880    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="4979738e-bb00-464e-b291-841df3c76db9" containerName="extract"
Jun 03 14:55:28.500445 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.500111    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.503071 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.503051    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 03 14:55:28.503296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.503281    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 03 14:55:28.503496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.503471    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-j7tbk\""
Jun 03 14:55:28.503657 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.503634    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 03 14:55:28.503870 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.503851    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 03 14:55:28.509732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.509708    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"]
Jun 03 14:55:28.620266 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.620237    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9616cafb-339f-486f-8e04-a080f1f21f5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.620266 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.620270    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7njtw\" (UniqueName: \"kubernetes.io/projected/9616cafb-339f-486f-8e04-a080f1f21f5e-kube-api-access-7njtw\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.620506 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.620302    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9616cafb-339f-486f-8e04-a080f1f21f5e-manifests\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.620506 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.620420    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9616cafb-339f-486f-8e04-a080f1f21f5e-tmp\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.620506 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.620456    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9616cafb-339f-486f-8e04-a080f1f21f5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.721065 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.721028    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9616cafb-339f-486f-8e04-a080f1f21f5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.721261 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.721066    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7njtw\" (UniqueName: \"kubernetes.io/projected/9616cafb-339f-486f-8e04-a080f1f21f5e-kube-api-access-7njtw\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.721261 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.721116    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9616cafb-339f-486f-8e04-a080f1f21f5e-manifests\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.721261 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.721222    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9616cafb-339f-486f-8e04-a080f1f21f5e-tmp\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.721261 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.721250    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9616cafb-339f-486f-8e04-a080f1f21f5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.721610 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.721576    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9616cafb-339f-486f-8e04-a080f1f21f5e-manifests\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.723480 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.723453    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9616cafb-339f-486f-8e04-a080f1f21f5e-tmp\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.723609 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.723594    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9616cafb-339f-486f-8e04-a080f1f21f5e-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.723654 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.723637    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9616cafb-339f-486f-8e04-a080f1f21f5e-webhook-cert\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.737614 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.737590    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7njtw\" (UniqueName: \"kubernetes.io/projected/9616cafb-339f-486f-8e04-a080f1f21f5e-kube-api-access-7njtw\") pod \"opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp\" (UID: \"9616cafb-339f-486f-8e04-a080f1f21f5e\") " pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.813067 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.813005    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:28.944881 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:28.944830    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"]
Jun 03 14:55:28.947535 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:55:28.947504    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9616cafb_339f_486f_8e04_a080f1f21f5e.slice/crio-fac862c7285a7fcacddc1e0f0820fb3bb5f91c3c5a0e04e119ec3d7cfe3ba906 WatchSource:0}: Error finding container fac862c7285a7fcacddc1e0f0820fb3bb5f91c3c5a0e04e119ec3d7cfe3ba906: Status 404 returned error can't find the container with id fac862c7285a7fcacddc1e0f0820fb3bb5f91c3c5a0e04e119ec3d7cfe3ba906
Jun 03 14:55:29.888406 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:29.888369    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp" event={"ID":"9616cafb-339f-486f-8e04-a080f1f21f5e","Type":"ContainerStarted","Data":"fac862c7285a7fcacddc1e0f0820fb3bb5f91c3c5a0e04e119ec3d7cfe3ba906"}
Jun 03 14:55:32.901583 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:32.901541    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp" event={"ID":"9616cafb-339f-486f-8e04-a080f1f21f5e","Type":"ContainerStarted","Data":"616d0dd23ebea7d0feaa0e765b27d85339776860a5e1d17b9b03a8da834192bd"}
Jun 03 14:55:33.906625 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:33.906589    2576 generic.go:358] "Generic (PLEG): container finished" podID="9616cafb-339f-486f-8e04-a080f1f21f5e" containerID="616d0dd23ebea7d0feaa0e765b27d85339776860a5e1d17b9b03a8da834192bd" exitCode=0
Jun 03 14:55:33.907025 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:33.906655    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp" event={"ID":"9616cafb-339f-486f-8e04-a080f1f21f5e","Type":"ContainerDied","Data":"616d0dd23ebea7d0feaa0e765b27d85339776860a5e1d17b9b03a8da834192bd"}
Jun 03 14:55:34.911884 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:34.911851    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp" event={"ID":"9616cafb-339f-486f-8e04-a080f1f21f5e","Type":"ContainerStarted","Data":"13a7d827915e77f7b4de64724e3cfadf7de84fae927c6d7a15cc167be598ee1c"}
Jun 03 14:55:34.912296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:34.911981    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:34.934246 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:34.934196    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp" podStartSLOduration=1.659771023 podStartE2EDuration="6.934183807s" podCreationTimestamp="2026-06-03 14:55:28 +0000 UTC" firstStartedPulling="2026-06-03 14:55:28.949156467 +0000 UTC m=+604.465949504" lastFinishedPulling="2026-06-03 14:55:34.223569254 +0000 UTC m=+609.740362288" observedRunningTime="2026-06-03 14:55:34.932731123 +0000 UTC m=+610.449524181" watchObservedRunningTime="2026-06-03 14:55:34.934183807 +0000 UTC m=+610.450976862"
Jun 03 14:55:45.917676 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:45.917599    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp"
Jun 03 14:55:49.259527 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.259492    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-6577596cd5-4hvbw"]
Jun 03 14:55:49.263020 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.263002    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:49.265566 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.265548    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\""
Jun 03 14:55:49.265655 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.265620    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-wk2r5\""
Jun 03 14:55:49.273879 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.273856    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-4hvbw"]
Jun 03 14:55:49.294814 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.294784    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-th6gq\" (UniqueName: \"kubernetes.io/projected/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-kube-api-access-th6gq\") pod \"model-serving-api-6577596cd5-4hvbw\" (UID: \"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55\") " pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:49.294936 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.294823    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-tls-certs\") pod \"model-serving-api-6577596cd5-4hvbw\" (UID: \"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55\") " pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:49.396847 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.396801    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-th6gq\" (UniqueName: \"kubernetes.io/projected/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-kube-api-access-th6gq\") pod \"model-serving-api-6577596cd5-4hvbw\" (UID: \"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55\") " pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:49.397045 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.396886    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-tls-certs\") pod \"model-serving-api-6577596cd5-4hvbw\" (UID: \"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55\") " pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:49.397780 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:55:49.397753    2576 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found
Jun 03 14:55:49.398252 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:55:49.398235    2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-tls-certs podName:990e0aef-5c27-4850-9fe2-1c5fd5fd7d55 nodeName:}" failed. No retries permitted until 2026-06-03 14:55:49.89820813 +0000 UTC m=+625.415001178 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-tls-certs") pod "model-serving-api-6577596cd5-4hvbw" (UID: "990e0aef-5c27-4850-9fe2-1c5fd5fd7d55") : secret "model-serving-api-tls" not found
Jun 03 14:55:49.409106 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.409074    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-th6gq\" (UniqueName: \"kubernetes.io/projected/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-kube-api-access-th6gq\") pod \"model-serving-api-6577596cd5-4hvbw\" (UID: \"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55\") " pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:49.902624 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.902583    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-tls-certs\") pod \"model-serving-api-6577596cd5-4hvbw\" (UID: \"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55\") " pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:49.905069 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:49.905036    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/990e0aef-5c27-4850-9fe2-1c5fd5fd7d55-tls-certs\") pod \"model-serving-api-6577596cd5-4hvbw\" (UID: \"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55\") " pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:50.174241 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.174158    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:50.298713 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.298684    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-6577596cd5-4hvbw"]
Jun 03 14:55:50.301081 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:55:50.301052    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod990e0aef_5c27_4850_9fe2_1c5fd5fd7d55.slice/crio-0f28f2fb6bbeb9e31f6e35ca011b05787a000e52b477f86e2e16e45042604b77 WatchSource:0}: Error finding container 0f28f2fb6bbeb9e31f6e35ca011b05787a000e52b477f86e2e16e45042604b77: Status 404 returned error can't find the container with id 0f28f2fb6bbeb9e31f6e35ca011b05787a000e52b477f86e2e16e45042604b77
Jun 03 14:55:50.307464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.307382    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"]
Jun 03 14:55:50.312233 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.312214    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.314595 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.314574    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztk72\""
Jun 03 14:55:50.314999 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.314853    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 14:55:50.315104 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.315027    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 14:55:50.318200 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.318181    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"]
Jun 03 14:55:50.407452 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.407418    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.407604 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.407561    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.407604 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.407592    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t92gb\" (UniqueName: \"kubernetes.io/projected/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-kube-api-access-t92gb\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.508578 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.508551    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.508749 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.508584    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t92gb\" (UniqueName: \"kubernetes.io/projected/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-kube-api-access-t92gb\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.508749 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.508611    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.508970 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.508952    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-bundle\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.509037 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.508970    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-util\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.516111 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.516087    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t92gb\" (UniqueName: \"kubernetes.io/projected/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-kube-api-access-t92gb\") pod \"4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") " pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.622610 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.622581    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:50.748364 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.748330    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"]
Jun 03 14:55:50.752008 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:55:50.751968    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14e45ae4_4b82_48ac_9c1f_db34ca2c2d94.slice/crio-ae8bf0cd75ec180f0478d83721c65ff73371fca66e81130ddae34781773bd6b5 WatchSource:0}: Error finding container ae8bf0cd75ec180f0478d83721c65ff73371fca66e81130ddae34781773bd6b5: Status 404 returned error can't find the container with id ae8bf0cd75ec180f0478d83721c65ff73371fca66e81130ddae34781773bd6b5
Jun 03 14:55:50.964911 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.964880    2576 generic.go:358] "Generic (PLEG): container finished" podID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerID="406fdbb9cbbbe0e008add4144a906b6f7c08e47fd3a01ccd2453ec9dac451d28" exitCode=0
Jun 03 14:55:50.965057 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.964960    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26" event={"ID":"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94","Type":"ContainerDied","Data":"406fdbb9cbbbe0e008add4144a906b6f7c08e47fd3a01ccd2453ec9dac451d28"}
Jun 03 14:55:50.965057 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.964994    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26" event={"ID":"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94","Type":"ContainerStarted","Data":"ae8bf0cd75ec180f0478d83721c65ff73371fca66e81130ddae34781773bd6b5"}
Jun 03 14:55:50.966057 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:50.966040    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-4hvbw" event={"ID":"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55","Type":"ContainerStarted","Data":"0f28f2fb6bbeb9e31f6e35ca011b05787a000e52b477f86e2e16e45042604b77"}
Jun 03 14:55:52.974146 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:52.974108    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-6577596cd5-4hvbw" event={"ID":"990e0aef-5c27-4850-9fe2-1c5fd5fd7d55","Type":"ContainerStarted","Data":"8ce1195b114757bed31f3c39b5d5a24076804d2e6d8fba464ef3cab0c1707f4a"}
Jun 03 14:55:52.975692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:52.975589    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:55:52.993027 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:52.992986    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/model-serving-api-6577596cd5-4hvbw" podStartSLOduration=1.636763892 podStartE2EDuration="3.992969486s" podCreationTimestamp="2026-06-03 14:55:49 +0000 UTC" firstStartedPulling="2026-06-03 14:55:50.302934194 +0000 UTC m=+625.819727226" lastFinishedPulling="2026-06-03 14:55:52.659139772 +0000 UTC m=+628.175932820" observedRunningTime="2026-06-03 14:55:52.992155806 +0000 UTC m=+628.508948863" watchObservedRunningTime="2026-06-03 14:55:52.992969486 +0000 UTC m=+628.509762541"
Jun 03 14:55:53.978746 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:53.978713    2576 generic.go:358] "Generic (PLEG): container finished" podID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerID="f5d03dbebd91efec992974f1217e71e741c94aac371e9ad26caebe4b3eafd778" exitCode=0
Jun 03 14:55:53.979156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:53.978797    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26" event={"ID":"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94","Type":"ContainerDied","Data":"f5d03dbebd91efec992974f1217e71e741c94aac371e9ad26caebe4b3eafd778"}
Jun 03 14:55:54.987763 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:54.987731    2576 generic.go:358] "Generic (PLEG): container finished" podID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerID="526e18fabbb42d426748530c37926e15a5175906ec557c1c7b760b6e94e778c2" exitCode=0
Jun 03 14:55:54.988124 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:54.987818    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26" event={"ID":"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94","Type":"ContainerDied","Data":"526e18fabbb42d426748530c37926e15a5175906ec557c1c7b760b6e94e778c2"}
Jun 03 14:55:56.134747 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.134725    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:56.175439 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175411    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"]
Jun 03 14:55:56.175800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175778    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerName="util"
Jun 03 14:55:56.175800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175794    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerName="util"
Jun 03 14:55:56.175800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175802    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerName="pull"
Jun 03 14:55:56.175800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175808    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerName="pull"
Jun 03 14:55:56.176069 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175825    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerName="extract"
Jun 03 14:55:56.176069 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175831    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerName="extract"
Jun 03 14:55:56.176069 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.175890    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" containerName="extract"
Jun 03 14:55:56.180490 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.180469    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.184255 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.184216    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 03 14:55:56.184368 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.184330    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 03 14:55:56.184532 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.184507    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-282gt\""
Jun 03 14:55:56.184642 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.184626    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 03 14:55:56.187673 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.187649    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 03 14:55:56.188291 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.188236    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 03 14:55:56.190013 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.189989    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"]
Jun 03 14:55:56.260667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.260589    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t92gb\" (UniqueName: \"kubernetes.io/projected/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-kube-api-access-t92gb\") pod \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") "
Jun 03 14:55:56.260667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.260630    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-bundle\") pod \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") "
Jun 03 14:55:56.260837 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.260694    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-util\") pod \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\" (UID: \"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94\") "
Jun 03 14:55:56.260837 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.260797    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d324daf7-1db1-480f-acf9-34f664f7352b-cert\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.260931 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.260844    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d324daf7-1db1-480f-acf9-34f664f7352b-metrics-cert\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.261036 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.261013    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d324daf7-1db1-480f-acf9-34f664f7352b-manager-config\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.261090 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.261064    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x5xh\" (UniqueName: \"kubernetes.io/projected/d324daf7-1db1-480f-acf9-34f664f7352b-kube-api-access-6x5xh\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.261566 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.261545    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-bundle" (OuterVolumeSpecName: "bundle") pod "14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" (UID: "14e45ae4-4b82-48ac-9c1f-db34ca2c2d94"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:55:56.262620 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.262598    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-kube-api-access-t92gb" (OuterVolumeSpecName: "kube-api-access-t92gb") pod "14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" (UID: "14e45ae4-4b82-48ac-9c1f-db34ca2c2d94"). InnerVolumeSpecName "kube-api-access-t92gb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:55:56.267499 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.267470    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-util" (OuterVolumeSpecName: "util") pod "14e45ae4-4b82-48ac-9c1f-db34ca2c2d94" (UID: "14e45ae4-4b82-48ac-9c1f-db34ca2c2d94"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:55:56.361526 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.361496    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d324daf7-1db1-480f-acf9-34f664f7352b-manager-config\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.361526 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.361531    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6x5xh\" (UniqueName: \"kubernetes.io/projected/d324daf7-1db1-480f-acf9-34f664f7352b-kube-api-access-6x5xh\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.361782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.361566    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d324daf7-1db1-480f-acf9-34f664f7352b-cert\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.361782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.361604    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d324daf7-1db1-480f-acf9-34f664f7352b-metrics-cert\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.361782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.361705    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t92gb\" (UniqueName: \"kubernetes.io/projected/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-kube-api-access-t92gb\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:55:56.361782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.361722    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:55:56.361782 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.361741    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14e45ae4-4b82-48ac-9c1f-db34ca2c2d94-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:55:56.362143 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.362107    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d324daf7-1db1-480f-acf9-34f664f7352b-manager-config\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.364773 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.364745    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d324daf7-1db1-480f-acf9-34f664f7352b-cert\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.364866 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.364744    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d324daf7-1db1-480f-acf9-34f664f7352b-metrics-cert\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.375535 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.375503    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x5xh\" (UniqueName: \"kubernetes.io/projected/d324daf7-1db1-480f-acf9-34f664f7352b-kube-api-access-6x5xh\") pod \"lws-controller-manager-5c7547bc79-shkf2\" (UID: \"d324daf7-1db1-480f-acf9-34f664f7352b\") " pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.491955 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.491918    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:56.616870 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.616841    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"]
Jun 03 14:55:56.618278 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:55:56.618250    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd324daf7_1db1_480f_acf9_34f664f7352b.slice/crio-9a7f587d207e8fd911531e8c7ca951f272ccab456e2c840cf8ef305a6d44013a WatchSource:0}: Error finding container 9a7f587d207e8fd911531e8c7ca951f272ccab456e2c840cf8ef305a6d44013a: Status 404 returned error can't find the container with id 9a7f587d207e8fd911531e8c7ca951f272ccab456e2c840cf8ef305a6d44013a
Jun 03 14:55:56.995186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.995154    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2" event={"ID":"d324daf7-1db1-480f-acf9-34f664f7352b","Type":"ContainerStarted","Data":"9a7f587d207e8fd911531e8c7ca951f272ccab456e2c840cf8ef305a6d44013a"}
Jun 03 14:55:56.996732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.996705    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26" event={"ID":"14e45ae4-4b82-48ac-9c1f-db34ca2c2d94","Type":"ContainerDied","Data":"ae8bf0cd75ec180f0478d83721c65ff73371fca66e81130ddae34781773bd6b5"}
Jun 03 14:55:56.996732 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.996736    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ae8bf0cd75ec180f0478d83721c65ff73371fca66e81130ddae34781773bd6b5"
Jun 03 14:55:56.996879 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:56.996764    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/4c892a6d2d8a57acbc49427d3a7d24e253bab25be2c607ef405d2c4835fxv26"
Jun 03 14:55:59.005416 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:59.005376    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2" event={"ID":"d324daf7-1db1-480f-acf9-34f664f7352b","Type":"ContainerStarted","Data":"761167c62606c26e6ae0cb1c03c7d85e39647911c92f2f2155a3432cc8eab310"}
Jun 03 14:55:59.005804 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:59.005515    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:55:59.024391 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:55:59.024347    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2" podStartSLOduration=1.302848231 podStartE2EDuration="3.024333417s" podCreationTimestamp="2026-06-03 14:55:56 +0000 UTC" firstStartedPulling="2026-06-03 14:55:56.62001702 +0000 UTC m=+632.136810056" lastFinishedPulling="2026-06-03 14:55:58.341502209 +0000 UTC m=+633.858295242" observedRunningTime="2026-06-03 14:55:59.023322158 +0000 UTC m=+634.540115213" watchObservedRunningTime="2026-06-03 14:55:59.024333417 +0000 UTC m=+634.541126472"
Jun 03 14:56:03.983395 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:03.983363    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-6577596cd5-4hvbw"
Jun 03 14:56:05.283354 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.283313    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"]
Jun 03 14:56:05.327187 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.327150    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"]
Jun 03 14:56:05.327440 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.327416    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.330180 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.330158    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 14:56:05.331261 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.331245    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztk72\""
Jun 03 14:56:05.331336 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.331252    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 14:56:05.454911 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.454874    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dqbc\" (UniqueName: \"kubernetes.io/projected/298e1b55-ecdf-4994-92c0-1691eccfd8d3-kube-api-access-2dqbc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.455092 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.454922    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.455092 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.454951    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.555922 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.555827    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2dqbc\" (UniqueName: \"kubernetes.io/projected/298e1b55-ecdf-4994-92c0-1691eccfd8d3-kube-api-access-2dqbc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.555922 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.555879    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.555922 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.555906    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.556255 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.556234    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-bundle\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.556304 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.556268    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-util\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.568780 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.568756    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dqbc\" (UniqueName: \"kubernetes.io/projected/298e1b55-ecdf-4994-92c0-1691eccfd8d3-kube-api-access-2dqbc\") pod \"c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") " pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.636872 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.636839    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:05.765024 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:05.765001    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"]
Jun 03 14:56:05.767467 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:56:05.767440    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod298e1b55_ecdf_4994_92c0_1691eccfd8d3.slice/crio-1ac1366ab9a20e69f26780e9ffbd088c2eac14cf4d411e2c6bc375ef69cb5734 WatchSource:0}: Error finding container 1ac1366ab9a20e69f26780e9ffbd088c2eac14cf4d411e2c6bc375ef69cb5734: Status 404 returned error can't find the container with id 1ac1366ab9a20e69f26780e9ffbd088c2eac14cf4d411e2c6bc375ef69cb5734
Jun 03 14:56:06.031832 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:06.031803    2576 generic.go:358] "Generic (PLEG): container finished" podID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerID="c4ac9b1a00c3240c92619a6e290b30b4383dc8061b101b7b31ed25ce3fe9e27e" exitCode=0
Jun 03 14:56:06.031975 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:06.031862    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b" event={"ID":"298e1b55-ecdf-4994-92c0-1691eccfd8d3","Type":"ContainerDied","Data":"c4ac9b1a00c3240c92619a6e290b30b4383dc8061b101b7b31ed25ce3fe9e27e"}
Jun 03 14:56:06.031975 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:06.031883    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b" event={"ID":"298e1b55-ecdf-4994-92c0-1691eccfd8d3","Type":"ContainerStarted","Data":"1ac1366ab9a20e69f26780e9ffbd088c2eac14cf4d411e2c6bc375ef69cb5734"}
Jun 03 14:56:08.041182 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:08.041119    2576 generic.go:358] "Generic (PLEG): container finished" podID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerID="4eda196f33f3cd2f75e4ef1002d5e092947f003ded6f0750559127fef68756e9" exitCode=0
Jun 03 14:56:08.041182 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:08.041167    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b" event={"ID":"298e1b55-ecdf-4994-92c0-1691eccfd8d3","Type":"ContainerDied","Data":"4eda196f33f3cd2f75e4ef1002d5e092947f003ded6f0750559127fef68756e9"}
Jun 03 14:56:09.045880 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:09.045846    2576 generic.go:358] "Generic (PLEG): container finished" podID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerID="71672ed25e26053c2df4834385bb13fbfab8f44580d2d24d0478d81e47232775" exitCode=0
Jun 03 14:56:09.045880 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:09.045881    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b" event={"ID":"298e1b55-ecdf-4994-92c0-1691eccfd8d3","Type":"ContainerDied","Data":"71672ed25e26053c2df4834385bb13fbfab8f44580d2d24d0478d81e47232775"}
Jun 03 14:56:10.010640 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.010611    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5c7547bc79-shkf2"
Jun 03 14:56:10.173627 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.173606    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:10.299951 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.299876    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2dqbc\" (UniqueName: \"kubernetes.io/projected/298e1b55-ecdf-4994-92c0-1691eccfd8d3-kube-api-access-2dqbc\") pod \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") "
Jun 03 14:56:10.299951 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.299933    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-bundle\") pod \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") "
Jun 03 14:56:10.300184 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.299995    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-util\") pod \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\" (UID: \"298e1b55-ecdf-4994-92c0-1691eccfd8d3\") "
Jun 03 14:56:10.300789 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.300763    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-bundle" (OuterVolumeSpecName: "bundle") pod "298e1b55-ecdf-4994-92c0-1691eccfd8d3" (UID: "298e1b55-ecdf-4994-92c0-1691eccfd8d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:56:10.301993 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.301975    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/298e1b55-ecdf-4994-92c0-1691eccfd8d3-kube-api-access-2dqbc" (OuterVolumeSpecName: "kube-api-access-2dqbc") pod "298e1b55-ecdf-4994-92c0-1691eccfd8d3" (UID: "298e1b55-ecdf-4994-92c0-1691eccfd8d3"). InnerVolumeSpecName "kube-api-access-2dqbc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:56:10.305363 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.305327    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-util" (OuterVolumeSpecName: "util") pod "298e1b55-ecdf-4994-92c0-1691eccfd8d3" (UID: "298e1b55-ecdf-4994-92c0-1691eccfd8d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:56:10.401559 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.401531    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:10.401559 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.401555    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2dqbc\" (UniqueName: \"kubernetes.io/projected/298e1b55-ecdf-4994-92c0-1691eccfd8d3-kube-api-access-2dqbc\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:10.401692 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:10.401567    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/298e1b55-ecdf-4994-92c0-1691eccfd8d3-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:11.054353 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:11.054329    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b"
Jun 03 14:56:11.054486 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:11.054325    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c34dbd22d61532abdd91a8be490d70c9b1095425e8ccf73b542d2e762a2nj6b" event={"ID":"298e1b55-ecdf-4994-92c0-1691eccfd8d3","Type":"ContainerDied","Data":"1ac1366ab9a20e69f26780e9ffbd088c2eac14cf4d411e2c6bc375ef69cb5734"}
Jun 03 14:56:11.054486 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:11.054433    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ac1366ab9a20e69f26780e9ffbd088c2eac14cf4d411e2c6bc375ef69cb5734"
Jun 03 14:56:21.938300 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938264    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"]
Jun 03 14:56:21.938876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938781    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerName="extract"
Jun 03 14:56:21.938876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938801    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerName="extract"
Jun 03 14:56:21.938876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938830    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerName="pull"
Jun 03 14:56:21.938876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938839    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerName="pull"
Jun 03 14:56:21.938876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938861    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerName="util"
Jun 03 14:56:21.938876 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938868    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerName="util"
Jun 03 14:56:21.939201 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.938953    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="298e1b55-ecdf-4994-92c0-1691eccfd8d3" containerName="extract"
Jun 03 14:56:21.942307 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.942287    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:21.945504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.945480    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-hlvmt\""
Jun 03 14:56:21.945626 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.945486    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 03 14:56:21.945626 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.945532    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 03 14:56:21.945831 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.945800    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 03 14:56:21.957529 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:21.957507    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"]
Jun 03 14:56:22.103906 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.103875    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.103906 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.103911    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.104156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.103930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.104156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.104000    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95rsq\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-kube-api-access-95rsq\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.104156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.104072    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.104156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.104101    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.104156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.104151    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.104374 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.104228    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.104374 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.104273    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.204975 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.204945    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-95rsq\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-kube-api-access-95rsq\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205179 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.204994    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205179 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205031    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205179 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205063    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205179 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205156    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205415 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205205    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205415 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205326    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205524 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205427    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205524 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205459    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205628 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205548    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205683 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205619    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205683 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205659    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205796 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205765    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-data\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.205850 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.205821    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.207173 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.207146    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"]
Jun 03 14:56:22.207787 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.207762    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.208011 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.207994    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.211239 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.211221    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.212979 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.212958    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-95rsq\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-kube-api-access-95rsq\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.220550 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.220507    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-token\") pod \"data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.223639 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.223615    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"]
Jun 03 14:56:22.253694 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.253667    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:22.305991 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.305952    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xvbwq\" (UniqueName: \"kubernetes.io/projected/4099e067-72af-45f7-9d3e-5e8544e85ece-kube-api-access-xvbwq\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306018    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306042    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306071    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306100    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306168    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306726 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306203    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4099e067-72af-45f7-9d3e-5e8544e85ece-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306726 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306258    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.306726 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.306298    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.403808 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.403783    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"]
Jun 03 14:56:22.405821 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:56:22.405795    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb1140d0_0b03_4150_9c96_9bd762c2b5fa.slice/crio-bfb1039f2745a7acd8f96e26d0b285111a0c594f1a85c7a369abf7a88aadd5cf WatchSource:0}: Error finding container bfb1039f2745a7acd8f96e26d0b285111a0c594f1a85c7a369abf7a88aadd5cf: Status 404 returned error can't find the container with id bfb1039f2745a7acd8f96e26d0b285111a0c594f1a85c7a369abf7a88aadd5cf
Jun 03 14:56:22.406881 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.406859    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xvbwq\" (UniqueName: \"kubernetes.io/projected/4099e067-72af-45f7-9d3e-5e8544e85ece-kube-api-access-xvbwq\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.406984 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.406902    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.406984 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.406926    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.406984 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.406951    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.406984 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.406971    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407226 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.406997    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407226 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407155    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4099e067-72af-45f7-9d3e-5e8544e85ece-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407226 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407213    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407391 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407253    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407391 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407312    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407630 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407393    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407630 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407602    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407787 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407639    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.407889 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.407866    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4099e067-72af-45f7-9d3e-5e8544e85ece-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.409450 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.409429    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.409745 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.409711    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.414485 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.414461    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4099e067-72af-45f7-9d3e-5e8544e85ece-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.414562 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.414509    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xvbwq\" (UniqueName: \"kubernetes.io/projected/4099e067-72af-45f7-9d3e-5e8544e85ece-kube-api-access-xvbwq\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6\" (UID: \"4099e067-72af-45f7-9d3e-5e8544e85ece\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.541604 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.541518    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:22.684670 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:22.684647    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"]
Jun 03 14:56:22.686789 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:56:22.686757    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4099e067_72af_45f7_9d3e_5e8544e85ece.slice/crio-aa922e48a205d54882b099c7131489c46c0a389514b73b8e3c5a75543fa0ab31 WatchSource:0}: Error finding container aa922e48a205d54882b099c7131489c46c0a389514b73b8e3c5a75543fa0ab31: Status 404 returned error can't find the container with id aa922e48a205d54882b099c7131489c46c0a389514b73b8e3c5a75543fa0ab31
Jun 03 14:56:23.096196 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:23.096153    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" event={"ID":"db1140d0-0b03-4150-9c96-9bd762c2b5fa","Type":"ContainerStarted","Data":"bfb1039f2745a7acd8f96e26d0b285111a0c594f1a85c7a369abf7a88aadd5cf"}
Jun 03 14:56:23.097700 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:23.097668    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6" event={"ID":"4099e067-72af-45f7-9d3e-5e8544e85ece","Type":"ContainerStarted","Data":"aa922e48a205d54882b099c7131489c46c0a389514b73b8e3c5a75543fa0ab31"}
Jun 03 14:56:25.300654 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:25.300603    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:56:25.300952 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:25.300702    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:56:25.300952 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:25.300743    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:56:25.305155 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:25.305107    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:56:25.305280 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:25.305195    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:56:25.305280 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:25.305228    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:56:26.110310 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.110272    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" event={"ID":"db1140d0-0b03-4150-9c96-9bd762c2b5fa","Type":"ContainerStarted","Data":"dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09"}
Jun 03 14:56:26.111651 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.111624    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6" event={"ID":"4099e067-72af-45f7-9d3e-5e8544e85ece","Type":"ContainerStarted","Data":"2a2bbf6110052ed4c7fb4ea54513b627c6de8b885762fbcd049d7549e2ce4dd8"}
Jun 03 14:56:26.130940 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.130888    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" podStartSLOduration=2.238523406 podStartE2EDuration="5.130876851s" podCreationTimestamp="2026-06-03 14:56:21 +0000 UTC" firstStartedPulling="2026-06-03 14:56:22.407926912 +0000 UTC m=+657.924719948" lastFinishedPulling="2026-06-03 14:56:25.300280344 +0000 UTC m=+660.817073393" observedRunningTime="2026-06-03 14:56:26.128771854 +0000 UTC m=+661.645564909" watchObservedRunningTime="2026-06-03 14:56:26.130876851 +0000 UTC m=+661.647669906"
Jun 03 14:56:26.146999 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.146942    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6" podStartSLOduration=1.530706297 podStartE2EDuration="4.14692405s" podCreationTimestamp="2026-06-03 14:56:22 +0000 UTC" firstStartedPulling="2026-06-03 14:56:22.688673088 +0000 UTC m=+658.205466125" lastFinishedPulling="2026-06-03 14:56:25.304890846 +0000 UTC m=+660.821683878" observedRunningTime="2026-06-03 14:56:26.145568339 +0000 UTC m=+661.662361395" watchObservedRunningTime="2026-06-03 14:56:26.14692405 +0000 UTC m=+661.663717107"
Jun 03 14:56:26.253907 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.253876    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:26.255304 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.255282    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jun 03 14:56:26.255410 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.255326    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jun 03 14:56:26.522182 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.522147    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-69b458fb86-fgvs9"]
Jun 03 14:56:26.526230 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.526211    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.529034 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.529012    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 03 14:56:26.529175 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.529095    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-9kw22\""
Jun 03 14:56:26.535440 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.535412    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69b458fb86-fgvs9"]
Jun 03 14:56:26.542259 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.542238    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:26.572960 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.572925    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:26.651447 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.651409    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39-redirect-config\") pod \"dashboard-redirect-69b458fb86-fgvs9\" (UID: \"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39\") " pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.651447 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.651452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2r7t\" (UniqueName: \"kubernetes.io/projected/02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39-kube-api-access-x2r7t\") pod \"dashboard-redirect-69b458fb86-fgvs9\" (UID: \"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39\") " pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.752141 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.752102    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39-redirect-config\") pod \"dashboard-redirect-69b458fb86-fgvs9\" (UID: \"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39\") " pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.752320 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.752175    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x2r7t\" (UniqueName: \"kubernetes.io/projected/02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39-kube-api-access-x2r7t\") pod \"dashboard-redirect-69b458fb86-fgvs9\" (UID: \"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39\") " pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.752790 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.752770    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39-redirect-config\") pod \"dashboard-redirect-69b458fb86-fgvs9\" (UID: \"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39\") " pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.760260 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.760237    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2r7t\" (UniqueName: \"kubernetes.io/projected/02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39-kube-api-access-x2r7t\") pod \"dashboard-redirect-69b458fb86-fgvs9\" (UID: \"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39\") " pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.839910 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.839832    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9"
Jun 03 14:56:26.992053 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:26.992023    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-69b458fb86-fgvs9"]
Jun 03 14:56:26.993612 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:56:26.993586    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02aea2bf_1bd5_45ef_a8d4_0ddb6e0cee39.slice/crio-c1eb8f66ebb53532eb5ef44f33f8839f914b1b7d97e97344d7135e0761220fcd WatchSource:0}: Error finding container c1eb8f66ebb53532eb5ef44f33f8839f914b1b7d97e97344d7135e0761220fcd: Status 404 returned error can't find the container with id c1eb8f66ebb53532eb5ef44f33f8839f914b1b7d97e97344d7135e0761220fcd
Jun 03 14:56:27.116338 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:27.116252    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9" event={"ID":"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39","Type":"ContainerStarted","Data":"c1eb8f66ebb53532eb5ef44f33f8839f914b1b7d97e97344d7135e0761220fcd"}
Jun 03 14:56:27.116590 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:27.116571    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:27.118023 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:27.118001    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6"
Jun 03 14:56:27.173121 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:27.173085    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"]
Jun 03 14:56:27.254204 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:27.254172    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jun 03 14:56:27.254344 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:27.254228    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jun 03 14:56:28.254076 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:28.254040    2576 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused" start-of-body=
Jun 03 14:56:28.254618 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:28.254101    2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.38:15021/healthz/ready\": dial tcp 10.134.0.38:15021: connect: connection refused"
Jun 03 14:56:29.126395 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:29.126340    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerName="istio-proxy" containerID="cri-o://dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09" gracePeriod=30
Jun 03 14:56:33.143423 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:33.143383    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9" event={"ID":"02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39","Type":"ContainerStarted","Data":"fef7d5cd52b6d08340d420a103c239f3a3309facebf0e9531e37b01b20bec470"}
Jun 03 14:56:33.160436 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:33.160387    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-69b458fb86-fgvs9" podStartSLOduration=1.47001649 podStartE2EDuration="7.160370969s" podCreationTimestamp="2026-06-03 14:56:26 +0000 UTC" firstStartedPulling="2026-06-03 14:56:26.995320059 +0000 UTC m=+662.512113096" lastFinishedPulling="2026-06-03 14:56:32.685674539 +0000 UTC m=+668.202467575" observedRunningTime="2026-06-03 14:56:33.158528862 +0000 UTC m=+668.675321929" watchObservedRunningTime="2026-06-03 14:56:33.160370969 +0000 UTC m=+668.677164024"
Jun 03 14:56:34.372484 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.372461    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:34.409886 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.409808    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-certs\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.409886 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.409846    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-credential-socket\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.409886 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.409878    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-podinfo\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.409919    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-95rsq\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-kube-api-access-95rsq\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.409979    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-envoy\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410010    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-token\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410061    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-socket\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410090    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-data\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410095    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410121    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:56:34.410172 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410159    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istiod-ca-cert\") pod \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\" (UID: \"db1140d0-0b03-4150-9c96-9bd762c2b5fa\") "
Jun 03 14:56:34.410558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410336    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:56:34.410558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410352    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-data" (OuterVolumeSpecName: "istio-data") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:56:34.410558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410458    2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-socket\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.410558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410477    2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-data\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.410558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410493    2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-workload-certs\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.410558 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410506    2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-credential-socket\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.410799 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.410679    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 03 14:56:34.412599 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.412564    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:56:34.412709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.412641    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-token" (OuterVolumeSpecName: "istio-token") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:56:34.412709 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.412663    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-kube-api-access-95rsq" (OuterVolumeSpecName: "kube-api-access-95rsq") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "kube-api-access-95rsq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:56:34.412804 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.412705    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "db1140d0-0b03-4150-9c96-9bd762c2b5fa" (UID: "db1140d0-0b03-4150-9c96-9bd762c2b5fa"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jun 03 14:56:34.511943 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.511907    2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-envoy\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.511943 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.511936    2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-token\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.511943 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.511945    2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istiod-ca-cert\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.512177 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.511955    2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/db1140d0-0b03-4150-9c96-9bd762c2b5fa-istio-podinfo\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:34.512177 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:34.511965    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-95rsq\" (UniqueName: \"kubernetes.io/projected/db1140d0-0b03-4150-9c96-9bd762c2b5fa-kube-api-access-95rsq\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:35.151024 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.150989    2576 generic.go:358] "Generic (PLEG): container finished" podID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerID="dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09" exitCode=0
Jun 03 14:56:35.151226 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.151048    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"
Jun 03 14:56:35.151226 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.151072    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" event={"ID":"db1140d0-0b03-4150-9c96-9bd762c2b5fa","Type":"ContainerDied","Data":"dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09"}
Jun 03 14:56:35.151226 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.151114    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn" event={"ID":"db1140d0-0b03-4150-9c96-9bd762c2b5fa","Type":"ContainerDied","Data":"bfb1039f2745a7acd8f96e26d0b285111a0c594f1a85c7a369abf7a88aadd5cf"}
Jun 03 14:56:35.151226 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.151149    2576 scope.go:117] "RemoveContainer" containerID="dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09"
Jun 03 14:56:35.159717 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.159698    2576 scope.go:117] "RemoveContainer" containerID="dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09"
Jun 03 14:56:35.159933 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:56:35.159916    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09\": container with ID starting with dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09 not found: ID does not exist" containerID="dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09"
Jun 03 14:56:35.159985 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.159939    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09"} err="failed to get container status \"dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09\": rpc error: code = NotFound desc = could not find container \"dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09\": container with ID starting with dbb28109b120a69ef74f8835f1720b548a75bf669ee9a81c5f7c5ef4be2d2e09 not found: ID does not exist"
Jun 03 14:56:35.172255 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.172233    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"]
Jun 03 14:56:35.176177 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:35.176155    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-587dfcbc44wb8dn"]
Jun 03 14:56:37.044193 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:37.044155    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" path="/var/lib/kubelet/pods/db1140d0-0b03-4150-9c96-9bd762c2b5fa/volumes"
Jun 03 14:56:49.783982 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.783948    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rq2wj"]
Jun 03 14:56:49.784456 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.784319    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerName="istio-proxy"
Jun 03 14:56:49.784456 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.784331    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerName="istio-proxy"
Jun 03 14:56:49.784456 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.784397    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="db1140d0-0b03-4150-9c96-9bd762c2b5fa" containerName="istio-proxy"
Jun 03 14:56:49.786451 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.786435    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj"
Jun 03 14:56:49.789539 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.789511    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2khff\""
Jun 03 14:56:49.790005 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.789991    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 03 14:56:49.790689 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.790667    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 03 14:56:49.796246 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.796225    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rq2wj"]
Jun 03 14:56:49.857856 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.857819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-scm62\" (UniqueName: \"kubernetes.io/projected/c14fc9b0-3b67-4c23-9371-c493efd1f354-kube-api-access-scm62\") pod \"kuadrant-operator-catalog-rq2wj\" (UID: \"c14fc9b0-3b67-4c23-9371-c493efd1f354\") " pod="kuadrant-system/kuadrant-operator-catalog-rq2wj"
Jun 03 14:56:49.958427 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.958397    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-scm62\" (UniqueName: \"kubernetes.io/projected/c14fc9b0-3b67-4c23-9371-c493efd1f354-kube-api-access-scm62\") pod \"kuadrant-operator-catalog-rq2wj\" (UID: \"c14fc9b0-3b67-4c23-9371-c493efd1f354\") " pod="kuadrant-system/kuadrant-operator-catalog-rq2wj"
Jun 03 14:56:49.966043 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:49.966013    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-scm62\" (UniqueName: \"kubernetes.io/projected/c14fc9b0-3b67-4c23-9371-c493efd1f354-kube-api-access-scm62\") pod \"kuadrant-operator-catalog-rq2wj\" (UID: \"c14fc9b0-3b67-4c23-9371-c493efd1f354\") " pod="kuadrant-system/kuadrant-operator-catalog-rq2wj"
Jun 03 14:56:50.097099 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.097013    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj"
Jun 03 14:56:50.164419 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.164364    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rq2wj"]
Jun 03 14:56:50.235166 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.235138    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rq2wj"]
Jun 03 14:56:50.236674 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:56:50.236645    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc14fc9b0_3b67_4c23_9371_c493efd1f354.slice/crio-0e11e7863fd8e6c272070af1d90d33d65b540620deef13bf47f7e339fd702b08 WatchSource:0}: Error finding container 0e11e7863fd8e6c272070af1d90d33d65b540620deef13bf47f7e339fd702b08: Status 404 returned error can't find the container with id 0e11e7863fd8e6c272070af1d90d33d65b540620deef13bf47f7e339fd702b08
Jun 03 14:56:50.362660 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.362573    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-27hvf"]
Jun 03 14:56:50.365894 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.365872    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:56:50.373377 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.373348    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-27hvf"]
Jun 03 14:56:50.465362 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.465327    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gk2rs\" (UniqueName: \"kubernetes.io/projected/757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0-kube-api-access-gk2rs\") pod \"kuadrant-operator-catalog-27hvf\" (UID: \"757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0\") " pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:56:50.566062 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.566024    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gk2rs\" (UniqueName: \"kubernetes.io/projected/757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0-kube-api-access-gk2rs\") pod \"kuadrant-operator-catalog-27hvf\" (UID: \"757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0\") " pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:56:50.574488 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.574455    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gk2rs\" (UniqueName: \"kubernetes.io/projected/757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0-kube-api-access-gk2rs\") pod \"kuadrant-operator-catalog-27hvf\" (UID: \"757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0\") " pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:56:50.676790 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.676695    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:56:50.809028 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:50.809000    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-27hvf"]
Jun 03 14:56:50.833625 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:56:50.833586    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod757ef4aa_3f6e_4eb1_8aaf_825ffd3e34d0.slice/crio-4dc2dfc7c9d3245db6b2d4dc9d7ca7c9b1cb26e50d110614c9602ac20907dc4e WatchSource:0}: Error finding container 4dc2dfc7c9d3245db6b2d4dc9d7ca7c9b1cb26e50d110614c9602ac20907dc4e: Status 404 returned error can't find the container with id 4dc2dfc7c9d3245db6b2d4dc9d7ca7c9b1cb26e50d110614c9602ac20907dc4e
Jun 03 14:56:51.214509 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:51.214473    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj" event={"ID":"c14fc9b0-3b67-4c23-9371-c493efd1f354","Type":"ContainerStarted","Data":"0e11e7863fd8e6c272070af1d90d33d65b540620deef13bf47f7e339fd702b08"}
Jun 03 14:56:51.215551 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:51.215517    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-27hvf" event={"ID":"757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0","Type":"ContainerStarted","Data":"4dc2dfc7c9d3245db6b2d4dc9d7ca7c9b1cb26e50d110614c9602ac20907dc4e"}
Jun 03 14:56:53.224549 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.224511    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-27hvf" event={"ID":"757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0","Type":"ContainerStarted","Data":"14161f3befbeedbfe556e38fa97d60a04834a6b6ac4530beb9b5cbbcad4b9ba9"}
Jun 03 14:56:53.225893 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.225868    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj" event={"ID":"c14fc9b0-3b67-4c23-9371-c493efd1f354","Type":"ContainerStarted","Data":"9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a"}
Jun 03 14:56:53.225999 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.225979    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj" podUID="c14fc9b0-3b67-4c23-9371-c493efd1f354" containerName="registry-server" containerID="cri-o://9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a" gracePeriod=2
Jun 03 14:56:53.243903 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.243863    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-27hvf" podStartSLOduration=1.73870059 podStartE2EDuration="3.243848528s" podCreationTimestamp="2026-06-03 14:56:50 +0000 UTC" firstStartedPulling="2026-06-03 14:56:50.835050059 +0000 UTC m=+686.351843092" lastFinishedPulling="2026-06-03 14:56:52.340197996 +0000 UTC m=+687.856991030" observedRunningTime="2026-06-03 14:56:53.241270054 +0000 UTC m=+688.758063110" watchObservedRunningTime="2026-06-03 14:56:53.243848528 +0000 UTC m=+688.760641574"
Jun 03 14:56:53.257112 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.257075    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj" podStartSLOduration=2.157554105 podStartE2EDuration="4.257063625s" podCreationTimestamp="2026-06-03 14:56:49 +0000 UTC" firstStartedPulling="2026-06-03 14:56:50.237846918 +0000 UTC m=+685.754639952" lastFinishedPulling="2026-06-03 14:56:52.33735642 +0000 UTC m=+687.854149472" observedRunningTime="2026-06-03 14:56:53.255272018 +0000 UTC m=+688.772065085" watchObservedRunningTime="2026-06-03 14:56:53.257063625 +0000 UTC m=+688.773856680"
Jun 03 14:56:53.471673 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.471652    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj"
Jun 03 14:56:53.593748 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.593658    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-scm62\" (UniqueName: \"kubernetes.io/projected/c14fc9b0-3b67-4c23-9371-c493efd1f354-kube-api-access-scm62\") pod \"c14fc9b0-3b67-4c23-9371-c493efd1f354\" (UID: \"c14fc9b0-3b67-4c23-9371-c493efd1f354\") "
Jun 03 14:56:53.595925 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.595898    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c14fc9b0-3b67-4c23-9371-c493efd1f354-kube-api-access-scm62" (OuterVolumeSpecName: "kube-api-access-scm62") pod "c14fc9b0-3b67-4c23-9371-c493efd1f354" (UID: "c14fc9b0-3b67-4c23-9371-c493efd1f354"). InnerVolumeSpecName "kube-api-access-scm62". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:56:53.694788 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:53.694752    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-scm62\" (UniqueName: \"kubernetes.io/projected/c14fc9b0-3b67-4c23-9371-c493efd1f354-kube-api-access-scm62\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:56:54.230975 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.230937    2576 generic.go:358] "Generic (PLEG): container finished" podID="c14fc9b0-3b67-4c23-9371-c493efd1f354" containerID="9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a" exitCode=0
Jun 03 14:56:54.231464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.230974    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj" event={"ID":"c14fc9b0-3b67-4c23-9371-c493efd1f354","Type":"ContainerDied","Data":"9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a"}
Jun 03 14:56:54.231464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.230996    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj"
Jun 03 14:56:54.231464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.231012    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-rq2wj" event={"ID":"c14fc9b0-3b67-4c23-9371-c493efd1f354","Type":"ContainerDied","Data":"0e11e7863fd8e6c272070af1d90d33d65b540620deef13bf47f7e339fd702b08"}
Jun 03 14:56:54.231464 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.231029    2576 scope.go:117] "RemoveContainer" containerID="9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a"
Jun 03 14:56:54.239977 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.239959    2576 scope.go:117] "RemoveContainer" containerID="9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a"
Jun 03 14:56:54.240279 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:56:54.240263    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a\": container with ID starting with 9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a not found: ID does not exist" containerID="9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a"
Jun 03 14:56:54.240348 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.240288    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a"} err="failed to get container status \"9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a\": rpc error: code = NotFound desc = could not find container \"9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a\": container with ID starting with 9b8b72fbaf9de52cdb9b979a1e8ef5bb99b13dbf8e9ffb8fb68811017b9bd24a not found: ID does not exist"
Jun 03 14:56:54.252521 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.252498    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rq2wj"]
Jun 03 14:56:54.254445 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:54.254424    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-rq2wj"]
Jun 03 14:56:55.043810 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:56:55.043777    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c14fc9b0-3b67-4c23-9371-c493efd1f354" path="/var/lib/kubelet/pods/c14fc9b0-3b67-4c23-9371-c493efd1f354/volumes"
Jun 03 14:57:00.676884 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:00.676847    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:57:00.677512 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:00.676898    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:57:00.699908 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:00.699882    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:57:01.286100 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:01.286072    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-27hvf"
Jun 03 14:57:05.571267 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.571235    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"]
Jun 03 14:57:05.571646 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.571623    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c14fc9b0-3b67-4c23-9371-c493efd1f354" containerName="registry-server"
Jun 03 14:57:05.571646 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.571637    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="c14fc9b0-3b67-4c23-9371-c493efd1f354" containerName="registry-server"
Jun 03 14:57:05.571728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.571716    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="c14fc9b0-3b67-4c23-9371-c493efd1f354" containerName="registry-server"
Jun 03 14:57:05.700461 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.700425    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"]
Jun 03 14:57:05.700623 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.700552    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.703334 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.703307    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dcldh\""
Jun 03 14:57:05.804823 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.804787    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.804980 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.804837    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.804980 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.804907    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92q5d\" (UniqueName: \"kubernetes.io/projected/44688955-f71a-49f0-a10f-f2de000eac3b-kube-api-access-92q5d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.906470 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.906385    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.906470 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.906437    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.906691 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.906494    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92q5d\" (UniqueName: \"kubernetes.io/projected/44688955-f71a-49f0-a10f-f2de000eac3b-kube-api-access-92q5d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.906851 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.906826    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.906913 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.906839    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.914405 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.914384    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92q5d\" (UniqueName: \"kubernetes.io/projected/44688955-f71a-49f0-a10f-f2de000eac3b-kube-api-access-92q5d\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:05.985544 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:05.985509    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"]
Jun 03 14:57:06.004342 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.004315    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"]
Jun 03 14:57:06.004480 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.004457    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.009531 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.009504    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:06.108740 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.108705    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.108907 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.108772    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.108907 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.108889    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcfs8\" (UniqueName: \"kubernetes.io/projected/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-kube-api-access-jcfs8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.149651 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.149606    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"]
Jun 03 14:57:06.151764 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:06.151738    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44688955_f71a_49f0_a10f_f2de000eac3b.slice/crio-ada2fd0e4ba6df145fdf4ac21082e63e8ed020d87a6e5652b4c75686b241d38e WatchSource:0}: Error finding container ada2fd0e4ba6df145fdf4ac21082e63e8ed020d87a6e5652b4c75686b241d38e: Status 404 returned error can't find the container with id ada2fd0e4ba6df145fdf4ac21082e63e8ed020d87a6e5652b4c75686b241d38e
Jun 03 14:57:06.209593 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.209564    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.209714 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.209649    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfs8\" (UniqueName: \"kubernetes.io/projected/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-kube-api-access-jcfs8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.209757 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.209742    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.209995 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.209970    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.210036 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.210001    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.218324 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.218296    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcfs8\" (UniqueName: \"kubernetes.io/projected/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-kube-api-access-jcfs8\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.284627 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.284598    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf" event={"ID":"44688955-f71a-49f0-a10f-f2de000eac3b","Type":"ContainerStarted","Data":"d78746a24693aa1a0158ddc1054f8fcc27aa4902fea2dc305539df8591da10db"}
Jun 03 14:57:06.284757 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.284633    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf" event={"ID":"44688955-f71a-49f0-a10f-f2de000eac3b","Type":"ContainerStarted","Data":"ada2fd0e4ba6df145fdf4ac21082e63e8ed020d87a6e5652b4c75686b241d38e"}
Jun 03 14:57:06.316059 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.316036    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:06.368613 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.368548    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"]
Jun 03 14:57:06.373802 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.373781    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.382097 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.382067    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"]
Jun 03 14:57:06.448539 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.448515    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"]
Jun 03 14:57:06.450226 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:06.450203    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbd810f6_f930_4f31_a3e9_5463e6cb0f29.slice/crio-aab636b225af6b62ccecd274050ac336f38662b6cdaaec954d9bab3c1cd63d38 WatchSource:0}: Error finding container aab636b225af6b62ccecd274050ac336f38662b6cdaaec954d9bab3c1cd63d38: Status 404 returned error can't find the container with id aab636b225af6b62ccecd274050ac336f38662b6cdaaec954d9bab3c1cd63d38
Jun 03 14:57:06.513022 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.512997    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.513117 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.513036    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.513117 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.513055    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4s4cw\" (UniqueName: \"kubernetes.io/projected/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-kube-api-access-4s4cw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.614194 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.614171    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.614504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.614206    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.614504 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.614225    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4s4cw\" (UniqueName: \"kubernetes.io/projected/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-kube-api-access-4s4cw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.614582 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.614511    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.614582 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.614534    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.623532 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.623513    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4s4cw\" (UniqueName: \"kubernetes.io/projected/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-kube-api-access-4s4cw\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.685415 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.685386    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:06.818735 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.818709    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"]
Jun 03 14:57:06.819970 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:06.819949    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9cfb542_bc1c_4b7d_8ec4_8ebdf0a7cf6f.slice/crio-7e62605e549741e3fc4158a57932c71ebcea86de5c9b6d35b896822e96325c25 WatchSource:0}: Error finding container 7e62605e549741e3fc4158a57932c71ebcea86de5c9b6d35b896822e96325c25: Status 404 returned error can't find the container with id 7e62605e549741e3fc4158a57932c71ebcea86de5c9b6d35b896822e96325c25
Jun 03 14:57:06.993646 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.993573    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"]
Jun 03 14:57:06.996248 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:06.996232    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.006094 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.006069    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"]
Jun 03 14:57:07.118277 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.118242    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.118277 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.118283    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.118505 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.118301    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tzjhc\" (UniqueName: \"kubernetes.io/projected/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-kube-api-access-tzjhc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.219591 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.219552    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.219775 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.219601    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.219775 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.219630    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tzjhc\" (UniqueName: \"kubernetes.io/projected/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-kube-api-access-tzjhc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.219974 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.219949    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.220031 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.219989    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.228590 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.228568    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tzjhc\" (UniqueName: \"kubernetes.io/projected/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-kube-api-access-tzjhc\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.291053 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.290977    2576 generic.go:358] "Generic (PLEG): container finished" podID="44688955-f71a-49f0-a10f-f2de000eac3b" containerID="d78746a24693aa1a0158ddc1054f8fcc27aa4902fea2dc305539df8591da10db" exitCode=0
Jun 03 14:57:07.291197 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.291063    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf" event={"ID":"44688955-f71a-49f0-a10f-f2de000eac3b","Type":"ContainerDied","Data":"d78746a24693aa1a0158ddc1054f8fcc27aa4902fea2dc305539df8591da10db"}
Jun 03 14:57:07.292486 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.292461    2576 generic.go:358] "Generic (PLEG): container finished" podID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerID="8aa2276392005d0c6e40be1c46015181786d66f9d5b616aeb423ac2b048675fd" exitCode=0
Jun 03 14:57:07.292677 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.292550    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn" event={"ID":"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f","Type":"ContainerDied","Data":"8aa2276392005d0c6e40be1c46015181786d66f9d5b616aeb423ac2b048675fd"}
Jun 03 14:57:07.292677 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.292577    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn" event={"ID":"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f","Type":"ContainerStarted","Data":"7e62605e549741e3fc4158a57932c71ebcea86de5c9b6d35b896822e96325c25"}
Jun 03 14:57:07.293938 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.293909    2576 generic.go:358] "Generic (PLEG): container finished" podID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerID="0a2ce9740bcbf00f9c67b2c94bb9df3de1d4c5dfe2827f275865652063f508db" exitCode=0
Jun 03 14:57:07.294012 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.293942    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln" event={"ID":"bbd810f6-f930-4f31-a3e9-5463e6cb0f29","Type":"ContainerDied","Data":"0a2ce9740bcbf00f9c67b2c94bb9df3de1d4c5dfe2827f275865652063f508db"}
Jun 03 14:57:07.294012 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.293965    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln" event={"ID":"bbd810f6-f930-4f31-a3e9-5463e6cb0f29","Type":"ContainerStarted","Data":"aab636b225af6b62ccecd274050ac336f38662b6cdaaec954d9bab3c1cd63d38"}
Jun 03 14:57:07.306117 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.306096    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:07.438475 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:07.438447    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"]
Jun 03 14:57:07.439831 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:07.439802    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa3b78f4_2f5a_4acb_8b03_3fd970c10889.slice/crio-4c73f9cc165a51500c12da1a0c6d4e506b4d7c60c97a78f3299441aa4dfdbf7a WatchSource:0}: Error finding container 4c73f9cc165a51500c12da1a0c6d4e506b4d7c60c97a78f3299441aa4dfdbf7a: Status 404 returned error can't find the container with id 4c73f9cc165a51500c12da1a0c6d4e506b4d7c60c97a78f3299441aa4dfdbf7a
Jun 03 14:57:08.306092 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:08.306056    2576 generic.go:358] "Generic (PLEG): container finished" podID="44688955-f71a-49f0-a10f-f2de000eac3b" containerID="084b00fd6369f6ad1740b2fa05457c2cacf92304a1979f8805e51a2d74326c3f" exitCode=0
Jun 03 14:57:08.306476 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:08.306151    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf" event={"ID":"44688955-f71a-49f0-a10f-f2de000eac3b","Type":"ContainerDied","Data":"084b00fd6369f6ad1740b2fa05457c2cacf92304a1979f8805e51a2d74326c3f"}
Jun 03 14:57:08.307868 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:08.307848    2576 generic.go:358] "Generic (PLEG): container finished" podID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerID="381d0a77973461bae0cf0f1b12e19183000cc575e41ba94432f0e7f3a384d6e7" exitCode=0
Jun 03 14:57:08.307951 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:08.307931    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn" event={"ID":"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f","Type":"ContainerDied","Data":"381d0a77973461bae0cf0f1b12e19183000cc575e41ba94432f0e7f3a384d6e7"}
Jun 03 14:57:08.309284 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:08.309256    2576 generic.go:358] "Generic (PLEG): container finished" podID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerID="d8d12039a5d57aea80d194468b20d3ed22c5a2ed1c4cec1dee158b063e7cb444" exitCode=0
Jun 03 14:57:08.309390 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:08.309317    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz" event={"ID":"aa3b78f4-2f5a-4acb-8b03-3fd970c10889","Type":"ContainerDied","Data":"d8d12039a5d57aea80d194468b20d3ed22c5a2ed1c4cec1dee158b063e7cb444"}
Jun 03 14:57:08.309390 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:08.309339    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz" event={"ID":"aa3b78f4-2f5a-4acb-8b03-3fd970c10889","Type":"ContainerStarted","Data":"4c73f9cc165a51500c12da1a0c6d4e506b4d7c60c97a78f3299441aa4dfdbf7a"}
Jun 03 14:57:09.315527 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.315426    2576 generic.go:358] "Generic (PLEG): container finished" podID="44688955-f71a-49f0-a10f-f2de000eac3b" containerID="89f8fa5e8b62519ec08f5395a8b5814ede12bb44480675a4295e3e4e6c5f26c3" exitCode=0
Jun 03 14:57:09.315923 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.315538    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf" event={"ID":"44688955-f71a-49f0-a10f-f2de000eac3b","Type":"ContainerDied","Data":"89f8fa5e8b62519ec08f5395a8b5814ede12bb44480675a4295e3e4e6c5f26c3"}
Jun 03 14:57:09.317347 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.317325    2576 generic.go:358] "Generic (PLEG): container finished" podID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerID="f948a0d60059f9e0fee84f5eaa185af953a89cd7fdd641a0e1ac28459c8da8b6" exitCode=0
Jun 03 14:57:09.317459 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.317406    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn" event={"ID":"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f","Type":"ContainerDied","Data":"f948a0d60059f9e0fee84f5eaa185af953a89cd7fdd641a0e1ac28459c8da8b6"}
Jun 03 14:57:09.319057 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.319037    2576 generic.go:358] "Generic (PLEG): container finished" podID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerID="7f2ae2b569e90c227c8f825023e495f159c02dcfcd494ed1ed585c51dc39a4b5" exitCode=0
Jun 03 14:57:09.319173 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.319107    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz" event={"ID":"aa3b78f4-2f5a-4acb-8b03-3fd970c10889","Type":"ContainerDied","Data":"7f2ae2b569e90c227c8f825023e495f159c02dcfcd494ed1ed585c51dc39a4b5"}
Jun 03 14:57:09.320793 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.320773    2576 generic.go:358] "Generic (PLEG): container finished" podID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerID="1dbaea71959e1a98cd079d410c1d7d734e834def3a4ac98e80893fb0e82a03fd" exitCode=0
Jun 03 14:57:09.320898 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:09.320800    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln" event={"ID":"bbd810f6-f930-4f31-a3e9-5463e6cb0f29","Type":"ContainerDied","Data":"1dbaea71959e1a98cd079d410c1d7d734e834def3a4ac98e80893fb0e82a03fd"}
Jun 03 14:57:10.326866 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.326778    2576 generic.go:358] "Generic (PLEG): container finished" podID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerID="f6d42639c3a8e2c0f55adf1c8a57f9dd394547d6c3e7f3d0bfb2d2e46cb6dbfc" exitCode=0
Jun 03 14:57:10.327317 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.326862    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz" event={"ID":"aa3b78f4-2f5a-4acb-8b03-3fd970c10889","Type":"ContainerDied","Data":"f6d42639c3a8e2c0f55adf1c8a57f9dd394547d6c3e7f3d0bfb2d2e46cb6dbfc"}
Jun 03 14:57:10.328614 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.328591    2576 generic.go:358] "Generic (PLEG): container finished" podID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerID="48d63ebad510a946750691a0d51b74c8b76e35bf9b2e94e9777a3dabaf79975c" exitCode=0
Jun 03 14:57:10.328710 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.328678    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln" event={"ID":"bbd810f6-f930-4f31-a3e9-5463e6cb0f29","Type":"ContainerDied","Data":"48d63ebad510a946750691a0d51b74c8b76e35bf9b2e94e9777a3dabaf79975c"}
Jun 03 14:57:10.480708 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.480687    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:10.483804 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.483787    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:10.653961 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.653878    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-bundle\") pod \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") "
Jun 03 14:57:10.653961 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.653941    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-util\") pod \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") "
Jun 03 14:57:10.654263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.653967    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4s4cw\" (UniqueName: \"kubernetes.io/projected/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-kube-api-access-4s4cw\") pod \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\" (UID: \"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f\") "
Jun 03 14:57:10.654263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.654016    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92q5d\" (UniqueName: \"kubernetes.io/projected/44688955-f71a-49f0-a10f-f2de000eac3b-kube-api-access-92q5d\") pod \"44688955-f71a-49f0-a10f-f2de000eac3b\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") "
Jun 03 14:57:10.654263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.654068    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-bundle\") pod \"44688955-f71a-49f0-a10f-f2de000eac3b\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") "
Jun 03 14:57:10.654263 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.654169    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-util\") pod \"44688955-f71a-49f0-a10f-f2de000eac3b\" (UID: \"44688955-f71a-49f0-a10f-f2de000eac3b\") "
Jun 03 14:57:10.654477 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.654400    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-bundle" (OuterVolumeSpecName: "bundle") pod "d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" (UID: "d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:10.654532 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.654503    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:10.654669 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.654648    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-bundle" (OuterVolumeSpecName: "bundle") pod "44688955-f71a-49f0-a10f-f2de000eac3b" (UID: "44688955-f71a-49f0-a10f-f2de000eac3b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:10.656531 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.656502    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-kube-api-access-4s4cw" (OuterVolumeSpecName: "kube-api-access-4s4cw") pod "d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" (UID: "d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f"). InnerVolumeSpecName "kube-api-access-4s4cw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:57:10.656626 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.656592    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44688955-f71a-49f0-a10f-f2de000eac3b-kube-api-access-92q5d" (OuterVolumeSpecName: "kube-api-access-92q5d") pod "44688955-f71a-49f0-a10f-f2de000eac3b" (UID: "44688955-f71a-49f0-a10f-f2de000eac3b"). InnerVolumeSpecName "kube-api-access-92q5d". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:57:10.660457 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.660423    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-util" (OuterVolumeSpecName: "util") pod "d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" (UID: "d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:10.660665 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.660644    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-util" (OuterVolumeSpecName: "util") pod "44688955-f71a-49f0-a10f-f2de000eac3b" (UID: "44688955-f71a-49f0-a10f-f2de000eac3b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:10.755368 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.755322    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92q5d\" (UniqueName: \"kubernetes.io/projected/44688955-f71a-49f0-a10f-f2de000eac3b-kube-api-access-92q5d\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:10.755368 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.755353    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:10.755368 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.755364    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/44688955-f71a-49f0-a10f-f2de000eac3b-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:10.755368 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.755377    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:10.755636 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:10.755388    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4s4cw\" (UniqueName: \"kubernetes.io/projected/d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f-kube-api-access-4s4cw\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:11.335008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.334925    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf" event={"ID":"44688955-f71a-49f0-a10f-f2de000eac3b","Type":"ContainerDied","Data":"ada2fd0e4ba6df145fdf4ac21082e63e8ed020d87a6e5652b4c75686b241d38e"}
Jun 03 14:57:11.335008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.334961    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ada2fd0e4ba6df145fdf4ac21082e63e8ed020d87a6e5652b4c75686b241d38e"
Jun 03 14:57:11.335008 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.334932    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf"
Jun 03 14:57:11.336718 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.336699    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn"
Jun 03 14:57:11.336848 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.336713    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn" event={"ID":"d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f","Type":"ContainerDied","Data":"7e62605e549741e3fc4158a57932c71ebcea86de5c9b6d35b896822e96325c25"}
Jun 03 14:57:11.336848 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.336753    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7e62605e549741e3fc4158a57932c71ebcea86de5c9b6d35b896822e96325c25"
Jun 03 14:57:11.473974 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.473950    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:11.511077 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.511051    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:11.561910 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.561875    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-util\") pod \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") "
Jun 03 14:57:11.562097 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.561917    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-bundle\") pod \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") "
Jun 03 14:57:11.562097 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.561952    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tzjhc\" (UniqueName: \"kubernetes.io/projected/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-kube-api-access-tzjhc\") pod \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") "
Jun 03 14:57:11.562097 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.562011    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jcfs8\" (UniqueName: \"kubernetes.io/projected/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-kube-api-access-jcfs8\") pod \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") "
Jun 03 14:57:11.562097 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.562074    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-bundle\") pod \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\" (UID: \"bbd810f6-f930-4f31-a3e9-5463e6cb0f29\") "
Jun 03 14:57:11.562366 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.562232    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-util\") pod \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\" (UID: \"aa3b78f4-2f5a-4acb-8b03-3fd970c10889\") "
Jun 03 14:57:11.562752 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.562726    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-bundle" (OuterVolumeSpecName: "bundle") pod "bbd810f6-f930-4f31-a3e9-5463e6cb0f29" (UID: "bbd810f6-f930-4f31-a3e9-5463e6cb0f29"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:11.562906 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.562743    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-bundle" (OuterVolumeSpecName: "bundle") pod "aa3b78f4-2f5a-4acb-8b03-3fd970c10889" (UID: "aa3b78f4-2f5a-4acb-8b03-3fd970c10889"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:11.564266 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.564238    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-kube-api-access-jcfs8" (OuterVolumeSpecName: "kube-api-access-jcfs8") pod "bbd810f6-f930-4f31-a3e9-5463e6cb0f29" (UID: "bbd810f6-f930-4f31-a3e9-5463e6cb0f29"). InnerVolumeSpecName "kube-api-access-jcfs8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:57:11.564355 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.564303    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-kube-api-access-tzjhc" (OuterVolumeSpecName: "kube-api-access-tzjhc") pod "aa3b78f4-2f5a-4acb-8b03-3fd970c10889" (UID: "aa3b78f4-2f5a-4acb-8b03-3fd970c10889"). InnerVolumeSpecName "kube-api-access-tzjhc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:57:11.567382 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.567350    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-util" (OuterVolumeSpecName: "util") pod "bbd810f6-f930-4f31-a3e9-5463e6cb0f29" (UID: "bbd810f6-f930-4f31-a3e9-5463e6cb0f29"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:11.567880 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.567860    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-util" (OuterVolumeSpecName: "util") pod "aa3b78f4-2f5a-4acb-8b03-3fd970c10889" (UID: "aa3b78f4-2f5a-4acb-8b03-3fd970c10889"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:11.663421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.663329    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:11.663421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.663362    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:11.663421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.663372    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:11.663421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.663380    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:11.663421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.663389    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tzjhc\" (UniqueName: \"kubernetes.io/projected/aa3b78f4-2f5a-4acb-8b03-3fd970c10889-kube-api-access-tzjhc\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:11.663421 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:11.663400    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jcfs8\" (UniqueName: \"kubernetes.io/projected/bbd810f6-f930-4f31-a3e9-5463e6cb0f29-kube-api-access-jcfs8\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:12.343380 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:12.343302    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz" event={"ID":"aa3b78f4-2f5a-4acb-8b03-3fd970c10889","Type":"ContainerDied","Data":"4c73f9cc165a51500c12da1a0c6d4e506b4d7c60c97a78f3299441aa4dfdbf7a"}
Jun 03 14:57:12.343380 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:12.343326    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz"
Jun 03 14:57:12.343380 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:12.343337    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c73f9cc165a51500c12da1a0c6d4e506b4d7c60c97a78f3299441aa4dfdbf7a"
Jun 03 14:57:12.345098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:12.345076    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln"
Jun 03 14:57:12.345098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:12.345079    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln" event={"ID":"bbd810f6-f930-4f31-a3e9-5463e6cb0f29","Type":"ContainerDied","Data":"aab636b225af6b62ccecd274050ac336f38662b6cdaaec954d9bab3c1cd63d38"}
Jun 03 14:57:12.345278 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:12.345112    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aab636b225af6b62ccecd274050ac336f38662b6cdaaec954d9bab3c1cd63d38"
Jun 03 14:57:21.698954 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.698923    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"]
Jun 03 14:57:21.699355 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699333    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44688955-f71a-49f0-a10f-f2de000eac3b" containerName="pull"
Jun 03 14:57:21.699355 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699346    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44688955-f71a-49f0-a10f-f2de000eac3b" containerName="pull"
Jun 03 14:57:21.699355 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699354    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerName="pull"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699360    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerName="pull"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699372    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerName="util"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699378    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerName="util"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699384    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerName="extract"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699390    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerName="extract"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699399    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerName="pull"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699407    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerName="pull"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699421    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44688955-f71a-49f0-a10f-f2de000eac3b" containerName="util"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699426    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44688955-f71a-49f0-a10f-f2de000eac3b" containerName="util"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699431    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44688955-f71a-49f0-a10f-f2de000eac3b" containerName="extract"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699436    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="44688955-f71a-49f0-a10f-f2de000eac3b" containerName="extract"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699442    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerName="pull"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699448    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerName="pull"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699458    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerName="extract"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699463    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerName="extract"
Jun 03 14:57:21.699468 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699470    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerName="util"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699477    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerName="util"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699495    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerName="util"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699504    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerName="util"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699513    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerName="extract"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699518    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerName="extract"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699582    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="aa3b78f4-2f5a-4acb-8b03-3fd970c10889" containerName="extract"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699595    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f" containerName="extract"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699604    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="44688955-f71a-49f0-a10f-f2de000eac3b" containerName="extract"
Jun 03 14:57:21.699950 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.699610    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="bbd810f6-f930-4f31-a3e9-5463e6cb0f29" containerName="extract"
Jun 03 14:57:21.702651 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.702636    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"
Jun 03 14:57:21.705294 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.705274    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jun 03 14:57:21.705416 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.705385    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-lsf9j\""
Jun 03 14:57:21.713079 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.713056    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"]
Jun 03 14:57:21.754627 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.754599    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2vdr\" (UniqueName: \"kubernetes.io/projected/3ca961f8-d5fc-42f3-a525-9fedc0f0df2c-kube-api-access-m2vdr\") pod \"dns-operator-controller-manager-648d5c98bc-wv5mw\" (UID: \"3ca961f8-d5fc-42f3-a525-9fedc0f0df2c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"
Jun 03 14:57:21.855267 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.855224    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m2vdr\" (UniqueName: \"kubernetes.io/projected/3ca961f8-d5fc-42f3-a525-9fedc0f0df2c-kube-api-access-m2vdr\") pod \"dns-operator-controller-manager-648d5c98bc-wv5mw\" (UID: \"3ca961f8-d5fc-42f3-a525-9fedc0f0df2c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"
Jun 03 14:57:21.876975 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:21.876944    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2vdr\" (UniqueName: \"kubernetes.io/projected/3ca961f8-d5fc-42f3-a525-9fedc0f0df2c-kube-api-access-m2vdr\") pod \"dns-operator-controller-manager-648d5c98bc-wv5mw\" (UID: \"3ca961f8-d5fc-42f3-a525-9fedc0f0df2c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"
Jun 03 14:57:22.013706 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:22.013673    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"
Jun 03 14:57:22.175035 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:22.175010    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"]
Jun 03 14:57:22.176593 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:22.176562    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ca961f8_d5fc_42f3_a525_9fedc0f0df2c.slice/crio-9ca5039703991a5d84c5011b18104e6f56864eb28f6fc67054419de0233ffb3e WatchSource:0}: Error finding container 9ca5039703991a5d84c5011b18104e6f56864eb28f6fc67054419de0233ffb3e: Status 404 returned error can't find the container with id 9ca5039703991a5d84c5011b18104e6f56864eb28f6fc67054419de0233ffb3e
Jun 03 14:57:22.382232 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:22.382151    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw" event={"ID":"3ca961f8-d5fc-42f3-a525-9fedc0f0df2c","Type":"ContainerStarted","Data":"9ca5039703991a5d84c5011b18104e6f56864eb28f6fc67054419de0233ffb3e"}
Jun 03 14:57:25.397004 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:25.396965    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw" event={"ID":"3ca961f8-d5fc-42f3-a525-9fedc0f0df2c","Type":"ContainerStarted","Data":"821e1b79be6aad8ee4edc4c3d397f0d92ec7dc52ef013bc7fa1e549327f0e9af"}
Jun 03 14:57:25.397454 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:25.397033    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"
Jun 03 14:57:25.416673 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:25.416623    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw" podStartSLOduration=1.841352036 podStartE2EDuration="4.416610657s" podCreationTimestamp="2026-06-03 14:57:21 +0000 UTC" firstStartedPulling="2026-06-03 14:57:22.178751059 +0000 UTC m=+717.695544106" lastFinishedPulling="2026-06-03 14:57:24.754009691 +0000 UTC m=+720.270802727" observedRunningTime="2026-06-03 14:57:25.413882636 +0000 UTC m=+720.930675692" watchObservedRunningTime="2026-06-03 14:57:25.416610657 +0000 UTC m=+720.933403712"
Jun 03 14:57:27.010225 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.010194    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"]
Jun 03 14:57:27.015186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.015165    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.017874 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.017852    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-pdfpn\""
Jun 03 14:57:27.024848 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.024824    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"]
Jun 03 14:57:27.104037 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.103996    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6xxcr\" (UniqueName: \"kubernetes.io/projected/170692f0-3905-4ff0-8d5f-040bdb0a287a-kube-api-access-6xxcr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.104037 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.104033    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170692f0-3905-4ff0-8d5f-040bdb0a287a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.205520 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.205488    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6xxcr\" (UniqueName: \"kubernetes.io/projected/170692f0-3905-4ff0-8d5f-040bdb0a287a-kube-api-access-6xxcr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.205520 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.205523    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170692f0-3905-4ff0-8d5f-040bdb0a287a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.205919 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.205902    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170692f0-3905-4ff0-8d5f-040bdb0a287a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.219860 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.219832    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6xxcr\" (UniqueName: \"kubernetes.io/projected/170692f0-3905-4ff0-8d5f-040bdb0a287a-kube-api-access-6xxcr\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.326550 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.326468    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:27.468370 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:27.468339    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"]
Jun 03 14:57:27.470809 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:27.470785    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170692f0_3905_4ff0_8d5f_040bdb0a287a.slice/crio-7055b5d1b14d207e54f3bf4c2340197973146233a824f8e5ee7386640b55f1f1 WatchSource:0}: Error finding container 7055b5d1b14d207e54f3bf4c2340197973146233a824f8e5ee7386640b55f1f1: Status 404 returned error can't find the container with id 7055b5d1b14d207e54f3bf4c2340197973146233a824f8e5ee7386640b55f1f1
Jun 03 14:57:28.410532 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:28.410494    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" event={"ID":"170692f0-3905-4ff0-8d5f-040bdb0a287a","Type":"ContainerStarted","Data":"7055b5d1b14d207e54f3bf4c2340197973146233a824f8e5ee7386640b55f1f1"}
Jun 03 14:57:32.427576 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:32.427547    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" event={"ID":"170692f0-3905-4ff0-8d5f-040bdb0a287a","Type":"ContainerStarted","Data":"7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2"}
Jun 03 14:57:32.427984 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:32.427641    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:32.450884 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:32.450814    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" podStartSLOduration=1.59469254 podStartE2EDuration="6.450799244s" podCreationTimestamp="2026-06-03 14:57:26 +0000 UTC" firstStartedPulling="2026-06-03 14:57:27.473190613 +0000 UTC m=+722.989983649" lastFinishedPulling="2026-06-03 14:57:32.329297318 +0000 UTC m=+727.846090353" observedRunningTime="2026-06-03 14:57:32.448934534 +0000 UTC m=+727.965727588" watchObservedRunningTime="2026-06-03 14:57:32.450799244 +0000 UTC m=+727.967592299"
Jun 03 14:57:35.389539 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.389507    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"]
Jun 03 14:57:35.393329 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.393307    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.395689 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.395666    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jun 03 14:57:35.395830 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.395691    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jun 03 14:57:35.395830 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.395769    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dcldh\""
Jun 03 14:57:35.400211 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.400189    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"]
Jun 03 14:57:35.486935 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.486906    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c16362e2-3cfe-456c-8290-3d0d749d5b02-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.486935 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.486942    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxwww\" (UniqueName: \"kubernetes.io/projected/c16362e2-3cfe-456c-8290-3d0d749d5b02-kube-api-access-jxwww\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.487185 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.486980    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c16362e2-3cfe-456c-8290-3d0d749d5b02-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.587854 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.587818    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c16362e2-3cfe-456c-8290-3d0d749d5b02-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.588025 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.587860    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jxwww\" (UniqueName: \"kubernetes.io/projected/c16362e2-3cfe-456c-8290-3d0d749d5b02-kube-api-access-jxwww\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.588025 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.587901    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c16362e2-3cfe-456c-8290-3d0d749d5b02-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.588524 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.588496    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/c16362e2-3cfe-456c-8290-3d0d749d5b02-nginx-conf\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.590373 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.590350    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/c16362e2-3cfe-456c-8290-3d0d749d5b02-plugin-serving-cert\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.595238 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.595221    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxwww\" (UniqueName: \"kubernetes.io/projected/c16362e2-3cfe-456c-8290-3d0d749d5b02-kube-api-access-jxwww\") pod \"kuadrant-console-plugin-6cb54b5c86-zkbtq\" (UID: \"c16362e2-3cfe-456c-8290-3d0d749d5b02\") " pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.703073 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.703046    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"
Jun 03 14:57:35.832715 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:35.832692    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq"]
Jun 03 14:57:35.834643 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:35.834619    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc16362e2_3cfe_456c_8290_3d0d749d5b02.slice/crio-5d8796a5c7f31d4c0cc51006eac041b12d1b23b4d4613f6581e907d0b530cd5a WatchSource:0}: Error finding container 5d8796a5c7f31d4c0cc51006eac041b12d1b23b4d4613f6581e907d0b530cd5a: Status 404 returned error can't find the container with id 5d8796a5c7f31d4c0cc51006eac041b12d1b23b4d4613f6581e907d0b530cd5a
Jun 03 14:57:36.403689 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:36.403654    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-wv5mw"
Jun 03 14:57:36.443986 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:36.443949    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq" event={"ID":"c16362e2-3cfe-456c-8290-3d0d749d5b02","Type":"ContainerStarted","Data":"5d8796a5c7f31d4c0cc51006eac041b12d1b23b4d4613f6581e907d0b530cd5a"}
Jun 03 14:57:43.434009 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:43.433975    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:44.666617 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.666582    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"]
Jun 03 14:57:44.670344 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.670318    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:44.680996 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.680970    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"]
Jun 03 14:57:44.775455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.775416    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfb8e08a-4df0-411a-9652-436944c6ddda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:44.775655 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.775483    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x54gc\" (UniqueName: \"kubernetes.io/projected/bfb8e08a-4df0-411a-9652-436944c6ddda-kube-api-access-x54gc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:44.776116 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.776095    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"]
Jun 03 14:57:44.776374 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:57:44.776351    2576 pod_workers.go:1301] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-x54gc], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z" podUID="bfb8e08a-4df0-411a-9652-436944c6ddda"
Jun 03 14:57:44.876992 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.876954    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfb8e08a-4df0-411a-9652-436944c6ddda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:44.877204 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.877025    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-x54gc\" (UniqueName: \"kubernetes.io/projected/bfb8e08a-4df0-411a-9652-436944c6ddda-kube-api-access-x54gc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:44.877395 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.877368    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfb8e08a-4df0-411a-9652-436944c6ddda-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:44.887414 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:44.887388    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x54gc\" (UniqueName: \"kubernetes.io/projected/bfb8e08a-4df0-411a-9652-436944c6ddda-kube-api-access-x54gc\") pod \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:45.219437 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.219324    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"]
Jun 03 14:57:45.219693 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.219642    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" containerName="manager" containerID="cri-o://7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2" gracePeriod=2
Jun 03 14:57:45.221800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.221750    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:45.222954 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.222929    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"]
Jun 03 14:57:45.232843 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.232817    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"]
Jun 03 14:57:45.239635 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.239609    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"]
Jun 03 14:57:45.240591 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.240572    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" containerName="manager"
Jun 03 14:57:45.240717 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.240705    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" containerName="manager"
Jun 03 14:57:45.240938 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.240927    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" containerName="manager"
Jun 03 14:57:45.244562 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.244544    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"]
Jun 03 14:57:45.244693 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.244667    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.255045 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.254631    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"]
Jun 03 14:57:45.270250 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.270218    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:45.382962 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.382925    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlst9\" (UniqueName: \"kubernetes.io/projected/043fded0-5f11-4615-8a79-6ee81125be88-kube-api-access-hlst9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-hbzbs\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.383148 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.382981    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/043fded0-5f11-4615-8a79-6ee81125be88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-hbzbs\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.484586 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.484483    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/043fded0-5f11-4615-8a79-6ee81125be88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-hbzbs\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.484765 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.484661    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hlst9\" (UniqueName: \"kubernetes.io/projected/043fded0-5f11-4615-8a79-6ee81125be88-kube-api-access-hlst9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-hbzbs\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.484977 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.484940    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/043fded0-5f11-4615-8a79-6ee81125be88-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-hbzbs\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.487934 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.487908    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:45.490591 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.490536    2576 status_manager.go:895] "Failed to get status for pod" podUID="bfb8e08a-4df0-411a-9652-436944c6ddda" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:45.492526 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.492495    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:45.493644 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.493621    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlst9\" (UniqueName: \"kubernetes.io/projected/043fded0-5f11-4615-8a79-6ee81125be88-kube-api-access-hlst9\") pod \"kuadrant-operator-controller-manager-5f895dd7d5-hbzbs\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") " pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.493819 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.493802    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:45.496094 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.496068    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:45.498098 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.498074    2576 status_manager.go:895] "Failed to get status for pod" podUID="bfb8e08a-4df0-411a-9652-436944c6ddda" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:45.582934 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.582903    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:45.686822 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.686786    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfb8e08a-4df0-411a-9652-436944c6ddda-extensions-socket-volume\") pod \"bfb8e08a-4df0-411a-9652-436944c6ddda\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") "
Jun 03 14:57:45.687300 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.686913    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x54gc\" (UniqueName: \"kubernetes.io/projected/bfb8e08a-4df0-411a-9652-436944c6ddda-kube-api-access-x54gc\") pod \"bfb8e08a-4df0-411a-9652-436944c6ddda\" (UID: \"bfb8e08a-4df0-411a-9652-436944c6ddda\") "
Jun 03 14:57:45.687300 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.687087    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bfb8e08a-4df0-411a-9652-436944c6ddda-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "bfb8e08a-4df0-411a-9652-436944c6ddda" (UID: "bfb8e08a-4df0-411a-9652-436944c6ddda"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:45.687300 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.687228    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/bfb8e08a-4df0-411a-9652-436944c6ddda-extensions-socket-volume\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:45.689547 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.689516    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bfb8e08a-4df0-411a-9652-436944c6ddda-kube-api-access-x54gc" (OuterVolumeSpecName: "kube-api-access-x54gc") pod "bfb8e08a-4df0-411a-9652-436944c6ddda" (UID: "bfb8e08a-4df0-411a-9652-436944c6ddda"). InnerVolumeSpecName "kube-api-access-x54gc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:57:45.788114 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:45.788035    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x54gc\" (UniqueName: \"kubernetes.io/projected/bfb8e08a-4df0-411a-9652-436944c6ddda-kube-api-access-x54gc\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:46.492728 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:46.492696    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z"
Jun 03 14:57:46.495296 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:46.495262    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:46.497302 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:46.497271    2576 status_manager.go:895] "Failed to get status for pod" podUID="bfb8e08a-4df0-411a-9652-436944c6ddda" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:46.502334 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:46.502305    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:46.504402 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:46.504373    2576 status_manager.go:895] "Failed to get status for pod" podUID="bfb8e08a-4df0-411a-9652-436944c6ddda" pod="kuadrant-system/kuadrant-operator-controller-manager-6bc9f4c76f-7n57z" err="pods \"kuadrant-operator-controller-manager-6bc9f4c76f-7n57z\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:47.044858 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:47.044822    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bfb8e08a-4df0-411a-9652-436944c6ddda" path="/var/lib/kubelet/pods/bfb8e08a-4df0-411a-9652-436944c6ddda/volumes"
Jun 03 14:57:59.130478 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.130451    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:59.132804 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.132772    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:59.156629 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.156590    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"]
Jun 03 14:57:59.176389 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:57:59.176363    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod043fded0_5f11_4615_8a79_6ee81125be88.slice/crio-ddc242cfe8bc4a826553e51b60e32b503ac9298e1cd92e434ebac78d61c1dc56 WatchSource:0}: Error finding container ddc242cfe8bc4a826553e51b60e32b503ac9298e1cd92e434ebac78d61c1dc56: Status 404 returned error can't find the container with id ddc242cfe8bc4a826553e51b60e32b503ac9298e1cd92e434ebac78d61c1dc56
Jun 03 14:57:59.213048 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.213026    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170692f0-3905-4ff0-8d5f-040bdb0a287a-extensions-socket-volume\") pod \"170692f0-3905-4ff0-8d5f-040bdb0a287a\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") "
Jun 03 14:57:59.213159 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.213079    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6xxcr\" (UniqueName: \"kubernetes.io/projected/170692f0-3905-4ff0-8d5f-040bdb0a287a-kube-api-access-6xxcr\") pod \"170692f0-3905-4ff0-8d5f-040bdb0a287a\" (UID: \"170692f0-3905-4ff0-8d5f-040bdb0a287a\") "
Jun 03 14:57:59.213632 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.213603    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/170692f0-3905-4ff0-8d5f-040bdb0a287a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "170692f0-3905-4ff0-8d5f-040bdb0a287a" (UID: "170692f0-3905-4ff0-8d5f-040bdb0a287a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:57:59.214999 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.214977    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170692f0-3905-4ff0-8d5f-040bdb0a287a-kube-api-access-6xxcr" (OuterVolumeSpecName: "kube-api-access-6xxcr") pod "170692f0-3905-4ff0-8d5f-040bdb0a287a" (UID: "170692f0-3905-4ff0-8d5f-040bdb0a287a"). InnerVolumeSpecName "kube-api-access-6xxcr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:57:59.314450 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.314363    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/170692f0-3905-4ff0-8d5f-040bdb0a287a-extensions-socket-volume\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:59.314450 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.314392    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6xxcr\" (UniqueName: \"kubernetes.io/projected/170692f0-3905-4ff0-8d5f-040bdb0a287a-kube-api-access-6xxcr\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:57:59.554533 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.554492    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs" event={"ID":"043fded0-5f11-4615-8a79-6ee81125be88","Type":"ContainerStarted","Data":"e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61"}
Jun 03 14:57:59.554533 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.554540    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs" event={"ID":"043fded0-5f11-4615-8a79-6ee81125be88","Type":"ContainerStarted","Data":"ddc242cfe8bc4a826553e51b60e32b503ac9298e1cd92e434ebac78d61c1dc56"}
Jun 03 14:57:59.554765 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.554584    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:57:59.556083 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.556057    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq" event={"ID":"c16362e2-3cfe-456c-8290-3d0d749d5b02","Type":"ContainerStarted","Data":"fbf0c41444bcff328b6aa2a695cf01f24d7e20730bd428f83008f0f552251abd"}
Jun 03 14:57:59.557331 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.557280    2576 generic.go:358] "Generic (PLEG): container finished" podID="170692f0-3905-4ff0-8d5f-040bdb0a287a" containerID="7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2" exitCode=0
Jun 03 14:57:59.557429 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.557314    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps"
Jun 03 14:57:59.557429 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.557338    2576 scope.go:117] "RemoveContainer" containerID="7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2"
Jun 03 14:57:59.567667 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.567649    2576 scope.go:117] "RemoveContainer" containerID="7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2"
Jun 03 14:57:59.567979 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:57:59.567951    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2\": container with ID starting with 7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2 not found: ID does not exist" containerID="7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2"
Jun 03 14:57:59.568069 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.567990    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2"} err="failed to get container status \"7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2\": rpc error: code = NotFound desc = could not find container \"7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2\": container with ID starting with 7df9e0d436379b2a7dc3a05370457f8d1360ff1a41eaaa7a62674232ecf6a3d2 not found: ID does not exist"
Jun 03 14:57:59.575188 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.575163    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:59.575406 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.575371    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs" podStartSLOduration=14.575359777 podStartE2EDuration="14.575359777s" podCreationTimestamp="2026-06-03 14:57:45 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:57:59.572943095 +0000 UTC m=+755.089736149" watchObservedRunningTime="2026-06-03 14:57:59.575359777 +0000 UTC m=+755.092152829"
Jun 03 14:57:59.592754 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.592728    2576 status_manager.go:895] "Failed to get status for pod" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-b9fps" err="pods \"kuadrant-operator-controller-manager-5f895dd7d5-b9fps\" is forbidden: User \"system:node:ip-10-0-140-251.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-251.ec2.internal' and this object"
Jun 03 14:57:59.593801 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:57:59.593763    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-6cb54b5c86-zkbtq" podStartSLOduration=1.345665072 podStartE2EDuration="24.59375205s" podCreationTimestamp="2026-06-03 14:57:35 +0000 UTC" firstStartedPulling="2026-06-03 14:57:35.835774838 +0000 UTC m=+731.352567871" lastFinishedPulling="2026-06-03 14:57:59.083861809 +0000 UTC m=+754.600654849" observedRunningTime="2026-06-03 14:57:59.590515366 +0000 UTC m=+755.107308421" watchObservedRunningTime="2026-06-03 14:57:59.59375205 +0000 UTC m=+755.110545104"
Jun 03 14:58:01.035737 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.035700    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"]
Jun 03 14:58:01.044282 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.044252    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="170692f0-3905-4ff0-8d5f-040bdb0a287a" path="/var/lib/kubelet/pods/170692f0-3905-4ff0-8d5f-040bdb0a287a/volumes"
Jun 03 14:58:01.323527 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.323430    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"]
Jun 03 14:58:01.326938 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.326920    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.337685 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.337660    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"]
Jun 03 14:58:01.433186 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.433125    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-49xhv\" (UniqueName: \"kubernetes.io/projected/754329dd-2cd1-4064-9898-8cf6cfc7bb97-kube-api-access-49xhv\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9npkg\" (UID: \"754329dd-2cd1-4064-9898-8cf6cfc7bb97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.433360 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.433277    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/754329dd-2cd1-4064-9898-8cf6cfc7bb97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9npkg\" (UID: \"754329dd-2cd1-4064-9898-8cf6cfc7bb97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.534312 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.534263    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-49xhv\" (UniqueName: \"kubernetes.io/projected/754329dd-2cd1-4064-9898-8cf6cfc7bb97-kube-api-access-49xhv\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9npkg\" (UID: \"754329dd-2cd1-4064-9898-8cf6cfc7bb97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.534529 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.534373    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/754329dd-2cd1-4064-9898-8cf6cfc7bb97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9npkg\" (UID: \"754329dd-2cd1-4064-9898-8cf6cfc7bb97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.534706 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.534691    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/754329dd-2cd1-4064-9898-8cf6cfc7bb97-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9npkg\" (UID: \"754329dd-2cd1-4064-9898-8cf6cfc7bb97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.544623 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.544598    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-49xhv\" (UniqueName: \"kubernetes.io/projected/754329dd-2cd1-4064-9898-8cf6cfc7bb97-kube-api-access-49xhv\") pod \"kuadrant-operator-controller-manager-55c7f4c975-9npkg\" (UID: \"754329dd-2cd1-4064-9898-8cf6cfc7bb97\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.568988 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.568919    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs" podUID="043fded0-5f11-4615-8a79-6ee81125be88" containerName="manager" containerID="cri-o://e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61" gracePeriod=10
Jun 03 14:58:01.638257 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.638222    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:01.777811 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.777780    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"]
Jun 03 14:58:01.779060 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:58:01.779025    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod754329dd_2cd1_4064_9898_8cf6cfc7bb97.slice/crio-a656e614f5035536ea339d173935142603586aa959efbe1c3f0986d5373ac798 WatchSource:0}: Error finding container a656e614f5035536ea339d173935142603586aa959efbe1c3f0986d5373ac798: Status 404 returned error can't find the container with id a656e614f5035536ea339d173935142603586aa959efbe1c3f0986d5373ac798
Jun 03 14:58:01.821783 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.821761    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:58:01.938413 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.938387    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hlst9\" (UniqueName: \"kubernetes.io/projected/043fded0-5f11-4615-8a79-6ee81125be88-kube-api-access-hlst9\") pod \"043fded0-5f11-4615-8a79-6ee81125be88\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") "
Jun 03 14:58:01.938545 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.938518    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/043fded0-5f11-4615-8a79-6ee81125be88-extensions-socket-volume\") pod \"043fded0-5f11-4615-8a79-6ee81125be88\" (UID: \"043fded0-5f11-4615-8a79-6ee81125be88\") "
Jun 03 14:58:01.938894 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.938869    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/043fded0-5f11-4615-8a79-6ee81125be88-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "043fded0-5f11-4615-8a79-6ee81125be88" (UID: "043fded0-5f11-4615-8a79-6ee81125be88"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:58:01.940317 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:01.940296    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/043fded0-5f11-4615-8a79-6ee81125be88-kube-api-access-hlst9" (OuterVolumeSpecName: "kube-api-access-hlst9") pod "043fded0-5f11-4615-8a79-6ee81125be88" (UID: "043fded0-5f11-4615-8a79-6ee81125be88"). InnerVolumeSpecName "kube-api-access-hlst9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:58:02.039658 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.039620    2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/043fded0-5f11-4615-8a79-6ee81125be88-extensions-socket-volume\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:58:02.040022 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.039746    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hlst9\" (UniqueName: \"kubernetes.io/projected/043fded0-5f11-4615-8a79-6ee81125be88-kube-api-access-hlst9\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:58:02.573785 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.573751    2576 generic.go:358] "Generic (PLEG): container finished" podID="043fded0-5f11-4615-8a79-6ee81125be88" containerID="e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61" exitCode=0
Jun 03 14:58:02.573964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.573837    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"
Jun 03 14:58:02.573964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.573871    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs" event={"ID":"043fded0-5f11-4615-8a79-6ee81125be88","Type":"ContainerDied","Data":"e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61"}
Jun 03 14:58:02.573964 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.573936    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs" event={"ID":"043fded0-5f11-4615-8a79-6ee81125be88","Type":"ContainerDied","Data":"ddc242cfe8bc4a826553e51b60e32b503ac9298e1cd92e434ebac78d61c1dc56"}
Jun 03 14:58:02.574154 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.573965    2576 scope.go:117] "RemoveContainer" containerID="e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61"
Jun 03 14:58:02.575744 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.575675    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg" event={"ID":"754329dd-2cd1-4064-9898-8cf6cfc7bb97","Type":"ContainerStarted","Data":"d2bf61e4133a283df96c108c4da67c994bbc00333bc9e3b2f9ae3a7da066f460"}
Jun 03 14:58:02.575744 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.575710    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:02.575744 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.575725    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg" event={"ID":"754329dd-2cd1-4064-9898-8cf6cfc7bb97","Type":"ContainerStarted","Data":"a656e614f5035536ea339d173935142603586aa959efbe1c3f0986d5373ac798"}
Jun 03 14:58:02.584349 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.584334    2576 scope.go:117] "RemoveContainer" containerID="e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61"
Jun 03 14:58:02.584578 ip-10-0-140-251 kubenswrapper[2576]: E0603 14:58:02.584560    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61\": container with ID starting with e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61 not found: ID does not exist" containerID="e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61"
Jun 03 14:58:02.584629 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.584587    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61"} err="failed to get container status \"e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61\": rpc error: code = NotFound desc = could not find container \"e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61\": container with ID starting with e704caa03c92488ed7dfa6210673398e181abda68eddedbe982784d148682c61 not found: ID does not exist"
Jun 03 14:58:02.599424 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.599396    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"]
Jun 03 14:58:02.605168 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.605145    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-5f895dd7d5-hbzbs"]
Jun 03 14:58:02.626455 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:02.626417    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg" podStartSLOduration=1.626405821 podStartE2EDuration="1.626405821s" podCreationTimestamp="2026-06-03 14:58:01 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:58:02.625168415 +0000 UTC m=+758.141961473" watchObservedRunningTime="2026-06-03 14:58:02.626405821 +0000 UTC m=+758.143198875"
Jun 03 14:58:03.044276 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:03.044242    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="043fded0-5f11-4615-8a79-6ee81125be88" path="/var/lib/kubelet/pods/043fded0-5f11-4615-8a79-6ee81125be88/volumes"
Jun 03 14:58:13.588808 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:13.588778    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55c7f4c975-9npkg"
Jun 03 14:58:17.353822 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.353787    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"]
Jun 03 14:58:17.354318 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.354193    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="043fded0-5f11-4615-8a79-6ee81125be88" containerName="manager"
Jun 03 14:58:17.354318 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.354205    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="043fded0-5f11-4615-8a79-6ee81125be88" containerName="manager"
Jun 03 14:58:17.354318 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.354268    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="043fded0-5f11-4615-8a79-6ee81125be88" containerName="manager"
Jun 03 14:58:17.495834 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.495801    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"]
Jun 03 14:58:17.496010 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.495930    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.498743 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.498724    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lrww2\""
Jun 03 14:58:17.580437 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580403    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0464e1-ffa0-4d76-b89c-32c2db266027-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580437 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580439    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580656 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580460    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580656 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580507    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580656 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580588    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580656 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580606    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580656 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580634    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580656 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580653    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rl9j9\" (UniqueName: \"kubernetes.io/projected/0e0464e1-ffa0-4d76-b89c-32c2db266027-kube-api-access-rl9j9\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.580872 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.580686    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682148 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682048    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682148 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682079    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682148 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682099    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682148 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682116    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-rl9j9\" (UniqueName: \"kubernetes.io/projected/0e0464e1-ffa0-4d76-b89c-32c2db266027-kube-api-access-rl9j9\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682166    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682235    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0464e1-ffa0-4d76-b89c-32c2db266027-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682412    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682458    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682496 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682486    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682733 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682536    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682733 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682573    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682875 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682858    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.682929 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.682874    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.683035 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.683014    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0e0464e1-ffa0-4d76-b89c-32c2db266027-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.684635 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.684611    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.684915 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.684898    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.689826 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.689807    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rl9j9\" (UniqueName: \"kubernetes.io/projected/0e0464e1-ffa0-4d76-b89c-32c2db266027-kube-api-access-rl9j9\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.689912 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.689877    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0e0464e1-ffa0-4d76-b89c-32c2db266027-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-lbtjm\" (UID: \"0e0464e1-ffa0-4d76-b89c-32c2db266027\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.806208 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.806178    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:17.943304 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.943267    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"]
Jun 03 14:58:17.943620 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:58:17.943596    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e0464e1_ffa0_4d76_b89c_32c2db266027.slice/crio-7077a541549c11be0ca671b9f32cca28fd617088215c6a30e979667695c40bd4 WatchSource:0}: Error finding container 7077a541549c11be0ca671b9f32cca28fd617088215c6a30e979667695c40bd4: Status 404 returned error can't find the container with id 7077a541549c11be0ca671b9f32cca28fd617088215c6a30e979667695c40bd4
Jun 03 14:58:17.945786 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.945758    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:58:17.945849 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.945819    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:58:17.945886 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:17.945864    2576 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 03 14:58:18.647426 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:18.647387    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm" event={"ID":"0e0464e1-ffa0-4d76-b89c-32c2db266027","Type":"ContainerStarted","Data":"4cff3b85667d91a2181fe596fdf78288854b4573d35b5c8c5be440eddf97b549"}
Jun 03 14:58:18.647426 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:18.647424    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm" event={"ID":"0e0464e1-ffa0-4d76-b89c-32c2db266027","Type":"ContainerStarted","Data":"7077a541549c11be0ca671b9f32cca28fd617088215c6a30e979667695c40bd4"}
Jun 03 14:58:18.669635 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:18.669582    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm" podStartSLOduration=1.669566282 podStartE2EDuration="1.669566282s" podCreationTimestamp="2026-06-03 14:58:17 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 14:58:18.666919962 +0000 UTC m=+774.183713036" watchObservedRunningTime="2026-06-03 14:58:18.669566282 +0000 UTC m=+774.186359339"
Jun 03 14:58:18.807206 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:18.807179    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:19.811648 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:19.811620    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:20.656428 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:20.656394    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:20.657494 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:20.657470    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-lbtjm"
Jun 03 14:58:33.988574 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:33.988536    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7498df8756-tqb59"]
Jun 03 14:58:34.037143 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.037096    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-tqb59"]
Jun 03 14:58:34.037305 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.037215    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-tqb59"
Jun 03 14:58:34.039761 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.039740    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-7b9vv\""
Jun 03 14:58:34.134846 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.134820    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n5lm7\" (UniqueName: \"kubernetes.io/projected/9a20a56b-d1a4-4525-9ad2-926da0fbf330-kube-api-access-n5lm7\") pod \"authorino-7498df8756-tqb59\" (UID: \"9a20a56b-d1a4-4525-9ad2-926da0fbf330\") " pod="kuadrant-system/authorino-7498df8756-tqb59"
Jun 03 14:58:34.235525 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.235483    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-n5lm7\" (UniqueName: \"kubernetes.io/projected/9a20a56b-d1a4-4525-9ad2-926da0fbf330-kube-api-access-n5lm7\") pod \"authorino-7498df8756-tqb59\" (UID: \"9a20a56b-d1a4-4525-9ad2-926da0fbf330\") " pod="kuadrant-system/authorino-7498df8756-tqb59"
Jun 03 14:58:34.243021 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.242968    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n5lm7\" (UniqueName: \"kubernetes.io/projected/9a20a56b-d1a4-4525-9ad2-926da0fbf330-kube-api-access-n5lm7\") pod \"authorino-7498df8756-tqb59\" (UID: \"9a20a56b-d1a4-4525-9ad2-926da0fbf330\") " pod="kuadrant-system/authorino-7498df8756-tqb59"
Jun 03 14:58:34.346324 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.346296    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-tqb59"
Jun 03 14:58:34.482372 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.482346    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7498df8756-tqb59"]
Jun 03 14:58:34.483315 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:58:34.483286    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9a20a56b_d1a4_4525_9ad2_926da0fbf330.slice/crio-3f63bb7a9bba310d4c7489830eb255ba9d669a30fe87ae8f579a0253fdd0323a WatchSource:0}: Error finding container 3f63bb7a9bba310d4c7489830eb255ba9d669a30fe87ae8f579a0253fdd0323a: Status 404 returned error can't find the container with id 3f63bb7a9bba310d4c7489830eb255ba9d669a30fe87ae8f579a0253fdd0323a
Jun 03 14:58:34.715968 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:34.715933    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-tqb59" event={"ID":"9a20a56b-d1a4-4525-9ad2-926da0fbf330","Type":"ContainerStarted","Data":"3f63bb7a9bba310d4c7489830eb255ba9d669a30fe87ae8f579a0253fdd0323a"}
Jun 03 14:58:37.730729 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:37.730690    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-tqb59" event={"ID":"9a20a56b-d1a4-4525-9ad2-926da0fbf330","Type":"ContainerStarted","Data":"089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add"}
Jun 03 14:58:37.744900 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:58:37.744844    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-7498df8756-tqb59" podStartSLOduration=1.952565793 podStartE2EDuration="4.744828286s" podCreationTimestamp="2026-06-03 14:58:33 +0000 UTC" firstStartedPulling="2026-06-03 14:58:34.48467656 +0000 UTC m=+790.001469592" lastFinishedPulling="2026-06-03 14:58:37.276939052 +0000 UTC m=+792.793732085" observedRunningTime="2026-06-03 14:58:37.744523544 +0000 UTC m=+793.261316600" watchObservedRunningTime="2026-06-03 14:58:37.744828286 +0000 UTC m=+793.261621342"
Jun 03 14:59:05.854144 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:05.854098    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"]
Jun 03 14:59:05.858178 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:05.858161    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:05.860797 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:05.860772    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jun 03 14:59:05.862357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:05.862041    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-ztk72\""
Jun 03 14:59:05.862357 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:05.862046    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jun 03 14:59:05.865904 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:05.865883    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"]
Jun 03 14:59:06.026897 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.026863    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.026897 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.026902    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.027113 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.027035    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7cp7\" (UniqueName: \"kubernetes.io/projected/973f5977-4a47-44e0-baa9-c6b08b9e148b-kube-api-access-t7cp7\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.128524 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.128441    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-t7cp7\" (UniqueName: \"kubernetes.io/projected/973f5977-4a47-44e0-baa9-c6b08b9e148b-kube-api-access-t7cp7\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.128524 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.128507    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.128694 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.128533    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.128885 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.128868    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-bundle\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.128938 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.128921    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-util\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.137724 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.137688    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7cp7\" (UniqueName: \"kubernetes.io/projected/973f5977-4a47-44e0-baa9-c6b08b9e148b-kube-api-access-t7cp7\") pod \"32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") " pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.168663 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.168635    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:06.299922 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.299889    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"]
Jun 03 14:59:06.300654 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:59:06.300629    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod973f5977_4a47_44e0_baa9_c6b08b9e148b.slice/crio-a922d486f14ef6346cff30e78930893dab42c0f0d84d74cf1e5392ddd03bc904 WatchSource:0}: Error finding container a922d486f14ef6346cff30e78930893dab42c0f0d84d74cf1e5392ddd03bc904: Status 404 returned error can't find the container with id a922d486f14ef6346cff30e78930893dab42c0f0d84d74cf1e5392ddd03bc904
Jun 03 14:59:06.302469 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.302454    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 14:59:06.851854 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.851819    2576 generic.go:358] "Generic (PLEG): container finished" podID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerID="e6b85b673db3d141526cccbdf4b087ffb4b2e552e7019574a2d6e2988f035484" exitCode=0
Jun 03 14:59:06.852025 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.851905    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk" event={"ID":"973f5977-4a47-44e0-baa9-c6b08b9e148b","Type":"ContainerDied","Data":"e6b85b673db3d141526cccbdf4b087ffb4b2e552e7019574a2d6e2988f035484"}
Jun 03 14:59:06.852025 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:06.851938    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk" event={"ID":"973f5977-4a47-44e0-baa9-c6b08b9e148b","Type":"ContainerStarted","Data":"a922d486f14ef6346cff30e78930893dab42c0f0d84d74cf1e5392ddd03bc904"}
Jun 03 14:59:07.858110 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:07.858078    2576 generic.go:358] "Generic (PLEG): container finished" podID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerID="f5aa28ee64973d4b7f70d033084e13b3721f50f5353e4b9c8a0e0a3572d7ee16" exitCode=0
Jun 03 14:59:07.858564 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:07.858119    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk" event={"ID":"973f5977-4a47-44e0-baa9-c6b08b9e148b","Type":"ContainerDied","Data":"f5aa28ee64973d4b7f70d033084e13b3721f50f5353e4b9c8a0e0a3572d7ee16"}
Jun 03 14:59:08.863220 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:08.863183    2576 generic.go:358] "Generic (PLEG): container finished" podID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerID="46d18948893770945eba379601a322dbf371c5ae6c52c7eba5902932fd4e8fc2" exitCode=0
Jun 03 14:59:08.863593 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:08.863269    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk" event={"ID":"973f5977-4a47-44e0-baa9-c6b08b9e148b","Type":"ContainerDied","Data":"46d18948893770945eba379601a322dbf371c5ae6c52c7eba5902932fd4e8fc2"}
Jun 03 14:59:09.994055 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:09.994030    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:10.167766 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.167683    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-util\") pod \"973f5977-4a47-44e0-baa9-c6b08b9e148b\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") "
Jun 03 14:59:10.167766 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.167721    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7cp7\" (UniqueName: \"kubernetes.io/projected/973f5977-4a47-44e0-baa9-c6b08b9e148b-kube-api-access-t7cp7\") pod \"973f5977-4a47-44e0-baa9-c6b08b9e148b\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") "
Jun 03 14:59:10.167985 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.167802    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-bundle\") pod \"973f5977-4a47-44e0-baa9-c6b08b9e148b\" (UID: \"973f5977-4a47-44e0-baa9-c6b08b9e148b\") "
Jun 03 14:59:10.168370 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.168346    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-bundle" (OuterVolumeSpecName: "bundle") pod "973f5977-4a47-44e0-baa9-c6b08b9e148b" (UID: "973f5977-4a47-44e0-baa9-c6b08b9e148b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:59:10.169851 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.169828    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/973f5977-4a47-44e0-baa9-c6b08b9e148b-kube-api-access-t7cp7" (OuterVolumeSpecName: "kube-api-access-t7cp7") pod "973f5977-4a47-44e0-baa9-c6b08b9e148b" (UID: "973f5977-4a47-44e0-baa9-c6b08b9e148b"). InnerVolumeSpecName "kube-api-access-t7cp7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 14:59:10.173643 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.173611    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-util" (OuterVolumeSpecName: "util") pod "973f5977-4a47-44e0-baa9-c6b08b9e148b" (UID: "973f5977-4a47-44e0-baa9-c6b08b9e148b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 03 14:59:10.269197 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.269167    2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-bundle\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:59:10.269197 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.269189    2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/973f5977-4a47-44e0-baa9-c6b08b9e148b-util\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:59:10.269197 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.269198    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7cp7\" (UniqueName: \"kubernetes.io/projected/973f5977-4a47-44e0-baa9-c6b08b9e148b-kube-api-access-t7cp7\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 14:59:10.873156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.873101    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk"
Jun 03 14:59:10.873156 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.873116    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/32684d7096c88e320aaae000f43b8c5ea50d1c3368188ae50aa1502a70nm7fk" event={"ID":"973f5977-4a47-44e0-baa9-c6b08b9e148b","Type":"ContainerDied","Data":"a922d486f14ef6346cff30e78930893dab42c0f0d84d74cf1e5392ddd03bc904"}
Jun 03 14:59:10.873361 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:10.873168    2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a922d486f14ef6346cff30e78930893dab42c0f0d84d74cf1e5392ddd03bc904"
Jun 03 14:59:28.414101 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414068    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 14:59:28.414497 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414462    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerName="pull"
Jun 03 14:59:28.414497 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414474    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerName="pull"
Jun 03 14:59:28.414497 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414494    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerName="util"
Jun 03 14:59:28.414598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414500    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerName="util"
Jun 03 14:59:28.414598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414519    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerName="extract"
Jun 03 14:59:28.414598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414524    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerName="extract"
Jun 03 14:59:28.414598 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.414580    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="973f5977-4a47-44e0-baa9-c6b08b9e148b" containerName="extract"
Jun 03 14:59:28.417635 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.417620    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:28.420514 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.420489    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 14:59:28.420648 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.420548    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 14:59:28.421625 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.421604    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8lhn8\""
Jun 03 14:59:28.421750 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.421649    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 14:59:28.427928 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.427908    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 14:59:28.524940 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.524909    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f4b7b\" (UniqueName: \"kubernetes.io/projected/aca11997-b144-4306-a6ec-d303c63b4ad2-kube-api-access-f4b7b\") pod \"maas-keycloak-0\" (UID: \"aca11997-b144-4306-a6ec-d303c63b4ad2\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:28.626198 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.626163    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-f4b7b\" (UniqueName: \"kubernetes.io/projected/aca11997-b144-4306-a6ec-d303c63b4ad2-kube-api-access-f4b7b\") pod \"maas-keycloak-0\" (UID: \"aca11997-b144-4306-a6ec-d303c63b4ad2\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:28.634229 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.634200    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f4b7b\" (UniqueName: \"kubernetes.io/projected/aca11997-b144-4306-a6ec-d303c63b4ad2-kube-api-access-f4b7b\") pod \"maas-keycloak-0\" (UID: \"aca11997-b144-4306-a6ec-d303c63b4ad2\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:28.728261 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.728229    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:28.864589 ip-10-0-140-251 kubenswrapper[2576]: W0603 14:59:28.864549    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaca11997_b144_4306_a6ec_d303c63b4ad2.slice/crio-dea779b5a2857fefdd43348c635b89ab6ef60a6d78d92a192dafa34a73c4d9df WatchSource:0}: Error finding container dea779b5a2857fefdd43348c635b89ab6ef60a6d78d92a192dafa34a73c4d9df: Status 404 returned error can't find the container with id dea779b5a2857fefdd43348c635b89ab6ef60a6d78d92a192dafa34a73c4d9df
Jun 03 14:59:28.864833 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.864810    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 14:59:28.940946 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:28.940913    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aca11997-b144-4306-a6ec-d303c63b4ad2","Type":"ContainerStarted","Data":"dea779b5a2857fefdd43348c635b89ab6ef60a6d78d92a192dafa34a73c4d9df"}
Jun 03 14:59:33.969406 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:33.969296    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aca11997-b144-4306-a6ec-d303c63b4ad2","Type":"ContainerStarted","Data":"35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8"}
Jun 03 14:59:33.991833 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:33.991155    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.152642412 podStartE2EDuration="5.991112925s" podCreationTimestamp="2026-06-03 14:59:28 +0000 UTC" firstStartedPulling="2026-06-03 14:59:28.865971091 +0000 UTC m=+844.382764133" lastFinishedPulling="2026-06-03 14:59:33.70444161 +0000 UTC m=+849.221234646" observedRunningTime="2026-06-03 14:59:33.990045962 +0000 UTC m=+849.506839030" watchObservedRunningTime="2026-06-03 14:59:33.991112925 +0000 UTC m=+849.507905983"
Jun 03 14:59:34.728362 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:34.728319    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:34.730201 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:34.730169    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:35.729678 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:35.729627    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:36.728936 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:36.728858    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:37.729332 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:37.729280    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:38.728605 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:38.728566    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:38.728931 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:38.728884    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:39.729588 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:39.729518    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:40.729364 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:40.729323    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:41.729272 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:41.729218    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:42.729208 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:42.729151    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:43.728660 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:43.728606    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:44.729358 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:44.729295    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:45.728990 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:45.728945    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.56:9000/health/started\": dial tcp 10.134.0.56:9000: connect: connection refused"
Jun 03 14:59:46.853093 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:46.853060    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:46.870388 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:46.870344    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 14:59:56.859281 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:56.859231    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 14:59:59.664857 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:59.664813    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-tqb59"]
Jun 03 14:59:59.665384 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:59.665004    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/authorino-7498df8756-tqb59" podUID="9a20a56b-d1a4-4525-9ad2-926da0fbf330" containerName="authorino" containerID="cri-o://089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add" gracePeriod=30
Jun 03 14:59:59.911918 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:59.911896    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-tqb59"
Jun 03 14:59:59.956800 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:59.956770    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n5lm7\" (UniqueName: \"kubernetes.io/projected/9a20a56b-d1a4-4525-9ad2-926da0fbf330-kube-api-access-n5lm7\") pod \"9a20a56b-d1a4-4525-9ad2-926da0fbf330\" (UID: \"9a20a56b-d1a4-4525-9ad2-926da0fbf330\") "
Jun 03 14:59:59.958850 ip-10-0-140-251 kubenswrapper[2576]: I0603 14:59:59.958814    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9a20a56b-d1a4-4525-9ad2-926da0fbf330-kube-api-access-n5lm7" (OuterVolumeSpecName: "kube-api-access-n5lm7") pod "9a20a56b-d1a4-4525-9ad2-926da0fbf330" (UID: "9a20a56b-d1a4-4525-9ad2-926da0fbf330"). InnerVolumeSpecName "kube-api-access-n5lm7". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:00:00.057845 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.057806    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n5lm7\" (UniqueName: \"kubernetes.io/projected/9a20a56b-d1a4-4525-9ad2-926da0fbf330-kube-api-access-n5lm7\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 15:00:00.099386 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.099351    2576 generic.go:358] "Generic (PLEG): container finished" podID="9a20a56b-d1a4-4525-9ad2-926da0fbf330" containerID="089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add" exitCode=0
Jun 03 15:00:00.099550 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.099404    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7498df8756-tqb59"
Jun 03 15:00:00.099550 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.099431    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-tqb59" event={"ID":"9a20a56b-d1a4-4525-9ad2-926da0fbf330","Type":"ContainerDied","Data":"089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add"}
Jun 03 15:00:00.099550 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.099464    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7498df8756-tqb59" event={"ID":"9a20a56b-d1a4-4525-9ad2-926da0fbf330","Type":"ContainerDied","Data":"3f63bb7a9bba310d4c7489830eb255ba9d669a30fe87ae8f579a0253fdd0323a"}
Jun 03 15:00:00.099550 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.099477    2576 scope.go:117] "RemoveContainer" containerID="089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add"
Jun 03 15:00:00.109325 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.109287    2576 scope.go:117] "RemoveContainer" containerID="089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add"
Jun 03 15:00:00.109555 ip-10-0-140-251 kubenswrapper[2576]: E0603 15:00:00.109537    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add\": container with ID starting with 089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add not found: ID does not exist" containerID="089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add"
Jun 03 15:00:00.109622 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.109564    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add"} err="failed to get container status \"089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add\": rpc error: code = NotFound desc = could not find container \"089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add\": container with ID starting with 089662a60e6843aa23a4e886256236b5d128610d56a497a5268da3e83cb66add not found: ID does not exist"
Jun 03 15:00:00.122624 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.122601    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7498df8756-tqb59"]
Jun 03 15:00:00.125241 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:00.125221    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7498df8756-tqb59"]
Jun 03 15:00:01.044171 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:01.044124    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9a20a56b-d1a4-4525-9ad2-926da0fbf330" path="/var/lib/kubelet/pods/9a20a56b-d1a4-4525-9ad2-926da0fbf330/volumes"
Jun 03 15:00:02.984003 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.983966    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-7f8968b5bf-xfljz"]
Jun 03 15:00:02.984443 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.984427    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9a20a56b-d1a4-4525-9ad2-926da0fbf330" containerName="authorino"
Jun 03 15:00:02.984487 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.984445    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9a20a56b-d1a4-4525-9ad2-926da0fbf330" containerName="authorino"
Jun 03 15:00:02.984522 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.984513    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="9a20a56b-d1a4-4525-9ad2-926da0fbf330" containerName="authorino"
Jun 03 15:00:02.987656 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.987639    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:02.990521 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.990501    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-vkljr\""
Jun 03 15:00:02.990767 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.990749    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 03 15:00:02.996369 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:02.996349    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8968b5bf-xfljz"]
Jun 03 15:00:03.085401 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.085370    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnxrf\" (UniqueName: \"kubernetes.io/projected/95e4070b-0c68-48da-bdb6-1cdd75972225-kube-api-access-wnxrf\") pod \"maas-controller-7f8968b5bf-xfljz\" (UID: \"95e4070b-0c68-48da-bdb6-1cdd75972225\") " pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:03.143070 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.143025    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-59866c4bc4-lvg7r"]
Jun 03 15:00:03.146084 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.146052    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59866c4bc4-lvg7r"
Jun 03 15:00:03.156835 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.156802    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59866c4bc4-lvg7r"]
Jun 03 15:00:03.186081 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.186051    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wnxrf\" (UniqueName: \"kubernetes.io/projected/95e4070b-0c68-48da-bdb6-1cdd75972225-kube-api-access-wnxrf\") pod \"maas-controller-7f8968b5bf-xfljz\" (UID: \"95e4070b-0c68-48da-bdb6-1cdd75972225\") " pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:03.186254 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.186093    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk8kw\" (UniqueName: \"kubernetes.io/projected/27287247-d3fa-4249-bc86-5b690d44c85e-kube-api-access-lk8kw\") pod \"maas-controller-59866c4bc4-lvg7r\" (UID: \"27287247-d3fa-4249-bc86-5b690d44c85e\") " pod="opendatahub/maas-controller-59866c4bc4-lvg7r"
Jun 03 15:00:03.195170 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.195147    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnxrf\" (UniqueName: \"kubernetes.io/projected/95e4070b-0c68-48da-bdb6-1cdd75972225-kube-api-access-wnxrf\") pod \"maas-controller-7f8968b5bf-xfljz\" (UID: \"95e4070b-0c68-48da-bdb6-1cdd75972225\") " pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:03.287039 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.286950    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lk8kw\" (UniqueName: \"kubernetes.io/projected/27287247-d3fa-4249-bc86-5b690d44c85e-kube-api-access-lk8kw\") pod \"maas-controller-59866c4bc4-lvg7r\" (UID: \"27287247-d3fa-4249-bc86-5b690d44c85e\") " pod="opendatahub/maas-controller-59866c4bc4-lvg7r"
Jun 03 15:00:03.295014 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.294995    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk8kw\" (UniqueName: \"kubernetes.io/projected/27287247-d3fa-4249-bc86-5b690d44c85e-kube-api-access-lk8kw\") pod \"maas-controller-59866c4bc4-lvg7r\" (UID: \"27287247-d3fa-4249-bc86-5b690d44c85e\") " pod="opendatahub/maas-controller-59866c4bc4-lvg7r"
Jun 03 15:00:03.299782 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.299763    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:03.434683 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.434655    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-7f8968b5bf-xfljz"]
Jun 03 15:00:03.436181 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:00:03.436154    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95e4070b_0c68_48da_bdb6_1cdd75972225.slice/crio-6814d6a2fed2f8b4e908f6dcb9ef7c1f1ce7e5b8cc89ccc319e18e703b089339 WatchSource:0}: Error finding container 6814d6a2fed2f8b4e908f6dcb9ef7c1f1ce7e5b8cc89ccc319e18e703b089339: Status 404 returned error can't find the container with id 6814d6a2fed2f8b4e908f6dcb9ef7c1f1ce7e5b8cc89ccc319e18e703b089339
Jun 03 15:00:03.456678 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.456651    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-59866c4bc4-lvg7r"
Jun 03 15:00:03.587872 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:03.587843    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-59866c4bc4-lvg7r"]
Jun 03 15:00:03.589467 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:00:03.589443    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27287247_d3fa_4249_bc86_5b690d44c85e.slice/crio-a072432a09fcb249b2af2a5c816fd7dcbdee958aac6dbf9d74408945b62830f1 WatchSource:0}: Error finding container a072432a09fcb249b2af2a5c816fd7dcbdee958aac6dbf9d74408945b62830f1: Status 404 returned error can't find the container with id a072432a09fcb249b2af2a5c816fd7dcbdee958aac6dbf9d74408945b62830f1
Jun 03 15:00:04.128406 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:04.128334    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59866c4bc4-lvg7r" event={"ID":"27287247-d3fa-4249-bc86-5b690d44c85e","Type":"ContainerStarted","Data":"a072432a09fcb249b2af2a5c816fd7dcbdee958aac6dbf9d74408945b62830f1"}
Jun 03 15:00:04.130811 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:04.130780    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8968b5bf-xfljz" event={"ID":"95e4070b-0c68-48da-bdb6-1cdd75972225","Type":"ContainerStarted","Data":"6814d6a2fed2f8b4e908f6dcb9ef7c1f1ce7e5b8cc89ccc319e18e703b089339"}
Jun 03 15:00:07.148282 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:07.148236    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-59866c4bc4-lvg7r" event={"ID":"27287247-d3fa-4249-bc86-5b690d44c85e","Type":"ContainerStarted","Data":"2257c0d8690d3188a36952c2b7ece6ccebaac47402b319cda0259884ef73e73e"}
Jun 03 15:00:07.148759 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:07.148355    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-59866c4bc4-lvg7r"
Jun 03 15:00:07.149549 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:07.149525    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8968b5bf-xfljz" event={"ID":"95e4070b-0c68-48da-bdb6-1cdd75972225","Type":"ContainerStarted","Data":"89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767"}
Jun 03 15:00:07.149665 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:07.149654    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:07.171796 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:07.171748    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-59866c4bc4-lvg7r" podStartSLOduration=1.674732803 podStartE2EDuration="4.171735159s" podCreationTimestamp="2026-06-03 15:00:03 +0000 UTC" firstStartedPulling="2026-06-03 15:00:03.590700033 +0000 UTC m=+879.107493065" lastFinishedPulling="2026-06-03 15:00:06.087702386 +0000 UTC m=+881.604495421" observedRunningTime="2026-06-03 15:00:07.167585862 +0000 UTC m=+882.684378946" watchObservedRunningTime="2026-06-03 15:00:07.171735159 +0000 UTC m=+882.688528214"
Jun 03 15:00:07.185114 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:07.185063    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-7f8968b5bf-xfljz" podStartSLOduration=2.524444746 podStartE2EDuration="5.185049441s" podCreationTimestamp="2026-06-03 15:00:02 +0000 UTC" firstStartedPulling="2026-06-03 15:00:03.437395217 +0000 UTC m=+878.954188249" lastFinishedPulling="2026-06-03 15:00:06.097999896 +0000 UTC m=+881.614792944" observedRunningTime="2026-06-03 15:00:07.183577863 +0000 UTC m=+882.700370917" watchObservedRunningTime="2026-06-03 15:00:07.185049441 +0000 UTC m=+882.701842541"
Jun 03 15:00:18.159211 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.159116    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-59866c4bc4-lvg7r"
Jun 03 15:00:18.159671 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.159321    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:18.222241 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.222207    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8968b5bf-xfljz"]
Jun 03 15:00:18.222424 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.222397    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-7f8968b5bf-xfljz" podUID="95e4070b-0c68-48da-bdb6-1cdd75972225" containerName="manager" containerID="cri-o://89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767" gracePeriod=30
Jun 03 15:00:18.475737 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.475711    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:18.530316 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.530282    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wnxrf\" (UniqueName: \"kubernetes.io/projected/95e4070b-0c68-48da-bdb6-1cdd75972225-kube-api-access-wnxrf\") pod \"95e4070b-0c68-48da-bdb6-1cdd75972225\" (UID: \"95e4070b-0c68-48da-bdb6-1cdd75972225\") "
Jun 03 15:00:18.532538 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.532505    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95e4070b-0c68-48da-bdb6-1cdd75972225-kube-api-access-wnxrf" (OuterVolumeSpecName: "kube-api-access-wnxrf") pod "95e4070b-0c68-48da-bdb6-1cdd75972225" (UID: "95e4070b-0c68-48da-bdb6-1cdd75972225"). InnerVolumeSpecName "kube-api-access-wnxrf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:00:18.631375 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:18.631336    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wnxrf\" (UniqueName: \"kubernetes.io/projected/95e4070b-0c68-48da-bdb6-1cdd75972225-kube-api-access-wnxrf\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 15:00:19.198352 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.198311    2576 generic.go:358] "Generic (PLEG): container finished" podID="95e4070b-0c68-48da-bdb6-1cdd75972225" containerID="89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767" exitCode=0
Jun 03 15:00:19.198730 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.198393    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8968b5bf-xfljz" event={"ID":"95e4070b-0c68-48da-bdb6-1cdd75972225","Type":"ContainerDied","Data":"89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767"}
Jun 03 15:00:19.198730 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.198434    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-7f8968b5bf-xfljz" event={"ID":"95e4070b-0c68-48da-bdb6-1cdd75972225","Type":"ContainerDied","Data":"6814d6a2fed2f8b4e908f6dcb9ef7c1f1ce7e5b8cc89ccc319e18e703b089339"}
Jun 03 15:00:19.198730 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.198449    2576 scope.go:117] "RemoveContainer" containerID="89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767"
Jun 03 15:00:19.198730 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.198404    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-7f8968b5bf-xfljz"
Jun 03 15:00:19.207760 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.207741    2576 scope.go:117] "RemoveContainer" containerID="89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767"
Jun 03 15:00:19.208016 ip-10-0-140-251 kubenswrapper[2576]: E0603 15:00:19.207997    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767\": container with ID starting with 89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767 not found: ID does not exist" containerID="89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767"
Jun 03 15:00:19.208064 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.208026    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767"} err="failed to get container status \"89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767\": rpc error: code = NotFound desc = could not find container \"89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767\": container with ID starting with 89942bd59418cd8cbe39e5f4bc62ce56b7febb566e8f0b88b56aa4eb74089767 not found: ID does not exist"
Jun 03 15:00:19.222596 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.222563    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-7f8968b5bf-xfljz"]
Jun 03 15:00:19.225217 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:19.225192    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-7f8968b5bf-xfljz"]
Jun 03 15:00:21.043920 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:21.043887    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95e4070b-0c68-48da-bdb6-1cdd75972225" path="/var/lib/kubelet/pods/95e4070b-0c68-48da-bdb6-1cdd75972225/volumes"
Jun 03 15:00:24.982865 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:24.982838    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 15:00:24.984292 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:24.984268    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 15:00:24.986695 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:24.986674    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 15:00:24.988062 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:24.988041    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 15:00:37.322294 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.322257    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-667b854b7d-hpnbp"]
Jun 03 15:00:37.326281 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.322650    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95e4070b-0c68-48da-bdb6-1cdd75972225" containerName="manager"
Jun 03 15:00:37.326281 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.322661    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="95e4070b-0c68-48da-bdb6-1cdd75972225" containerName="manager"
Jun 03 15:00:37.326281 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.322743    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="95e4070b-0c68-48da-bdb6-1cdd75972225" containerName="manager"
Jun 03 15:00:37.326281 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.326273    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.330452 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.330424    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 03 15:00:37.330452 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.330442    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-4v249\""
Jun 03 15:00:37.337636 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.337610    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-667b854b7d-hpnbp"]
Jun 03 15:00:37.514422 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.514384    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1af3c66-eff7-48b3-a516-40a9ee011697-maas-api-tls\") pod \"maas-api-667b854b7d-hpnbp\" (UID: \"d1af3c66-eff7-48b3-a516-40a9ee011697\") " pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.514594 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.514427    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftp5k\" (UniqueName: \"kubernetes.io/projected/d1af3c66-eff7-48b3-a516-40a9ee011697-kube-api-access-ftp5k\") pod \"maas-api-667b854b7d-hpnbp\" (UID: \"d1af3c66-eff7-48b3-a516-40a9ee011697\") " pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.615676 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.615598    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1af3c66-eff7-48b3-a516-40a9ee011697-maas-api-tls\") pod \"maas-api-667b854b7d-hpnbp\" (UID: \"d1af3c66-eff7-48b3-a516-40a9ee011697\") " pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.615676 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.615645    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-ftp5k\" (UniqueName: \"kubernetes.io/projected/d1af3c66-eff7-48b3-a516-40a9ee011697-kube-api-access-ftp5k\") pod \"maas-api-667b854b7d-hpnbp\" (UID: \"d1af3c66-eff7-48b3-a516-40a9ee011697\") " pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.618057 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.618034    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/d1af3c66-eff7-48b3-a516-40a9ee011697-maas-api-tls\") pod \"maas-api-667b854b7d-hpnbp\" (UID: \"d1af3c66-eff7-48b3-a516-40a9ee011697\") " pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.624084 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.624061    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftp5k\" (UniqueName: \"kubernetes.io/projected/d1af3c66-eff7-48b3-a516-40a9ee011697-kube-api-access-ftp5k\") pod \"maas-api-667b854b7d-hpnbp\" (UID: \"d1af3c66-eff7-48b3-a516-40a9ee011697\") " pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.638949 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.638928    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:37.775394 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.775365    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-667b854b7d-hpnbp"]
Jun 03 15:00:37.776936 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:00:37.776909    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1af3c66_eff7_48b3_a516_40a9ee011697.slice/crio-824ed234072b775d4866e228853464304661c81cf30519e8d482fbad58453730 WatchSource:0}: Error finding container 824ed234072b775d4866e228853464304661c81cf30519e8d482fbad58453730: Status 404 returned error can't find the container with id 824ed234072b775d4866e228853464304661c81cf30519e8d482fbad58453730
Jun 03 15:00:37.847653 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.847629    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-5v479"]
Jun 03 15:00:37.850824 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.850809    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479"
Jun 03 15:00:37.853677 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.853659    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-xtqsn\""
Jun 03 15:00:37.853764 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.853677    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 03 15:00:37.861039 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.861019    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-5v479"]
Jun 03 15:00:37.883526 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.883460    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-82z2j"]
Jun 03 15:00:37.885907 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.885893    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j"
Jun 03 15:00:37.898441 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:37.898411    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-82z2j"]
Jun 03 15:00:38.019901 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.019861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tvlk2\" (UniqueName: \"kubernetes.io/projected/81052fef-a7b5-4e20-9634-f50fa99f9d90-kube-api-access-tvlk2\") pod \"payload-pre-processing-75d9d88b9-5v479\" (UID: \"81052fef-a7b5-4e20-9634-f50fa99f9d90\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479"
Jun 03 15:00:38.020074 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.019930    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v5l2c\" (UniqueName: \"kubernetes.io/projected/ecb1d338-96dc-47dc-843e-22cc7f8e2cde-kube-api-access-v5l2c\") pod \"payload-processing-58b6c8fdc7-82z2j\" (UID: \"ecb1d338-96dc-47dc-843e-22cc7f8e2cde\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j"
Jun 03 15:00:38.121494 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.121456    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-tvlk2\" (UniqueName: \"kubernetes.io/projected/81052fef-a7b5-4e20-9634-f50fa99f9d90-kube-api-access-tvlk2\") pod \"payload-pre-processing-75d9d88b9-5v479\" (UID: \"81052fef-a7b5-4e20-9634-f50fa99f9d90\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479"
Jun 03 15:00:38.121691 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.121574    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v5l2c\" (UniqueName: \"kubernetes.io/projected/ecb1d338-96dc-47dc-843e-22cc7f8e2cde-kube-api-access-v5l2c\") pod \"payload-processing-58b6c8fdc7-82z2j\" (UID: \"ecb1d338-96dc-47dc-843e-22cc7f8e2cde\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j"
Jun 03 15:00:38.129753 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.129722    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tvlk2\" (UniqueName: \"kubernetes.io/projected/81052fef-a7b5-4e20-9634-f50fa99f9d90-kube-api-access-tvlk2\") pod \"payload-pre-processing-75d9d88b9-5v479\" (UID: \"81052fef-a7b5-4e20-9634-f50fa99f9d90\") " pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479"
Jun 03 15:00:38.129869 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.129798    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v5l2c\" (UniqueName: \"kubernetes.io/projected/ecb1d338-96dc-47dc-843e-22cc7f8e2cde-kube-api-access-v5l2c\") pod \"payload-processing-58b6c8fdc7-82z2j\" (UID: \"ecb1d338-96dc-47dc-843e-22cc7f8e2cde\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j"
Jun 03 15:00:38.162961 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.162893    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479"
Jun 03 15:00:38.196532 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.196498    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j"
Jun 03 15:00:38.283896 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.282764    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-667b854b7d-hpnbp" event={"ID":"d1af3c66-eff7-48b3-a516-40a9ee011697","Type":"ContainerStarted","Data":"824ed234072b775d4866e228853464304661c81cf30519e8d482fbad58453730"}
Jun 03 15:00:38.317313 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.317283    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-75d9d88b9-5v479"]
Jun 03 15:00:38.319361 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:00:38.319324    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81052fef_a7b5_4e20_9634_f50fa99f9d90.slice/crio-a8903f256672911da0dcb3085e6d0366f7487d449bb9b6d9703efd2851d23a0a WatchSource:0}: Error finding container a8903f256672911da0dcb3085e6d0366f7487d449bb9b6d9703efd2851d23a0a: Status 404 returned error can't find the container with id a8903f256672911da0dcb3085e6d0366f7487d449bb9b6d9703efd2851d23a0a
Jun 03 15:00:38.349733 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:38.349705    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-82z2j"]
Jun 03 15:00:38.350377 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:00:38.350354    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecb1d338_96dc_47dc_843e_22cc7f8e2cde.slice/crio-c06f1358fc14918b0cee98487e71dd3ffe94beaf333a3e2b80506aac05eea466 WatchSource:0}: Error finding container c06f1358fc14918b0cee98487e71dd3ffe94beaf333a3e2b80506aac05eea466: Status 404 returned error can't find the container with id c06f1358fc14918b0cee98487e71dd3ffe94beaf333a3e2b80506aac05eea466
Jun 03 15:00:39.295758 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:39.295689    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j" event={"ID":"ecb1d338-96dc-47dc-843e-22cc7f8e2cde","Type":"ContainerStarted","Data":"c06f1358fc14918b0cee98487e71dd3ffe94beaf333a3e2b80506aac05eea466"}
Jun 03 15:00:39.297780 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:39.297723    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479" event={"ID":"81052fef-a7b5-4e20-9634-f50fa99f9d90","Type":"ContainerStarted","Data":"a8903f256672911da0dcb3085e6d0366f7487d449bb9b6d9703efd2851d23a0a"}
Jun 03 15:00:41.310507 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:41.310467    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-667b854b7d-hpnbp" event={"ID":"d1af3c66-eff7-48b3-a516-40a9ee011697","Type":"ContainerStarted","Data":"a361ea198e0c81e71f0c5019855350f655522c4f8a14fbfde1ec88ef0a5bd7f1"}
Jun 03 15:00:41.310932 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:41.310564    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:41.333052 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:41.332993    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-667b854b7d-hpnbp" podStartSLOduration=1.858474645 podStartE2EDuration="4.332976579s" podCreationTimestamp="2026-06-03 15:00:37 +0000 UTC" firstStartedPulling="2026-06-03 15:00:37.778571551 +0000 UTC m=+913.295364585" lastFinishedPulling="2026-06-03 15:00:40.253073486 +0000 UTC m=+915.769866519" observedRunningTime="2026-06-03 15:00:41.328167656 +0000 UTC m=+916.844960712" watchObservedRunningTime="2026-06-03 15:00:41.332976579 +0000 UTC m=+916.849769637"
Jun 03 15:00:42.316280 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:42.316246    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j" event={"ID":"ecb1d338-96dc-47dc-843e-22cc7f8e2cde","Type":"ContainerStarted","Data":"d650c9bdffdfb75d65b409d26d43d88f0803257c0401e026e458350da7def1f2"}
Jun 03 15:00:42.316756 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:42.316391    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j"
Jun 03 15:00:42.317780 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:42.317756    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479" event={"ID":"81052fef-a7b5-4e20-9634-f50fa99f9d90","Type":"ContainerStarted","Data":"77b49b4d071bc5c948bde9c6de3b939c8299e08842c0e46168824a9f53190b4e"}
Jun 03 15:00:42.317888 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:42.317791    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479"
Jun 03 15:00:42.336777 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:42.336736    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j" podStartSLOduration=2.22826562 podStartE2EDuration="5.336723451s" podCreationTimestamp="2026-06-03 15:00:37 +0000 UTC" firstStartedPulling="2026-06-03 15:00:38.352052664 +0000 UTC m=+913.868845697" lastFinishedPulling="2026-06-03 15:00:41.460510478 +0000 UTC m=+916.977303528" observedRunningTime="2026-06-03 15:00:42.333475215 +0000 UTC m=+917.850268274" watchObservedRunningTime="2026-06-03 15:00:42.336723451 +0000 UTC m=+917.853516506"
Jun 03 15:00:42.350440 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:42.350393    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479" podStartSLOduration=2.217391978 podStartE2EDuration="5.350377322s" podCreationTimestamp="2026-06-03 15:00:37 +0000 UTC" firstStartedPulling="2026-06-03 15:00:38.321294785 +0000 UTC m=+913.838087839" lastFinishedPulling="2026-06-03 15:00:41.45428015 +0000 UTC m=+916.971073183" observedRunningTime="2026-06-03 15:00:42.349847564 +0000 UTC m=+917.866640620" watchObservedRunningTime="2026-06-03 15:00:42.350377322 +0000 UTC m=+917.867170378"
Jun 03 15:00:47.323798 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:47.323771    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-667b854b7d-hpnbp"
Jun 03 15:00:49.216231 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:49.216196    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 15:00:49.216688 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:49.216409    2576 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak" containerID="cri-o://35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8" gracePeriod=30
Jun 03 15:00:51.263534 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.263505    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.355019 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.354989    2576 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f4b7b\" (UniqueName: \"kubernetes.io/projected/aca11997-b144-4306-a6ec-d303c63b4ad2-kube-api-access-f4b7b\") pod \"aca11997-b144-4306-a6ec-d303c63b4ad2\" (UID: \"aca11997-b144-4306-a6ec-d303c63b4ad2\") "
Jun 03 15:00:51.357335 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.357307    2576 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aca11997-b144-4306-a6ec-d303c63b4ad2-kube-api-access-f4b7b" (OuterVolumeSpecName: "kube-api-access-f4b7b") pod "aca11997-b144-4306-a6ec-d303c63b4ad2" (UID: "aca11997-b144-4306-a6ec-d303c63b4ad2"). InnerVolumeSpecName "kube-api-access-f4b7b". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 03 15:00:51.359531 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.359498    2576 generic.go:358] "Generic (PLEG): container finished" podID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerID="35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8" exitCode=143
Jun 03 15:00:51.359643 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.359577    2576 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.359643 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.359579    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aca11997-b144-4306-a6ec-d303c63b4ad2","Type":"ContainerDied","Data":"35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8"}
Jun 03 15:00:51.359643 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.359624    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"aca11997-b144-4306-a6ec-d303c63b4ad2","Type":"ContainerDied","Data":"dea779b5a2857fefdd43348c635b89ab6ef60a6d78d92a192dafa34a73c4d9df"}
Jun 03 15:00:51.359793 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.359644    2576 scope.go:117] "RemoveContainer" containerID="35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8"
Jun 03 15:00:51.372417 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.372393    2576 scope.go:117] "RemoveContainer" containerID="35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8"
Jun 03 15:00:51.372690 ip-10-0-140-251 kubenswrapper[2576]: E0603 15:00:51.372672    2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8\": container with ID starting with 35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8 not found: ID does not exist" containerID="35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8"
Jun 03 15:00:51.372749 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.372698    2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8"} err="failed to get container status \"35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8\": rpc error: code = NotFound desc = could not find container \"35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8\": container with ID starting with 35c0d279dd0172c151ae24d8d33eec1659049c54133a338c07eefecee490e6e8 not found: ID does not exist"
Jun 03 15:00:51.386018 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.385918    2576 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 15:00:51.388514 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.388492    2576 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 15:00:51.411996 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.411963    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 15:00:51.412615 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.412592    2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak"
Jun 03 15:00:51.412615 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.412615    2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak"
Jun 03 15:00:51.412768 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.412756    2576 memory_manager.go:356] "RemoveStaleState removing state" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" containerName="keycloak"
Jun 03 15:00:51.415760 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.415741    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.418502 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.418481    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 03 15:00:51.418616 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.418489    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 03 15:00:51.418616 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.418566    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 03 15:00:51.418616 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.418570    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-8lhn8\""
Jun 03 15:00:51.418775 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.418622    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 03 15:00:51.427890 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.427865    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 15:00:51.456112 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.456082    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nnm8\" (UniqueName: \"kubernetes.io/projected/486f3813-841e-4afe-b94b-f763d2a706ac-kube-api-access-4nnm8\") pod \"maas-keycloak-0\" (UID: \"486f3813-841e-4afe-b94b-f763d2a706ac\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.456267 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.456250    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/486f3813-841e-4afe-b94b-f763d2a706ac-test-realms\") pod \"maas-keycloak-0\" (UID: \"486f3813-841e-4afe-b94b-f763d2a706ac\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.456375 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.456363    2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f4b7b\" (UniqueName: \"kubernetes.io/projected/aca11997-b144-4306-a6ec-d303c63b4ad2-kube-api-access-f4b7b\") on node \"ip-10-0-140-251.ec2.internal\" DevicePath \"\""
Jun 03 15:00:51.557893 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.557858    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/486f3813-841e-4afe-b94b-f763d2a706ac-test-realms\") pod \"maas-keycloak-0\" (UID: \"486f3813-841e-4afe-b94b-f763d2a706ac\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.558071 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.557913    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-4nnm8\" (UniqueName: \"kubernetes.io/projected/486f3813-841e-4afe-b94b-f763d2a706ac-kube-api-access-4nnm8\") pod \"maas-keycloak-0\" (UID: \"486f3813-841e-4afe-b94b-f763d2a706ac\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.558589 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.558570    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/486f3813-841e-4afe-b94b-f763d2a706ac-test-realms\") pod \"maas-keycloak-0\" (UID: \"486f3813-841e-4afe-b94b-f763d2a706ac\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.568031 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.568006    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nnm8\" (UniqueName: \"kubernetes.io/projected/486f3813-841e-4afe-b94b-f763d2a706ac-kube-api-access-4nnm8\") pod \"maas-keycloak-0\" (UID: \"486f3813-841e-4afe-b94b-f763d2a706ac\") " pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.727119 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.727085    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:51.865263 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:51.865238    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 03 15:00:51.866563 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:00:51.866532    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod486f3813_841e_4afe_b94b_f763d2a706ac.slice/crio-e291cd7dc513b57e4111d6a115d92cf421e6d4c350ee6e69e5d7ce76ea4d33af WatchSource:0}: Error finding container e291cd7dc513b57e4111d6a115d92cf421e6d4c350ee6e69e5d7ce76ea4d33af: Status 404 returned error can't find the container with id e291cd7dc513b57e4111d6a115d92cf421e6d4c350ee6e69e5d7ce76ea4d33af
Jun 03 15:00:52.367139 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:52.367081    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"486f3813-841e-4afe-b94b-f763d2a706ac","Type":"ContainerStarted","Data":"b6956c1392e2f59be66d695a37a860c944ac04fb763e2004ef6d0456378273e3"}
Jun 03 15:00:52.367624 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:52.367154    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"486f3813-841e-4afe-b94b-f763d2a706ac","Type":"ContainerStarted","Data":"e291cd7dc513b57e4111d6a115d92cf421e6d4c350ee6e69e5d7ce76ea4d33af"}
Jun 03 15:00:52.400317 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:52.400266    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.10436749 podStartE2EDuration="1.400251234s" podCreationTimestamp="2026-06-03 15:00:51 +0000 UTC" firstStartedPulling="2026-06-03 15:00:51.86790626 +0000 UTC m=+927.384699294" lastFinishedPulling="2026-06-03 15:00:52.163790004 +0000 UTC m=+927.680583038" observedRunningTime="2026-06-03 15:00:52.398349626 +0000 UTC m=+927.915142705" watchObservedRunningTime="2026-06-03 15:00:52.400251234 +0000 UTC m=+927.917044289"
Jun 03 15:00:52.728061 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:52.728029    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:00:52.729757 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:52.729725    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:00:53.044754 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:53.044721    2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aca11997-b144-4306-a6ec-d303c63b4ad2" path="/var/lib/kubelet/pods/aca11997-b144-4306-a6ec-d303c63b4ad2/volumes"
Jun 03 15:00:53.324437 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:53.324350    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-75d9d88b9-5v479"
Jun 03 15:00:53.324790 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:53.324768    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-82z2j"
Jun 03 15:00:53.727854 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:53.727802    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:00:54.728286 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:54.728236    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:00:55.727734 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:55.727684    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:00:56.727933 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:56.727891    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:00:57.727785 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:57.727736    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:00:58.727863 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:58.727814    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:00:59.728150 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:00:59.728085    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:01:00.727834 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:00.727787    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:01:01.727610 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:01.727572    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:01:01.728010 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:01.727857    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:01:02.727951 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:02.727900    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:01:03.727961 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:03.727912    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:01:04.728241 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:04.728201    2576 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.62:9000/health/started\": dial tcp 10.134.0.62:9000: connect: connection refused"
Jun 03 15:01:05.853888 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:05.853852    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:01:05.871965 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:05.871918    2576 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="486f3813-841e-4afe-b94b-f763d2a706ac" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 03 15:01:15.861007 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:15.860976    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 03 15:01:33.035317 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.035287    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"]
Jun 03 15:01:33.040934 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.040906    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.044289 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.044181    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gnjdk\""
Jun 03 15:01:33.044437 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.044365    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 03 15:01:33.045085 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.045046    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 03 15:01:33.045085 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.045072    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 03 15:01:33.054799 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.054778    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"]
Jun 03 15:01:33.090843 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.090819    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.090961 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.090861    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.090961 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.090882    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.090961 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.090944    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.091071 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.090992    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.091170 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.091121    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qr7r7\" (UniqueName: \"kubernetes.io/projected/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-kube-api-access-qr7r7\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.192534 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.192504    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qr7r7\" (UniqueName: \"kubernetes.io/projected/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-kube-api-access-qr7r7\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.192692 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.192549    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.192692 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.192600    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.192692 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.192629    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.192692 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.192684    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.192875 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.192737    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.193062 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.193042    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.193163 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.193030    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.193163 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.193084    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.194948 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.194924    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.195225 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.195208    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.206685 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.206663    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qr7r7\" (UniqueName: \"kubernetes.io/projected/1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094-kube-api-access-qr7r7\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b\" (UID: \"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.354293 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.354216    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:01:33.516511 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.516477    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"]
Jun 03 15:01:33.519162 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:01:33.519117    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d07f4bc_a142_4e4a_b8ae_90ca6bbeb094.slice/crio-c62094b86564353dce602f425ead458cbd18021f12cdb0c16a38c4045426dc26 WatchSource:0}: Error finding container c62094b86564353dce602f425ead458cbd18021f12cdb0c16a38c4045426dc26: Status 404 returned error can't find the container with id c62094b86564353dce602f425ead458cbd18021f12cdb0c16a38c4045426dc26
Jun 03 15:01:33.566771 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:33.566737    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b" event={"ID":"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094","Type":"ContainerStarted","Data":"c62094b86564353dce602f425ead458cbd18021f12cdb0c16a38c4045426dc26"}
Jun 03 15:01:38.594394 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:38.594355    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b" event={"ID":"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094","Type":"ContainerStarted","Data":"7b8c31c354d0eae8c34e74c1ce85668d29eb0b5c10f2f9815a9e83964f0e58b1"}
Jun 03 15:01:42.612282 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:42.612240    2576 generic.go:358] "Generic (PLEG): container finished" podID="1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094" containerID="7b8c31c354d0eae8c34e74c1ce85668d29eb0b5c10f2f9815a9e83964f0e58b1" exitCode=0
Jun 03 15:01:42.612785 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:42.612319    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b" event={"ID":"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094","Type":"ContainerDied","Data":"7b8c31c354d0eae8c34e74c1ce85668d29eb0b5c10f2f9815a9e83964f0e58b1"}
Jun 03 15:01:44.377792 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.377760    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"]
Jun 03 15:01:44.382967 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.382947    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.392883 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.392855    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\""
Jun 03 15:01:44.442553 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.442523    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"]
Jun 03 15:01:44.503589 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.503541    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.503589 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.503593    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.503793 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.503748    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.503793 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.503776    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.503905 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.503841    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qh5sd\" (UniqueName: \"kubernetes.io/projected/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-kube-api-access-qh5sd\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.503905 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.503896    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605253 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605215    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605253 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605252    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605524 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605301    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qh5sd\" (UniqueName: \"kubernetes.io/projected/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-kube-api-access-qh5sd\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605524 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605322    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605524 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605359    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605524 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605378    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605739 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605689    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-home\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605920 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605898    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-model-cache\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.605997 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.605971    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.607596 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.607577    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-dshm\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.608061 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.608040    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-tls-certs\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.623082 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.623052    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qh5sd\" (UniqueName: \"kubernetes.io/projected/66cb0fdd-4631-42f4-b38b-0cf1e06b804b-kube-api-access-qh5sd\") pod \"e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk\" (UID: \"66cb0fdd-4631-42f4-b38b-0cf1e06b804b\") " pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.696025 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.695935    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:44.849968 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:44.849945    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"]
Jun 03 15:01:44.851925 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:01:44.851900    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66cb0fdd_4631_42f4_b38b_0cf1e06b804b.slice/crio-7b5829cd170961a52e00e1eef2bba7500631e1f38ccdc813840297a30e53dab4 WatchSource:0}: Error finding container 7b5829cd170961a52e00e1eef2bba7500631e1f38ccdc813840297a30e53dab4: Status 404 returned error can't find the container with id 7b5829cd170961a52e00e1eef2bba7500631e1f38ccdc813840297a30e53dab4
Jun 03 15:01:45.629497 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:45.629464    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk" event={"ID":"66cb0fdd-4631-42f4-b38b-0cf1e06b804b","Type":"ContainerStarted","Data":"386ddd2c0bd67226c767d54986cff6496a5a953d42bb7e7a5a80646378d94a7a"}
Jun 03 15:01:45.629899 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:45.629504    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk" event={"ID":"66cb0fdd-4631-42f4-b38b-0cf1e06b804b","Type":"ContainerStarted","Data":"7b5829cd170961a52e00e1eef2bba7500631e1f38ccdc813840297a30e53dab4"}
Jun 03 15:01:49.647017 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:49.646985    2576 generic.go:358] "Generic (PLEG): container finished" podID="66cb0fdd-4631-42f4-b38b-0cf1e06b804b" containerID="386ddd2c0bd67226c767d54986cff6496a5a953d42bb7e7a5a80646378d94a7a" exitCode=0
Jun 03 15:01:49.647393 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:49.647063    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk" event={"ID":"66cb0fdd-4631-42f4-b38b-0cf1e06b804b","Type":"ContainerDied","Data":"386ddd2c0bd67226c767d54986cff6496a5a953d42bb7e7a5a80646378d94a7a"}
Jun 03 15:01:52.661487 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:52.661451    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk" event={"ID":"66cb0fdd-4631-42f4-b38b-0cf1e06b804b","Type":"ContainerStarted","Data":"535a8e6d98ce00b77c03c6ddbb1f946543349a7691c55edc7f464e4843092496"}
Jun 03 15:01:52.691731 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:52.691680    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk" podStartSLOduration=6.712004986 podStartE2EDuration="8.691663211s" podCreationTimestamp="2026-06-03 15:01:44 +0000 UTC" firstStartedPulling="2026-06-03 15:01:49.647747412 +0000 UTC m=+985.164540446" lastFinishedPulling="2026-06-03 15:01:51.627405636 +0000 UTC m=+987.144198671" observedRunningTime="2026-06-03 15:01:52.688438489 +0000 UTC m=+988.205231544" watchObservedRunningTime="2026-06-03 15:01:52.691663211 +0000 UTC m=+988.208456266"
Jun 03 15:01:54.696509 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:54.696477    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:54.696509 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:54.696514    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:54.710109 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:54.710078    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:55.686150 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:55.686110    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk"
Jun 03 15:01:59.691668 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:01:59.691627    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b" event={"ID":"1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094","Type":"ContainerStarted","Data":"3596b23c327583f10638be96ebe21f51fdc3ecf8c7cae03a2bae3be847167b22"}
Jun 03 15:02:03.354528 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:02:03.354480    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:02:03.354924 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:02:03.354539    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:02:03.367364 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:02:03.367340    2576 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:02:03.391189 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:02:03.391141    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b" podStartSLOduration=6.034686394 podStartE2EDuration="31.391114232s" podCreationTimestamp="2026-06-03 15:01:32 +0000 UTC" firstStartedPulling="2026-06-03 15:01:33.520939775 +0000 UTC m=+969.037732807" lastFinishedPulling="2026-06-03 15:01:58.877367597 +0000 UTC m=+994.394160645" observedRunningTime="2026-06-03 15:01:59.727084127 +0000 UTC m=+995.243877181" watchObservedRunningTime="2026-06-03 15:02:03.391114232 +0000 UTC m=+998.907907286"
Jun 03 15:02:03.719043 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:02:03.719011    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b"
Jun 03 15:05:25.023391 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:05:25.023358    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 15:05:25.026317 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:05:25.026295    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 15:05:25.026884 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:05:25.026868    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 15:05:25.029926 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:05:25.029903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cq5p2_3ae7b1b0-8f72-4b0c-8a04-e812b3bb9a60/ovn-acl-logging/0.log"
Jun 03 15:09:08.697716 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:08.697683    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69b458fb86-fgvs9_02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39/nginx/0.log"
Jun 03 15:09:09.048434 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:09.048357    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-667b854b7d-hpnbp_d1af3c66-eff7-48b3-a516-40a9ee011697/maas-api/0.log"
Jun 03 15:09:09.173796 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:09.173766    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59866c4bc4-lvg7r_27287247-d3fa-4249-bc86-5b690d44c85e/manager/0.log"
Jun 03 15:09:09.304210 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:09.304103    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-4hvbw_990e0aef-5c27-4850-9fe2-1c5fd5fd7d55/server/0.log"
Jun 03 15:09:09.564058 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:09.563979    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp_9616cafb-339f-486f-8e04-a080f1f21f5e/copy-manifests/0.log"
Jun 03 15:09:09.577789 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:09.577761    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp_9616cafb-339f-486f-8e04-a080f1f21f5e/manager/0.log"
Jun 03 15:09:10.746196 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:10.746166    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf_44688955-f71a-49f0-a10f-f2de000eac3b/util/0.log"
Jun 03 15:09:10.763506 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:10.763480    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf_44688955-f71a-49f0-a10f-f2de000eac3b/pull/0.log"
Jun 03 15:09:10.773542 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:10.773520    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf_44688955-f71a-49f0-a10f-f2de000eac3b/extract/0.log"
Jun 03 15:09:10.897020 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:10.896992    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn_d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f/util/0.log"
Jun 03 15:09:10.913151 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:10.913117    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn_d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f/pull/0.log"
Jun 03 15:09:10.927318 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:10.927298    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn_d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f/extract/0.log"
Jun 03 15:09:11.046820 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.046745    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz_aa3b78f4-2f5a-4acb-8b03-3fd970c10889/pull/0.log"
Jun 03 15:09:11.055401 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.055377    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz_aa3b78f4-2f5a-4acb-8b03-3fd970c10889/extract/0.log"
Jun 03 15:09:11.064259 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.064240    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz_aa3b78f4-2f5a-4acb-8b03-3fd970c10889/util/0.log"
Jun 03 15:09:11.176947 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.176921    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln_bbd810f6-f930-4f31-a3e9-5463e6cb0f29/util/0.log"
Jun 03 15:09:11.186313 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.186287    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln_bbd810f6-f930-4f31-a3e9-5463e6cb0f29/pull/0.log"
Jun 03 15:09:11.194832 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.194812    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln_bbd810f6-f930-4f31-a3e9-5463e6cb0f29/extract/0.log"
Jun 03 15:09:11.554168 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.554123    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-wv5mw_3ca961f8-d5fc-42f3-a525-9fedc0f0df2c/manager/0.log"
Jun 03 15:09:11.672148 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.672100    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-zkbtq_c16362e2-3cfe-456c-8290-3d0d749d5b02/kuadrant-console-plugin/0.log"
Jun 03 15:09:11.794829 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.794790    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-27hvf_757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0/registry-server/0.log"
Jun 03 15:09:11.927763 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:11.927682    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9npkg_754329dd-2cd1-4064-9898-8cf6cfc7bb97/manager/0.log"
Jun 03 15:09:12.547476 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:12.547441    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6_4099e067-72af-45f7-9d3e-5e8544e85ece/istio-proxy/0.log"
Jun 03 15:09:13.017461 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:13.017437    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-lbtjm_0e0464e1-ffa0-4d76-b89c-32c2db266027/istio-proxy/0.log"
Jun 03 15:09:13.135535 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:13.135506    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-5v479_81052fef-a7b5-4e20-9634-f50fa99f9d90/payload-pre-processing/0.log"
Jun 03 15:09:13.256512 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:13.256486    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-82z2j_ecb1d338-96dc-47dc-843e-22cc7f8e2cde/payload-processing/0.log"
Jun 03 15:09:13.735346 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:13.735318    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b_1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094/storage-initializer/0.log"
Jun 03 15:09:13.744316 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:13.744288    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-pzp8b_1d07f4bc-a142-4e4a-b8ae-90ca6bbeb094/main/0.log"
Jun 03 15:09:13.859678 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:13.859648    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk_66cb0fdd-4631-42f4-b38b-0cf1e06b804b/storage-initializer/0.log"
Jun 03 15:09:13.872600 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:13.872575    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5489f4f4bc-qdcnk_66cb0fdd-4631-42f4-b38b-0cf1e06b804b/main/0.log"
Jun 03 15:09:22.012722 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:22.012691    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-vlqpg_5c62b226-cb13-4d18-8a23-a722f29f8cbd/global-pull-secret-syncer/0.log"
Jun 03 15:09:22.079190 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:22.079155    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-4l555_5b26d486-14a9-4e91-b44f-fc82d1cb39d7/konnectivity-agent/0.log"
Jun 03 15:09:22.250405 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:22.250371    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-251.ec2.internal_a180eda1c8d6820e570160c8b827bfae/haproxy/0.log"
Jun 03 15:09:25.948473 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:25.948446    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf_44688955-f71a-49f0-a10f-f2de000eac3b/extract/0.log"
Jun 03 15:09:25.971646 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:25.971620    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf_44688955-f71a-49f0-a10f-f2de000eac3b/util/0.log"
Jun 03 15:09:25.996757 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:25.996735    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592n8rf_44688955-f71a-49f0-a10f-f2de000eac3b/pull/0.log"
Jun 03 15:09:26.024896 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.024869    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn_d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f/extract/0.log"
Jun 03 15:09:26.047473 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.047444    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn_d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f/util/0.log"
Jun 03 15:09:26.070840 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.070796    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0nzqpn_d9cfb542-bc1c-4b7d-8ec4-8ebdf0a7cf6f/pull/0.log"
Jun 03 15:09:26.115039 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.115017    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz_aa3b78f4-2f5a-4acb-8b03-3fd970c10889/extract/0.log"
Jun 03 15:09:26.160931 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.160903    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz_aa3b78f4-2f5a-4acb-8b03-3fd970c10889/util/0.log"
Jun 03 15:09:26.198645 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.198568    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73l7pwz_aa3b78f4-2f5a-4acb-8b03-3fd970c10889/pull/0.log"
Jun 03 15:09:26.244143 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.244105    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln_bbd810f6-f930-4f31-a3e9-5463e6cb0f29/extract/0.log"
Jun 03 15:09:26.288678 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.288649    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln_bbd810f6-f930-4f31-a3e9-5463e6cb0f29/util/0.log"
Jun 03 15:09:26.334539 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.334513    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef17cvln_bbd810f6-f930-4f31-a3e9-5463e6cb0f29/pull/0.log"
Jun 03 15:09:26.437707 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.437677    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-wv5mw_3ca961f8-d5fc-42f3-a525-9fedc0f0df2c/manager/0.log"
Jun 03 15:09:26.463925 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.463846    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-6cb54b5c86-zkbtq_c16362e2-3cfe-456c-8290-3d0d749d5b02/kuadrant-console-plugin/0.log"
Jun 03 15:09:26.506631 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.506597    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-27hvf_757ef4aa-3f6e-4eb1-8aaf-825ffd3e34d0/registry-server/0.log"
Jun 03 15:09:26.565408 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:26.565377    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-55c7f4c975-9npkg_754329dd-2cd1-4064-9898-8cf6cfc7bb97/manager/0.log"
Jun 03 15:09:27.896187 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:27.896158    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bdcc783-2c20-4425-a95a-9bc15b1a0e39/alertmanager/0.log"
Jun 03 15:09:27.923880 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:27.923852    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bdcc783-2c20-4425-a95a-9bc15b1a0e39/config-reloader/0.log"
Jun 03 15:09:27.948519 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:27.948499    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bdcc783-2c20-4425-a95a-9bc15b1a0e39/kube-rbac-proxy-web/0.log"
Jun 03 15:09:27.970568 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:27.970545    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bdcc783-2c20-4425-a95a-9bc15b1a0e39/kube-rbac-proxy/0.log"
Jun 03 15:09:27.996462 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:27.996442    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bdcc783-2c20-4425-a95a-9bc15b1a0e39/kube-rbac-proxy-metric/0.log"
Jun 03 15:09:28.019587 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.019565    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bdcc783-2c20-4425-a95a-9bc15b1a0e39/prom-label-proxy/0.log"
Jun 03 15:09:28.041266 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.041241    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_6bdcc783-2c20-4425-a95a-9bc15b1a0e39/init-config-reloader/0.log"
Jun 03 15:09:28.090497 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.090469    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-69b6cbdb88-9mwdn_d10cc6e5-f695-4031-90cd-9824659fba3b/cluster-monitoring-operator/0.log"
Jun 03 15:09:28.119234 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.119207    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mlkkt_7421bfa0-3cfc-4579-b0d9-64aea57e5ff8/kube-state-metrics/0.log"
Jun 03 15:09:28.142010 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.141990    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mlkkt_7421bfa0-3cfc-4579-b0d9-64aea57e5ff8/kube-rbac-proxy-main/0.log"
Jun 03 15:09:28.163294 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.163233    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-8469c486bb-mlkkt_7421bfa0-3cfc-4579-b0d9-64aea57e5ff8/kube-rbac-proxy-self/0.log"
Jun 03 15:09:28.235660 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.235637    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-z8wwp_3a20a3bc-6662-4c39-b474-299d3e6191b0/monitoring-plugin/0.log"
Jun 03 15:09:28.406292 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.406266    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g67j6_73140bba-fedb-47be-bc7f-3362ea597efc/node-exporter/0.log"
Jun 03 15:09:28.435244 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.435171    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g67j6_73140bba-fedb-47be-bc7f-3362ea597efc/kube-rbac-proxy/0.log"
Jun 03 15:09:28.468038 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.468013    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-g67j6_73140bba-fedb-47be-bc7f-3362ea597efc/init-textfile/0.log"
Jun 03 15:09:28.591687 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.591652    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-r67qr_beeab172-f2f6-402a-ad04-8fe9f8cebf04/kube-rbac-proxy-main/0.log"
Jun 03 15:09:28.614699 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.614666    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-r67qr_beeab172-f2f6-402a-ad04-8fe9f8cebf04/kube-rbac-proxy-self/0.log"
Jun 03 15:09:28.638437 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:28.638414    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-r67qr_beeab172-f2f6-402a-ad04-8fe9f8cebf04/openshift-state-metrics/0.log"
Jun 03 15:09:29.048733 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:29.048703    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b47fb5ff-5g5mz_d5850d7f-56be-4188-ae4c-133f8bbfd3c0/thanos-query/0.log"
Jun 03 15:09:29.073189 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:29.073167    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b47fb5ff-5g5mz_d5850d7f-56be-4188-ae4c-133f8bbfd3c0/kube-rbac-proxy-web/0.log"
Jun 03 15:09:29.099614 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:29.099597    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b47fb5ff-5g5mz_d5850d7f-56be-4188-ae4c-133f8bbfd3c0/kube-rbac-proxy/0.log"
Jun 03 15:09:29.120871 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:29.120805    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b47fb5ff-5g5mz_d5850d7f-56be-4188-ae4c-133f8bbfd3c0/prom-label-proxy/0.log"
Jun 03 15:09:29.143115 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:29.143094    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b47fb5ff-5g5mz_d5850d7f-56be-4188-ae4c-133f8bbfd3c0/kube-rbac-proxy-rules/0.log"
Jun 03 15:09:29.164911 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:29.164889    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6b47fb5ff-5g5mz_d5850d7f-56be-4188-ae4c-133f8bbfd3c0/kube-rbac-proxy-metrics/0.log"
Jun 03 15:09:30.837932 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:30.837899    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/1.log"
Jun 03 15:09:30.847350 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:30.847327    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-zz2j7_7317b775-d822-4530-b5fb-65c35ca3e8b0/console-operator/2.log"
Jun 03 15:09:31.360267 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.360239    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56bf699cb8-kz5w5_f2a20082-bc9b-4c88-9179-905bab87f604/console/0.log"
Jun 03 15:09:31.518161 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.518115    2576 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"]
Jun 03 15:09:31.521999 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.521983    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.527632 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.527605    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9snz7\"/\"openshift-service-ca.crt\""
Jun 03 15:09:31.528950 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.528928    2576 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-9snz7\"/\"default-dockercfg-hzmpx\""
Jun 03 15:09:31.529062 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.528955    2576 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-9snz7\"/\"kube-root-ca.crt\""
Jun 03 15:09:31.539914 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.539893    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"]
Jun 03 15:09:31.641432 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.641353    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-sys\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.641432 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.641422    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-podres\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.641619 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.641452    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p646\" (UniqueName: \"kubernetes.io/projected/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-kube-api-access-8p646\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.641619 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.641517    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-proc\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.641619 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.641579    2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-lib-modules\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742564 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742535    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-lib-modules\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742734 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742574    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-sys\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742734 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742616    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-podres\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742734 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742639    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8p646\" (UniqueName: \"kubernetes.io/projected/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-kube-api-access-8p646\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742734 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742671    2576 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-proc\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742734 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742707    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-lib-modules\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742734 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742721    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-sys\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742980 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742753    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-podres\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.742980 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.742776    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-proc\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.751578 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.751554    2576 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p646\" (UniqueName: \"kubernetes.io/projected/97d11a94-85bf-4e7e-a82d-e36d9529b0a2-kube-api-access-8p646\") pod \"perf-node-gather-daemonset-xcpdj\" (UID: \"97d11a94-85bf-4e7e-a82d-e36d9529b0a2\") " pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.832794 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.832769    2576 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:31.971477 ip-10-0-140-251 kubenswrapper[2576]: W0603 15:09:31.971442    2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod97d11a94_85bf_4e7e_a82d_e36d9529b0a2.slice/crio-b3b2f80adb7aea30df858aef1a7a24fa1fff8a027baef4caa3c71ab263729bda WatchSource:0}: Error finding container b3b2f80adb7aea30df858aef1a7a24fa1fff8a027baef4caa3c71ab263729bda: Status 404 returned error can't find the container with id b3b2f80adb7aea30df858aef1a7a24fa1fff8a027baef4caa3c71ab263729bda
Jun 03 15:09:31.971883 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.971732    2576 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"]
Jun 03 15:09:31.973202 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:31.973184    2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 03 15:09:32.043177 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:32.043119    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-tph4g_ec092399-223c-4db2-81db-9647b58ae114/volume-data-source-validator/0.log"
Jun 03 15:09:32.616641 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:32.616604    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj" event={"ID":"97d11a94-85bf-4e7e-a82d-e36d9529b0a2","Type":"ContainerStarted","Data":"ac74901ee54999d251e7de089b2aac33a37bb06ae7f1c0421b266ccf742e063f"}
Jun 03 15:09:32.616641 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:32.616642    2576 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj" event={"ID":"97d11a94-85bf-4e7e-a82d-e36d9529b0a2","Type":"ContainerStarted","Data":"b3b2f80adb7aea30df858aef1a7a24fa1fff8a027baef4caa3c71ab263729bda"}
Jun 03 15:09:32.616903 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:32.616668    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:32.636683 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:32.636632    2576 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj" podStartSLOduration=1.636600485 podStartE2EDuration="1.636600485s" podCreationTimestamp="2026-06-03 15:09:31 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-03 15:09:32.636556096 +0000 UTC m=+1448.153349155" watchObservedRunningTime="2026-06-03 15:09:32.636600485 +0000 UTC m=+1448.153393532"
Jun 03 15:09:33.017083 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:33.017047    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5f9m_54728720-211f-4a83-ab10-ba0fde28f34a/dns/0.log"
Jun 03 15:09:33.045555 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:33.045526    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-z5f9m_54728720-211f-4a83-ab10-ba0fde28f34a/kube-rbac-proxy/0.log"
Jun 03 15:09:33.189636 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:33.189604    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ppnw2_2f9e2c9c-9a4c-49f4-9e3e-c8d0e3e4e524/dns-node-resolver/0.log"
Jun 03 15:09:33.701194 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:33.701164    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-75f7c59bfb-6b5qh_f6016ff8-2d60-469e-b6b0-640da22361f6/registry/0.log"
Jun 03 15:09:33.766514 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:33.766481    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-5hlrw_d5aee60d-1fc5-49d9-b7e3-88955abb0a3f/node-ca/0.log"
Jun 03 15:09:34.697715 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:34.697681    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bvb2n6_4099e067-72af-45f7-9d3e-5e8544e85ece/istio-proxy/0.log"
Jun 03 15:09:34.915324 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:34.915284    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-lbtjm_0e0464e1-ffa0-4d76-b89c-32c2db266027/istio-proxy/0.log"
Jun 03 15:09:34.960527 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:34.960438    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-75d9d88b9-5v479_81052fef-a7b5-4e20-9634-f50fa99f9d90/payload-pre-processing/0.log"
Jun 03 15:09:34.991830 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:34.991798    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-82z2j_ecb1d338-96dc-47dc-843e-22cc7f8e2cde/payload-processing/0.log"
Jun 03 15:09:35.705746 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:35.705719    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mcckm_d40ccee8-3333-411b-8b01-2a2707cfa56f/serve-healthcheck-canary/0.log"
Jun 03 15:09:36.284962 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:36.284932    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-h54pq_7f1c41a6-0b05-4ad0-9346-1bfc1565901e/insights-operator/0.log"
Jun 03 15:09:36.285788 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:36.285766    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-788bf58df5-h54pq_7f1c41a6-0b05-4ad0-9346-1bfc1565901e/insights-operator/1.log"
Jun 03 15:09:36.499789 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:36.499757    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sv47q_43cc2ba3-2e08-4c3d-964b-db460ad9b027/kube-rbac-proxy/0.log"
Jun 03 15:09:36.523513 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:36.523491    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sv47q_43cc2ba3-2e08-4c3d-964b-db460ad9b027/exporter/0.log"
Jun 03 15:09:36.548605 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:36.548540    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-sv47q_43cc2ba3-2e08-4c3d-964b-db460ad9b027/extractor/0.log"
Jun 03 15:09:38.631630 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:38.631597    2576 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-9snz7/perf-node-gather-daemonset-xcpdj"
Jun 03 15:09:38.820860 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:38.820828    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-69b458fb86-fgvs9_02aea2bf-1bd5-45ef-a8d4-0ddb6e0cee39/nginx/0.log"
Jun 03 15:09:38.926253 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:38.926176    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-667b854b7d-hpnbp_d1af3c66-eff7-48b3-a516-40a9ee011697/maas-api/0.log"
Jun 03 15:09:38.962479 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:38.962447    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-59866c4bc4-lvg7r_27287247-d3fa-4249-bc86-5b690d44c85e/manager/0.log"
Jun 03 15:09:38.984156 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:38.984115    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-6577596cd5-4hvbw_990e0aef-5c27-4850-9fe2-1c5fd5fd7d55/server/0.log"
Jun 03 15:09:39.057118 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:39.057087    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp_9616cafb-339f-486f-8e04-a080f1f21f5e/manager/0.log"
Jun 03 15:09:39.079815 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:39.079790    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7bd9f95c7d-c6lqp_9616cafb-339f-486f-8e04-a080f1f21f5e/copy-manifests/0.log"
Jun 03 15:09:40.966256 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:40.966232    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5c7547bc79-shkf2_d324daf7-1db1-480f-acf9-34f664f7352b/manager/0.log"
Jun 03 15:09:47.302768 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:47.302742    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dq4s_42ce5c30-ac13-4c63-ad41-b67cac79c6bb/kube-multus-additional-cni-plugins/0.log"
Jun 03 15:09:47.328596 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:47.328568    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dq4s_42ce5c30-ac13-4c63-ad41-b67cac79c6bb/egress-router-binary-copy/0.log"
Jun 03 15:09:47.354286 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:47.354264    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dq4s_42ce5c30-ac13-4c63-ad41-b67cac79c6bb/cni-plugins/0.log"
Jun 03 15:09:47.377931 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:47.377906    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dq4s_42ce5c30-ac13-4c63-ad41-b67cac79c6bb/bond-cni-plugin/0.log"
Jun 03 15:09:47.404172 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:47.404148    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dq4s_42ce5c30-ac13-4c63-ad41-b67cac79c6bb/routeoverride-cni/0.log"
Jun 03 15:09:47.444290 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:47.444263    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dq4s_42ce5c30-ac13-4c63-ad41-b67cac79c6bb/whereabouts-cni-bincopy/0.log"
Jun 03 15:09:47.468960 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:47.468931    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-6dq4s_42ce5c30-ac13-4c63-ad41-b67cac79c6bb/whereabouts-cni/0.log"
Jun 03 15:09:48.003024 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:48.002992    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-q262g_d92e960e-554c-4498-85ae-aedaa0302260/kube-multus/0.log"
Jun 03 15:09:48.155342 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:48.155315    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbcfw_6c806192-8385-493c-acc6-b3dfa7ca4ef4/network-metrics-daemon/0.log"
Jun 03 15:09:48.180945 ip-10-0-140-251 kubenswrapper[2576]: I0603 15:09:48.180919    2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-fbcfw_6c806192-8385-493c-acc6-b3dfa7ca4ef4/kube-rbac-proxy/0.log"