Jun 01 21:39:14.776833 ip-10-0-134-181 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jun 01 21:39:14.776846 ip-10-0-134-181 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jun 01 21:39:14.776856 ip-10-0-134-181 systemd[1]: kubelet.service: Failed with result 'resources'.
Jun 01 21:39:14.777170 ip-10-0-134-181 systemd[1]: Failed to start Kubernetes Kubelet.
Jun 01 21:39:24.811290 ip-10-0-134-181 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jun 01 21:39:24.811305 ip-10-0-134-181 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot de5ea35faa7545abbc7703272ad76516 --
Jun 01 21:41:48.556787 ip-10-0-134-181 systemd[1]: Starting Kubernetes Kubelet...
Jun 01 21:41:49.071691 ip-10-0-134-181 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 01 21:41:49.071691 ip-10-0-134-181 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jun 01 21:41:49.071691 ip-10-0-134-181 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 01 21:41:49.071691 ip-10-0-134-181 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jun 01 21:41:49.071691 ip-10-0-134-181 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jun 01 21:41:49.074736 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.074598    2562 server.go:212] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jun 01 21:41:49.082859 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082834    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 01 21:41:49.082859 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082850    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 01 21:41:49.082859 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082856    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 01 21:41:49.082859 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082861    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 01 21:41:49.082859 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082865    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082870    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082874    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082879    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082883    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082888    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082892    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082906    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082911    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082915    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082919    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082923    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082927    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082932    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082936    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082940    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082945    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082952    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082958    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082963    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 01 21:41:49.083135 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082967    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082971    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082976    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082980    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082984    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082988    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082992    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.082996    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083001    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083005    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083009    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083013    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083017    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083021    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083027    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083032    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083036    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083041    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083047    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083052    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 01 21:41:49.083966 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083055    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083059    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083063    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083068    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083074    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083079    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083084    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083088    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083092    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083096    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083101    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083105    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083109    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083113    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083117    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083121    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083125    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083129    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083133    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 01 21:41:49.084651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083137    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083142    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083146    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083151    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083155    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083159    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083164    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083171    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083175    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083179    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083183    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083187    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083192    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083196    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083200    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083204    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083208    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083213    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083217    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 01 21:41:49.085131 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083221    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083224    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083228    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083232    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083838    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083846    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083850    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083855    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083859    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083865    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083871    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083875    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083879    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083883    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083887    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083891    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083897    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083901    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083905    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 01 21:41:49.085640 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083909    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083916    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083920    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083924    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083928    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083933    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083937    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083941    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083945    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083949    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083953    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083957    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083961    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083965    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083969    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083973    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083977    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083981    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083985    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083989    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 01 21:41:49.086321 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083993    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.083997    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084001    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084005    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084009    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084013    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084020    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084026    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084030    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084036    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084066    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084073    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084078    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084084    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084089    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084093    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084098    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084102    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084106    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084110    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 01 21:41:49.087212 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084114    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084118    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084122    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084127    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084130    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084143    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084147    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084151    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084155    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084159    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084163    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084168    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084172    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084177    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084181    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084185    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084189    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084194    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084198    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 01 21:41:49.087755 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084201    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084205    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084209    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084213    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084221    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084225    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084229    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084233    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084238    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084241    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084245    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.084249    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085834    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085851    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085862    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085869    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085876    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085881    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085888    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085894    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085900    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jun 01 21:41:49.088265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085904    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085910    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085916    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085921    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085926    2562 flags.go:64] FLAG: --cgroup-root=""
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085930    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085935    2562 flags.go:64] FLAG: --client-ca-file=""
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085940    2562 flags.go:64] FLAG: --cloud-config=""
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085945    2562 flags.go:64] FLAG: --cloud-provider="external"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085950    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085956    2562 flags.go:64] FLAG: --cluster-domain=""
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085961    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085966    2562 flags.go:64] FLAG: --config-dir=""
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085970    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085976    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085982    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.085993    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086000    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086006    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086011    2562 flags.go:64] FLAG: --contention-profiling="false"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086016    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086021    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086026    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086030    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086038    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jun 01 21:41:49.088836 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086042    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086047    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086052    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086057    2562 flags.go:64] FLAG: --enable-server="true"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086061    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086068    2562 flags.go:64] FLAG: --event-burst="100"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086073    2562 flags.go:64] FLAG: --event-qps="50"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086078    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086083    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086088    2562 flags.go:64] FLAG: --eviction-hard=""
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086094    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086099    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086104    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086108    2562 flags.go:64] FLAG: --eviction-soft=""
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086113    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086118    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086123    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086129    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086133    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086138    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086147    2562 flags.go:64] FLAG: --feature-gates=""
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086154    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086158    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086163    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086169    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086174    2562 flags.go:64] FLAG: --healthz-port="10248"
Jun 01 21:41:49.089751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086179    2562 flags.go:64] FLAG: --help="false"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086184    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086189    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086194    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086199    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086204    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086210    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086215    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086220    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086224    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086229    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086234    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086239    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086243    2562 flags.go:64] FLAG: --kube-reserved=""
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086248    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086253    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086258    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086263    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086268    2562 flags.go:64] FLAG: --lock-file=""
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086272    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086277    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086282    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086291    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jun 01 21:41:49.090383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086296    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086301    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086305    2562 flags.go:64] FLAG: --logging-format="text"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086312    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086317    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086322    2562 flags.go:64] FLAG: --manifest-url=""
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086326    2562 flags.go:64] FLAG: --manifest-url-header=""
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086333    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086338    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086345    2562 flags.go:64] FLAG: --max-pods="110"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086350    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086355    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086360    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086365    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086370    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086375    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086380    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086391    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086396    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086401    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086426    2562 flags.go:64] FLAG: --pod-cidr=""
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086430    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:f1083dc6abd9805f79797fa11c9accacc4a38caa073c94cb99097faffce05983"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086439    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086444    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jun 01 21:41:49.091039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086449    2562 flags.go:64] FLAG: --pods-per-core="0"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086453    2562 flags.go:64] FLAG: --port="10250"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086458    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086463    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0bc51f2d77bd13e5f"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086468    2562 flags.go:64] FLAG: --qos-reserved=""
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086473    2562 flags.go:64] FLAG: --read-only-port="10255"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086478    2562 flags.go:64] FLAG: --register-node="true"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086483    2562 flags.go:64] FLAG: --register-schedulable="true"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086487    2562 flags.go:64] FLAG: --register-with-taints=""
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086493    2562 flags.go:64] FLAG: --registry-burst="10"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086498    2562 flags.go:64] FLAG: --registry-qps="5"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086503    2562 flags.go:64] FLAG: --reserved-cpus=""
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086509    2562 flags.go:64] FLAG: --reserved-memory=""
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086515    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086519    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086524    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086529    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086535    2562 flags.go:64] FLAG: --runonce="false"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086540    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086545    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086550    2562 flags.go:64] FLAG: --seccomp-default="false"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086554    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086559    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086564    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086569    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086574    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jun 01 21:41:49.091689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086579    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086584    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086589    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086594    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086599    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086603    2562 flags.go:64] FLAG: --system-cgroups=""
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086608    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086617    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086622    2562 flags.go:64] FLAG: --tls-cert-file=""
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086627    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086633    2562 flags.go:64] FLAG: --tls-min-version=""
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086638    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086642    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086647    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086651    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086656    2562 flags.go:64] FLAG: --v="2"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086663    2562 flags.go:64] FLAG: --version="false"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086670    2562 flags.go:64] FLAG: --vmodule=""
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086678    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.086683    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086842    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086848    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086853    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086858    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 01 21:41:49.092310 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086864    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086868    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086873    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086877    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086883    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086887    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086892    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086896    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086901    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086905    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086909    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086912    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086916    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086921    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086934    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086939    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086943    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086947    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086951    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086955    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 01 21:41:49.092898 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086962    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086967    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086972    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086977    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086981    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086986    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086992    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.086997    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087001    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087005    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087010    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087014    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087018    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087023    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087028    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087032    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087039    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087043    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087047    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087052    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 01 21:41:49.093395 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087056    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087060    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087064    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087068    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087072    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087077    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087081    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087085    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087089    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087094    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087098    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087102    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087106    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087110    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087114    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087118    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087122    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087125    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087131    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087136    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 01 21:41:49.093944 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087140    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087144    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087148    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087152    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087156    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087160    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087169    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087174    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087180    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087184    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087188    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087192    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087197    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087201    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087205    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087209    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087212    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087216    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087220    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 01 21:41:49.094507 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087224    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 01 21:41:49.094981 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087230    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 01 21:41:49.094981 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.087235    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 01 21:41:49.094981 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.088162    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 01 21:41:49.095637 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.095616    2562 server.go:530] "Kubelet version" kubeletVersion="v1.33.12"
Jun 01 21:41:49.095673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.095638    2562 server.go:532] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jun 01 21:41:49.095703 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095691    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 01 21:41:49.095703 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095696    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 01 21:41:49.095703 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095700    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 01 21:41:49.095703 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095703    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095706    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095709    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095712    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095715    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095718    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095720    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095723    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095726    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095729    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095731    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095734    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095736    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095739    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095742    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095744    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095747    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095750    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095752    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095755    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 01 21:41:49.095807 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095757    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095759    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095762    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095766    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095771    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095773    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095776    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095779    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095788    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095791    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095794    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095796    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095798    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095801    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095805    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095807    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095810    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095813    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095816    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 01 21:41:49.096309 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095818    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095821    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095824    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095826    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095829    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095831    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095834    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095836    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095839    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095841    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095844    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095846    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095849    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095851    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095854    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095856    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095859    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095861    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095869    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095872    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 01 21:41:49.096785 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095875    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095877    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095885    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095888    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095890    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095893    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095895    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095899    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095901    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095904    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095907    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095909    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095912    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095914    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095917    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095919    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095922    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095924    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095928    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 01 21:41:49.097292 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095932    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095935    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095938    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095940    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.095943    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.095948    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096083    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096088    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096091    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096094    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096097    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096100    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096102    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096105    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096108    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096110    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jun 01 21:41:49.097821 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096118    2562 feature_gate.go:328] unrecognized feature gate: Example
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096121    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096125    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096136    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096141    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096145    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096148    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096151    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096154    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096157    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096160    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096162    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096165    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096168    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096171    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096173    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096176    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096178    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096180    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jun 01 21:41:49.098254 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096183    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096185    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096188    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096191    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096193    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096196    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096198    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096201    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096204    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096207    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096210    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096213    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096216    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096218    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096227    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterOperations
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096229    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096232    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096235    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096237    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jun 01 21:41:49.098739 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096240    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096242    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096245    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096247    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096250    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096252    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096254    2562 feature_gate.go:328] unrecognized feature gate: SetEIPForNLBIngressController
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096257    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096259    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096262    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096264    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096267    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096269    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096272    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096274    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096277    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096279    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096282    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096284    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096287    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jun 01 21:41:49.099232 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096289    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096292    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096295    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096297    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096300    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096302    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096304    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096307    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096315    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfigAPI
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096318    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096321    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096324    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096326    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096329    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096331    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096334    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerLBSubnetsAWS
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096336    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jun 01 21:41:49.099744 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:49.096338    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jun 01 21:41:49.100162 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.096343    2562 feature_gate.go:384] feature gates: {map[DynamicResourceAllocation:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutatingAdmissionPolicy:false NodeSwap:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:false]}
Jun 01 21:41:49.100162 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.097219    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jun 01 21:41:49.100162 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.099594    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jun 01 21:41:49.100682 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.100670    2562 server.go:1019] "Starting client certificate rotation"
Jun 01 21:41:49.100784 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.100767    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 01 21:41:49.100814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.100799    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jun 01 21:41:49.128287 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.128273    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 01 21:41:49.129674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.129659    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jun 01 21:41:49.148392 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.148372    2562 log.go:25] "Validated CRI v1 runtime API"
Jun 01 21:41:49.155436 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.155421    2562 log.go:25] "Validated CRI v1 image API"
Jun 01 21:41:49.156786 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.156770    2562 server.go:1452] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jun 01 21:41:49.160394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.160379    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 01 21:41:49.164434 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.164391    2562 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 7d344304-a9f6-4d8f-8c54-87ca30aa106a:/dev/nvme0n1p4 a04d3427-041d-4b0c-adc1-155202521963:/dev/nvme0n1p3]
Jun 01 21:41:49.164480 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.164435    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jun 01 21:41:49.168903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.168806    2562 manager.go:217] Machine: {Timestamp:2026-06-01 21:41:49.168295916 +0000 UTC m=+0.474735171 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3096875 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec228d0aee6e462cc9a45602add9c134 SystemUUID:ec228d0a-ee6e-462c-c9a4-5602add9c134 BootID:de5ea35f-aa75-45ab-bc77-03272ad76516 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6103040 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e6:c7:8e:90:79 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e6:c7:8e:90:79 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:e7:8d:4d:9f:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jun 01 21:41:49.169698 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.169688    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jun 01 21:41:49.169883 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.169768    2562 manager.go:233] Version: {KernelVersion:5.14.0-570.117.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260521-1 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jun 01 21:41:49.171133 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.171102    2562 container_manager_linux.go:270] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jun 01 21:41:49.171318 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.171139    2562 container_manager_linux.go:275] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-134-181.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jun 01 21:41:49.171363 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.171333    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jun 01 21:41:49.171363 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.171347    2562 container_manager_linux.go:306] "Creating device plugin manager"
Jun 01 21:41:49.171363 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.171359    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 01 21:41:49.172643 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.172349    2562 server.go:72] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jun 01 21:41:49.173701 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.173688    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 01 21:41:49.173817 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.173808    2562 server.go:1267] "Using root directory" path="/var/lib/kubelet"
Jun 01 21:41:49.176644 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.176634    2562 kubelet.go:491] "Attempting to sync node with API server"
Jun 01 21:41:49.176677 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.176653    2562 kubelet.go:386] "Adding static pod path" path="/etc/kubernetes/manifests"
Jun 01 21:41:49.176677 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.176665    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jun 01 21:41:49.176677 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.176675    2562 kubelet.go:397] "Adding apiserver pod source"
Jun 01 21:41:49.176786 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.176685    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jun 01 21:41:49.177920 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.177909    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 01 21:41:49.177968 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.177928    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jun 01 21:41:49.180184 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.180167    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hw5s6"
Jun 01 21:41:49.181395 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.181381    2562 kuberuntime_manager.go:279] "Container runtime initialized" containerRuntime="cri-o" version="1.33.12-3.rhaos4.20.git64c6a00.el9" apiVersion="v1"
Jun 01 21:41:49.183646 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.183633    2562 kubelet.go:953] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jun 01 21:41:49.186616 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186603    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186620    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186627    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186634    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186642    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186649    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186655    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186660    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186667    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jun 01 21:41:49.186674 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186673    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jun 01 21:41:49.186913 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186689    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jun 01 21:41:49.186913 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.186695    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jun 01 21:41:49.187763 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.187754    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jun 01 21:41:49.187763 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.187764    2562 plugins.go:616] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jun 01 21:41:49.188076 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.188049    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-hw5s6"
Jun 01 21:41:49.191367 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.191339    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-134-181.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jun 01 21:41:49.191494 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.191465    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jun 01 21:41:49.192951 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.192935    2562 watchdog_linux.go:99] "Systemd watchdog is not enabled"
Jun 01 21:41:49.193004 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.192981    2562 server.go:1295] "Started kubelet"
Jun 01 21:41:49.193077 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.193048    2562 ratelimit.go:55] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jun 01 21:41:49.193126 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.193061    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jun 01 21:41:49.193126 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.193103    2562 server_v1.go:47] "podresources" method="list" useActivePods=true
Jun 01 21:41:49.193637 ip-10-0-134-181 systemd[1]: Started Kubernetes Kubelet.
Jun 01 21:41:49.194542 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.194526    2562 server.go:255] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jun 01 21:41:49.195994 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.195978    2562 server.go:317] "Adding debug handlers to kubelet server"
Jun 01 21:41:49.201613 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.201594    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jun 01 21:41:49.202175 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.202160    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jun 01 21:41:49.202423 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.202391    2562 volume_manager.go:295] "The desired_state_of_world populator starts"
Jun 01 21:41:49.202521 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.202511    2562 volume_manager.go:297] "Starting Kubelet Volume Manager"
Jun 01 21:41:49.202658 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.202642    2562 desired_state_of_world_populator.go:150] "Desired state populator starts to run"
Jun 01 21:41:49.202722 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.202709    2562 reconstruct.go:97] "Volume reconstruction finished"
Jun 01 21:41:49.202722 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.202717    2562 reconciler.go:26] "Reconciler: start to sync state"
Jun 01 21:41:49.203646 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.203619    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.205144 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205125    2562 factory.go:153] Registering CRI-O factory
Jun 01 21:41:49.205228 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205148    2562 factory.go:223] Registration of the crio container factory successfully
Jun 01 21:41:49.205228 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205203    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jun 01 21:41:49.205228 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205212    2562 factory.go:55] Registering systemd factory
Jun 01 21:41:49.205228 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205219    2562 factory.go:223] Registration of the systemd container factory successfully
Jun 01 21:41:49.205386 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205244    2562 factory.go:103] Registering Raw factory
Jun 01 21:41:49.205386 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205258    2562 manager.go:1196] Started watching for new ooms in manager
Jun 01 21:41:49.205563 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205550    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 01 21:41:49.205671 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.205603    2562 manager.go:319] Starting recovery of all containers
Jun 01 21:41:49.206114 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.206080    2562 kubelet.go:1618] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jun 01 21:41:49.208266 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.208233    2562 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-134-181.ec2.internal\" not found" node="ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.208344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.208281    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-181.ec2.internal" not found
Jun 01 21:41:49.215629 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.215613    2562 manager.go:324] Recovery completed
Jun 01 21:41:49.221139 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.221124    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 01 21:41:49.223159 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.223144    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientMemory"
Jun 01 21:41:49.223236 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.223169    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasNoDiskPressure"
Jun 01 21:41:49.223236 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.223182    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientPID"
Jun 01 21:41:49.223623 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.223610    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jun 01 21:41:49.223623 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.223619    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jun 01 21:41:49.223717 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.223636    2562 state_mem.go:36] "Initialized new in-memory state store"
Jun 01 21:41:49.224776 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.224761    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-181.ec2.internal" not found
Jun 01 21:41:49.227644 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.227630    2562 policy_none.go:49] "None policy: Start"
Jun 01 21:41:49.227644 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.227646    2562 memory_manager.go:186] "Starting memorymanager" policy="None"
Jun 01 21:41:49.227736 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.227656    2562 state_mem.go:35] "Initializing new in-memory state store"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.270745    2562 manager.go:341] "Starting Device Plugin manager"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.270834    2562 manager.go:517] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.270848    2562 server.go:85] "Starting device plugin registration server"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.271113    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.271125    2562 container_log_manager.go:189] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.271223    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.271307    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.271316    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.271741    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jun 01 21:41:49.273621 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.271781    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.281594 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.281576    2562 nodeinfomanager.go:417] Failed to publish CSINode: nodes "ip-10-0-134-181.ec2.internal" not found
Jun 01 21:41:49.300331 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.300299    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv4"
Jun 01 21:41:49.301481 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.301462    2562 kubelet_network_linux.go:49] "Initialized iptables rules." protocol="IPv6"
Jun 01 21:41:49.301577 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.301489    2562 status_manager.go:230] "Starting to sync pod status with apiserver"
Jun 01 21:41:49.301577 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.301506    2562 watchdog_linux.go:127] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jun 01 21:41:49.301577 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.301512    2562 kubelet.go:2451] "Starting kubelet main sync loop"
Jun 01 21:41:49.301577 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.301547    2562 kubelet.go:2475] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jun 01 21:41:49.303580 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.303561    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 01 21:41:49.371349 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.371274    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 01 21:41:49.372210 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.372191    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientMemory"
Jun 01 21:41:49.372305 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.372222    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasNoDiskPressure"
Jun 01 21:41:49.372305 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.372237    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientPID"
Jun 01 21:41:49.372305 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.372267    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.380474 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.380453    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.380577 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.380480    2562 kubelet_node_status.go:597] "Error updating node status, will retry" err="error getting node \"ip-10-0-134-181.ec2.internal\": node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.397806 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.397783    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.401865 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.401848    2562 kubelet.go:2537] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal"]
Jun 01 21:41:49.401934 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.401922    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 01 21:41:49.403112 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.403096    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4dc87949f8a9c885caf7a824abecf768-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal\" (UID: \"4dc87949f8a9c885caf7a824abecf768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.403184 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.403119    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dc87949f8a9c885caf7a824abecf768-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal\" (UID: \"4dc87949f8a9c885caf7a824abecf768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.403902 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.403886    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientMemory"
Jun 01 21:41:49.403972 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.403914    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasNoDiskPressure"
Jun 01 21:41:49.403972 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.403932    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientPID"
Jun 01 21:41:49.405098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405086    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 01 21:41:49.405234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405219    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.405285 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405249    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 01 21:41:49.405848 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405832    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientMemory"
Jun 01 21:41:49.405940 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405858    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasNoDiskPressure"
Jun 01 21:41:49.405940 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405873    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientPID"
Jun 01 21:41:49.405940 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405834    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientMemory"
Jun 01 21:41:49.405940 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405935    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasNoDiskPressure"
Jun 01 21:41:49.406082 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.405947    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientPID"
Jun 01 21:41:49.407066 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.407054    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.407123 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.407078    2562 kubelet_node_status.go:413] "Setting node annotation to enable volume controller attach/detach"
Jun 01 21:41:49.407773 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.407752    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientMemory"
Jun 01 21:41:49.407773 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.407775    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasNoDiskPressure"
Jun 01 21:41:49.407901 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.407787    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeHasSufficientPID"
Jun 01 21:41:49.427036 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.427019    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-181.ec2.internal\" not found" node="ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.431254 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.431240    2562 kubelet.go:3336] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-134-181.ec2.internal\" not found" node="ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.498243 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.498220    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.503456 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.503439    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4dc87949f8a9c885caf7a824abecf768-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal\" (UID: \"4dc87949f8a9c885caf7a824abecf768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.503522 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.503464    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4dc87949f8a9c885caf7a824abecf768-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal\" (UID: \"4dc87949f8a9c885caf7a824abecf768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.503522 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.503470    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dc87949f8a9c885caf7a824abecf768-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal\" (UID: \"4dc87949f8a9c885caf7a824abecf768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.503522 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.503508    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4dc87949f8a9c885caf7a824abecf768-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal\" (UID: \"4dc87949f8a9c885caf7a824abecf768\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.598486 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.598460    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.603656 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.603641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6401c04a440f4f89d2d403cc6c765190-config\") pod \"kube-apiserver-proxy-ip-10-0-134-181.ec2.internal\" (UID: \"6401c04a440f4f89d2d403cc6c765190\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.699048 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.698992    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.704276 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.704254    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6401c04a440f4f89d2d403cc6c765190-config\") pod \"kube-apiserver-proxy-ip-10-0-134-181.ec2.internal\" (UID: \"6401c04a440f4f89d2d403cc6c765190\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.704327 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.704308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/6401c04a440f4f89d2d403cc6c765190-config\") pod \"kube-apiserver-proxy-ip-10-0-134-181.ec2.internal\" (UID: \"6401c04a440f4f89d2d403cc6c765190\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.729378 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.729357    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.735164 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:49.735149    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:49.800018 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.799994    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:49.900446 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:49.900426    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.000916 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.000866    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.100369 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.100340    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jun 01 21:41:50.100962 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.100489    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 01 21:41:50.100962 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.100504    2562 reflector.go:556] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jun 01 21:41:50.101446 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.101422    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.192308 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.192255    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-05-31 21:36:49 +0000 UTC" deadline="2027-12-21 09:21:48.24612633 +0000 UTC"
Jun 01 21:41:50.192308 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.192301    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13619h39m58.053828166s"
Jun 01 21:41:50.202415 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.202382    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jun 01 21:41:50.202472 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.202415    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.221910 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.221884    2562 reflector.go:430] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jun 01 21:41:50.242731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.242710    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-d6lw2"
Jun 01 21:41:50.250299 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.250278    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-d6lw2"
Jun 01 21:41:50.264570 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.264555    2562 reflector.go:430] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 01 21:41:50.302865 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.302832    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.400186 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:50.400139    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6401c04a440f4f89d2d403cc6c765190.slice/crio-912a4e4bcc04e5f41d030be5394ed20644fd76dee38ea797eeba8fd530a1fd59 WatchSource:0}: Error finding container 912a4e4bcc04e5f41d030be5394ed20644fd76dee38ea797eeba8fd530a1fd59: Status 404 returned error can't find the container with id 912a4e4bcc04e5f41d030be5394ed20644fd76dee38ea797eeba8fd530a1fd59
Jun 01 21:41:50.400466 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:50.400446    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dc87949f8a9c885caf7a824abecf768.slice/crio-b300b1ef903b1f2afefeda0ca8fbad1ed893c6701d372a2851407962f5c7a84c WatchSource:0}: Error finding container b300b1ef903b1f2afefeda0ca8fbad1ed893c6701d372a2851407962f5c7a84c: Status 404 returned error can't find the container with id b300b1ef903b1f2afefeda0ca8fbad1ed893c6701d372a2851407962f5c7a84c
Jun 01 21:41:50.403691 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.403665    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.404875 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.404851    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 01 21:41:50.503961 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.503928    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.604394 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.604333    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.705026 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:50.704994    2562 kubelet_node_status.go:515] "Error getting the current node from lister" err="node \"ip-10-0-134-181.ec2.internal\" not found"
Jun 01 21:41:50.738700 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.738679    2562 reflector.go:430] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 01 21:41:50.803566 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.803546    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:50.814021 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.814001    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 01 21:41:50.815200 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.815184    2562 kubelet.go:3340] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal"
Jun 01 21:41:50.826132 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:50.826109    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jun 01 21:41:51.147542 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.147512    2562 reflector.go:430] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 01 21:41:51.177685 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.177651    2562 apiserver.go:52] "Watching apiserver"
Jun 01 21:41:51.188312 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.188288    2562 reflector.go:430] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jun 01 21:41:51.189656 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.189623    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal","openshift-dns/node-resolver-fdt8z","openshift-image-registry/node-ca-2fq6l","openshift-multus/multus-8gtd5","openshift-multus/network-metrics-daemon-nc7qb","openshift-network-diagnostics/network-check-target-2f284","openshift-network-operator/iptables-alerter-65792","kube-system/konnectivity-agent-qm4bj","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm","openshift-cluster-node-tuning-operator/tuned-n6c5z","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal","openshift-multus/multus-additional-cni-plugins-56cnv","openshift-ovn-kubernetes/ovnkube-node-cbn52"]
Jun 01 21:41:51.194183 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.194162    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.196255 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.196235    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.196852 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.196833    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jun 01 21:41:51.196968 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.196945    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jun 01 21:41:51.197026 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.197019    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-2rk7v\""
Jun 01 21:41:51.197097 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.196837    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jun 01 21:41:51.198387 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.198185    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jun 01 21:41:51.198387 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.198356    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.198553 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.198483    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jun 01 21:41:51.198807 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.198786    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-p8hrv\""
Jun 01 21:41:51.200550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.200376    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jun 01 21:41:51.200764 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.200748    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jun 01 21:41:51.200840 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.200752    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kzlsv\""
Jun 01 21:41:51.201073 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.200908    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jun 01 21:41:51.201073 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.200995    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jun 01 21:41:51.201430 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.201398    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.203442 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.203423    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jun 01 21:41:51.203654 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.203636    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:51.203738 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.203704    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:41:51.203738 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.203734    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jun 01 21:41:51.204223 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.204054    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-sxqgv\""
Jun 01 21:41:51.204223 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.204139    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jun 01 21:41:51.206029 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.206011    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:51.206127 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.206077    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:41:51.208265 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.208238    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.210710 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.210690    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.211042 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.211018    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jun 01 21:41:51.211133 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.211082    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jun 01 21:41:51.211627 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.211611    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-knjbp\""
Jun 01 21:41:51.212100 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212078    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-kubelet\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212164 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:51.212164 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lfgfk\" (UniqueName: \"kubernetes.io/projected/3458e253-32bd-4931-8ca1-73f8c439709d-kube-api-access-lfgfk\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.212268 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212162    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-cni-bin\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212268 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-daemon-config\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212268 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212212    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-host\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.212268 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212243    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-cnibin\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212489 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212290    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-cni-binary-copy\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212489 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212313    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-hostroot\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212489 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-k8s-cni-cncf-io\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212489 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212364    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-multus-certs\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212489 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212388    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qbp2t\" (UniqueName: \"kubernetes.io/projected/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-kube-api-access-qbp2t\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.212489 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212429    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-system-cni-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212489 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhrqw\" (UniqueName: \"kubernetes.io/projected/764970ef-ec62-4e03-a3a6-e5c3382b1d91-kube-api-access-zhrqw\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:51.212980 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212497    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-cni-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212980 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-netns\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212980 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212550    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-cni-multus\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.212980 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:51.212980 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.212731    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jun 01 21:41:51.213219 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-serviceca\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.213219 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213115    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-conf-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.213219 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sd594\" (UniqueName: \"kubernetes.io/projected/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-kube-api-access-sd594\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.213219 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea91858-06b1-4def-baf4-504ef8ed92f9-tmp-dir\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.213219 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx6cn\" (UniqueName: \"kubernetes.io/projected/9ea91858-06b1-4def-baf4-504ef8ed92f9-kube-api-access-bx6cn\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213230    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-etc-kubernetes\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213249    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213254    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3458e253-32bd-4931-8ca1-73f8c439709d-iptables-alerter-script\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213284    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-x8v9k\""
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213294    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3458e253-32bd-4931-8ca1-73f8c439709d-host-slash\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213318    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea91858-06b1-4def-baf4-504ef8ed92f9-hosts-file\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213340    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-os-release\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.213464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-socket-dir-parent\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.213838 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.213552    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jun 01 21:41:51.214751 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.214099    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.216286 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.216267    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jun 01 21:41:51.216427 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.216386    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j72rf\""
Jun 01 21:41:51.216427 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.216399    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jun 01 21:41:51.216814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.216794    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.216895 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.216818    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.219423 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.219387    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jun 01 21:41:51.220211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.220079    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-vfn77\""
Jun 01 21:41:51.220435 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.220399    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jun 01 21:41:51.220722 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.220702    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jun 01 21:41:51.220993 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.220978    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jun 01 21:41:51.221289 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.221270    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xj59c\""
Jun 01 21:41:51.221556 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.221536    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jun 01 21:41:51.221809 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.221788    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jun 01 21:41:51.221882 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.221862    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jun 01 21:41:51.222323 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.222308    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jun 01 21:41:51.251511 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.251482    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-31 21:36:50 +0000 UTC" deadline="2028-02-22 11:53:54.74425307 +0000 UTC"
Jun 01 21:41:51.251511 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.251510    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15134h12m3.492746672s"
Jun 01 21:41:51.288458 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.288435    2562 reflector.go:430] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jun 01 21:41:51.303635 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.303617    2562 desired_state_of_world_populator.go:158] "Finished populating initial desired state of world"
Jun 01 21:41:51.305558 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.305515    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal" event={"ID":"6401c04a440f4f89d2d403cc6c765190","Type":"ContainerStarted","Data":"912a4e4bcc04e5f41d030be5394ed20644fd76dee38ea797eeba8fd530a1fd59"}
Jun 01 21:41:51.306553 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.306535    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal" event={"ID":"4dc87949f8a9c885caf7a824abecf768","Type":"ContainerStarted","Data":"b300b1ef903b1f2afefeda0ca8fbad1ed893c6701d372a2851407962f5c7a84c"}
Jun 01 21:41:51.313603 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313580    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-multus-certs\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.313696 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313618    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qbp2t\" (UniqueName: \"kubernetes.io/projected/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-kube-api-access-qbp2t\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.313696 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kpnjw\" (UniqueName: \"kubernetes.io/projected/ca587687-8789-4585-862d-d9ffe57c9023-kube-api-access-kpnjw\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.313696 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovnkube-config\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.313696 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-multus-certs\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.313889 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313704    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98rk4\" (UniqueName: \"kubernetes.io/projected/3f200d20-7476-4a36-9dbe-e027c51d9811-kube-api-access-98rk4\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.313889 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-var-lib-kubelet\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.313889 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-etc-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.313889 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313856    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-cni-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313889    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-netns\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313916    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-cnibin\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313953    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-run-netns\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313963    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-netns\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.313984    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314020    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-serviceca\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314026    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-cni-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314046    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-system-cni-dir\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.314125 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-node-log\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314133    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314184    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-sys\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314204    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-host\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314226    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea91858-06b1-4def-baf4-504ef8ed92f9-tmp-dir\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314250    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-env-overrides\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314311    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqt7n\" (UniqueName: \"kubernetes.io/projected/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-kube-api-access-nqt7n\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314338    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-etc-kubernetes\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314363    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea91858-06b1-4def-baf4-504ef8ed92f9-hosts-file\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314424    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-socket-dir-parent\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314435    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/9ea91858-06b1-4def-baf4-504ef8ed92f9-hosts-file\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314460    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-kubelet\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.314541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314518    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-socket-dir-parent\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314549    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-serviceca\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314556    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-etc-kubernetes\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314590    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314628    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-kubelet\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314671    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-var-lib-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.314748    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314754    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ea91858-06b1-4def-baf4-504ef8ed92f9-tmp-dir\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314775    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxbn\" (UniqueName: \"kubernetes.io/projected/739a841c-3f77-4217-b400-80ef7ed39f53-kube-api-access-mfxbn\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.314821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysctl-conf\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.314960    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:41:51.814808406 +0000 UTC m=+3.121247649 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315028    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-host\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.315069 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315056    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-cnibin\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315079    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-hostroot\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315105    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315132    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-host\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315146    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-device-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315180    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-hostroot\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315194    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-systemd\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315221    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-k8s-cni-cncf-io\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-cnibin\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315245    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-modprobe-d\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315280    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-system-cni-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315308    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-run-k8s-cni-cncf-io\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315355    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-zhrqw\" (UniqueName: \"kubernetes.io/projected/764970ef-ec62-4e03-a3a6-e5c3382b1d91-kube-api-access-zhrqw\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315449    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-kubernetes\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315477    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-cni-multus\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315511    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:51.315608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315538    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysconfig\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315593    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-system-cni-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-run\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315653    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-conf-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315691    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-sd594\" (UniqueName: \"kubernetes.io/projected/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-kube-api-access-sd594\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315718    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-os-release\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315744    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-cni-multus\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovnkube-script-lib\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315895    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-socket-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/739a841c-3f77-4217-b400-80ef7ed39f53-tmp\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315967    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bx6cn\" (UniqueName: \"kubernetes.io/projected/9ea91858-06b1-4def-baf4-504ef8ed92f9-kube-api-access-bx6cn\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.315994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3123e555-e462-42c0-8c96-96f4f5fd50b9-konnectivity-ca\") pod \"konnectivity-agent-qm4bj\" (UID: \"3123e555-e462-42c0-8c96-96f4f5fd50b9\") " pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316001    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-conf-dir\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-cni-binary-copy\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316074    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-cni-netd\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.316302 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316099    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/739a841c-3f77-4217-b400-80ef7ed39f53-etc-tuned\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316142    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3458e253-32bd-4931-8ca1-73f8c439709d-iptables-alerter-script\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316170    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3458e253-32bd-4931-8ca1-73f8c439709d-host-slash\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316237    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-os-release\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316255    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3458e253-32bd-4931-8ca1-73f8c439709d-host-slash\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316271    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316308    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-slash\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316335    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-os-release\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316342    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-systemd\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316373    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-lib-modules\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316392    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-lfgfk\" (UniqueName: \"kubernetes.io/projected/3458e253-32bd-4931-8ca1-73f8c439709d-kube-api-access-lfgfk\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316448    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-cni-bin\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316478    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-daemon-config\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316506    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-kubelet\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-host-var-lib-cni-bin\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316531    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-systemd-units\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316590    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-ovn\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317074 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316661    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-log-socket\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovn-node-metrics-cert\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316740    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-cni-binary-copy\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316750    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/3458e253-32bd-4931-8ca1-73f8c439709d-iptables-alerter-script\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316806    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3123e555-e462-42c0-8c96-96f4f5fd50b9-agent-certs\") pod \"konnectivity-agent-qm4bj\" (UID: \"3123e555-e462-42c0-8c96-96f4f5fd50b9\") " pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-registration-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-sys-fs\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysctl-d\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.316943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-cni-bin\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.317062    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-multus-daemon-config\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.317667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.317116    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-cni-binary-copy\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.319603 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.319583    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jun 01 21:41:51.321927 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.321710    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 01 21:41:51.321927 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.321927    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 01 21:41:51.322088 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.321941    2562 projected.go:194] Error preparing data for projected volume kube-api-access-bsn9v for pod openshift-network-diagnostics/network-check-target-2f284: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:51.322088 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.322023    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v podName:7251e65b-b26e-47de-b8a7-c043aeb3b26f nodeName:}" failed. No retries permitted until 2026-06-01 21:41:51.822005448 +0000 UTC m=+3.128444703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-bsn9v" (UniqueName: "kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v") pod "network-check-target-2f284" (UID: "7251e65b-b26e-47de-b8a7-c043aeb3b26f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:51.323131 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.323111    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qbp2t\" (UniqueName: \"kubernetes.io/projected/011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd-kube-api-access-qbp2t\") pod \"node-ca-2fq6l\" (UID: \"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd\") " pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.324768 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.324747    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx6cn\" (UniqueName: \"kubernetes.io/projected/9ea91858-06b1-4def-baf4-504ef8ed92f9-kube-api-access-bx6cn\") pod \"node-resolver-fdt8z\" (UID: \"9ea91858-06b1-4def-baf4-504ef8ed92f9\") " pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.325387 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.325365    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sd594\" (UniqueName: \"kubernetes.io/projected/93fd91fe-2457-4345-8ad2-ecd5bbb800ea-kube-api-access-sd594\") pod \"multus-8gtd5\" (UID: \"93fd91fe-2457-4345-8ad2-ecd5bbb800ea\") " pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.325702 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.325664    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lfgfk\" (UniqueName: \"kubernetes.io/projected/3458e253-32bd-4931-8ca1-73f8c439709d-kube-api-access-lfgfk\") pod \"iptables-alerter-65792\" (UID: \"3458e253-32bd-4931-8ca1-73f8c439709d\") " pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.326017 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.325978    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhrqw\" (UniqueName: \"kubernetes.io/projected/764970ef-ec62-4e03-a3a6-e5c3382b1d91-kube-api-access-zhrqw\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:51.417607 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417527    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kpnjw\" (UniqueName: \"kubernetes.io/projected/ca587687-8789-4585-862d-d9ffe57c9023-kube-api-access-kpnjw\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.417607 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417569    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovnkube-config\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.417607 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417597    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-98rk4\" (UniqueName: \"kubernetes.io/projected/3f200d20-7476-4a36-9dbe-e027c51d9811-kube-api-access-98rk4\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417620    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-var-lib-kubelet\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417642    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-etc-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417660    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-cnibin\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417675    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-run-netns\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417698    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417724    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-system-cni-dir\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417743    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-cnibin\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417747    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-node-log\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417783    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-node-log\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417784    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417795    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-var-lib-kubelet\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417814    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.417814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417815    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-run-ovn-kubernetes\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417851    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-sys\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417876    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-host\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417892    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-sys\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417894    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-system-cni-dir\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417907    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-env-overrides\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417744    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-etc-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-run-netns\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417945    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-etc-selinux\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.417956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418003    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-host\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418087    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-nqt7n\" (UniqueName: \"kubernetes.io/projected/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-kube-api-access-nqt7n\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418133    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-var-lib-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418151    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovnkube-config\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418158    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxbn\" (UniqueName: \"kubernetes.io/projected/739a841c-3f77-4217-b400-80ef7ed39f53-kube-api-access-mfxbn\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418215    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysctl-conf\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418247    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.418344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418272    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418296    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-device-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418320    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-systemd\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-env-overrides\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418379    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-kubelet-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418387    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-device-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418343    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-modprobe-d\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-systemd\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418450    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-var-lib-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418462    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-modprobe-d\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418484    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-kubernetes\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418524    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysctl-conf\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418539    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysconfig\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418567    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-run\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418575    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysconfig\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-kubernetes\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418592    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-tuning-conf-dir\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.419135 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418594    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-os-release\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418623    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418629    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-run\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418647    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ca587687-8789-4585-862d-d9ffe57c9023-os-release\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418652    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418682    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovnkube-script-lib\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418705    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-socket-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418732    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/739a841c-3f77-4217-b400-80ef7ed39f53-tmp\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418758    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3123e555-e462-42c0-8c96-96f4f5fd50b9-konnectivity-ca\") pod \"konnectivity-agent-qm4bj\" (UID: \"3123e555-e462-42c0-8c96-96f4f5fd50b9\") " pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418784    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-cni-binary-copy\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418786    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-openvswitch\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418810    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-cni-netd\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418834    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/739a841c-3f77-4217-b400-80ef7ed39f53-etc-tuned\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418837    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-socket-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418863    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418889    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-slash\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418913    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-systemd\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.419903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418937    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-lib-modules\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418966    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-kubelet\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.418992    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-systemd-units\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419016    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-ovn\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419041    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-log-socket\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419066    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovn-node-metrics-cert\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419091    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3123e555-e462-42c0-8c96-96f4f5fd50b9-agent-certs\") pod \"konnectivity-agent-qm4bj\" (UID: \"3123e555-e462-42c0-8c96-96f4f5fd50b9\") " pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419116    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-registration-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419143    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-sys-fs\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419167    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysctl-d\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419187    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-systemd-units\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419196    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-cni-bin\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419234    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-lib-modules\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419259    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3123e555-e462-42c0-8c96-96f4f5fd50b9-konnectivity-ca\") pod \"konnectivity-agent-qm4bj\" (UID: \"3123e555-e462-42c0-8c96-96f4f5fd50b9\") " pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419284    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-cni-bin\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419286    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovnkube-script-lib\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.420659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-log-socket\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419313    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-cni-netd\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419339    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-registration-dir\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419348    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3f200d20-7476-4a36-9dbe-e027c51d9811-sys-fs\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419351    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-slash\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419386    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-host-kubelet\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-ovn\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419476    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/739a841c-3f77-4217-b400-80ef7ed39f53-etc-sysctl-d\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.419502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-run-systemd\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.420354    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.420445    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ca587687-8789-4585-862d-d9ffe57c9023-cni-binary-copy\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.421731 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.421708    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/739a841c-3f77-4217-b400-80ef7ed39f53-tmp\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.422141 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.421925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/739a841c-3f77-4217-b400-80ef7ed39f53-etc-tuned\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.422141 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.422020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3123e555-e462-42c0-8c96-96f4f5fd50b9-agent-certs\") pod \"konnectivity-agent-qm4bj\" (UID: \"3123e555-e462-42c0-8c96-96f4f5fd50b9\") " pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.422400 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.422378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-ovn-node-metrics-cert\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.426335 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.426305    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kpnjw\" (UniqueName: \"kubernetes.io/projected/ca587687-8789-4585-862d-d9ffe57c9023-kube-api-access-kpnjw\") pod \"multus-additional-cni-plugins-56cnv\" (UID: \"ca587687-8789-4585-862d-d9ffe57c9023\") " pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.426600 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.426581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxbn\" (UniqueName: \"kubernetes.io/projected/739a841c-3f77-4217-b400-80ef7ed39f53-kube-api-access-mfxbn\") pod \"tuned-n6c5z\" (UID: \"739a841c-3f77-4217-b400-80ef7ed39f53\") " pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.427020 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.426998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-98rk4\" (UniqueName: \"kubernetes.io/projected/3f200d20-7476-4a36-9dbe-e027c51d9811-kube-api-access-98rk4\") pod \"aws-ebs-csi-driver-node-d7wnm\" (UID: \"3f200d20-7476-4a36-9dbe-e027c51d9811\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.427104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.427080    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqt7n\" (UniqueName: \"kubernetes.io/projected/125de1d5-be72-4d3b-b32e-15ad4df1d3a9-kube-api-access-nqt7n\") pod \"ovnkube-node-cbn52\" (UID: \"125de1d5-be72-4d3b-b32e-15ad4df1d3a9\") " pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.509536 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.509505    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-65792"
Jun 01 21:41:51.516291 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.516270    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fdt8z"
Jun 01 21:41:51.539513 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.539490    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8gtd5"
Jun 01 21:41:51.544076 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.544060    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2fq6l"
Jun 01 21:41:51.551597 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.551581    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:41:51.559120 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.559102    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm"
Jun 01 21:41:51.567711 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.567694    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-n6c5z"
Jun 01 21:41:51.575241 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.575227    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-56cnv"
Jun 01 21:41:51.580812 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.580795    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:41:51.821537 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.821462    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:51.821678 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.821625    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:51.821732 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.821705    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:41:52.821682811 +0000 UTC m=+4.128122060 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:51.921964 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:51.921929    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:51.922123 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.922102    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 01 21:41:51.922167 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.922126    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 01 21:41:51.922167 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.922136    2562 projected.go:194] Error preparing data for projected volume kube-api-access-bsn9v for pod openshift-network-diagnostics/network-check-target-2f284: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:51.922256 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:51.922190    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v podName:7251e65b-b26e-47de-b8a7-c043aeb3b26f nodeName:}" failed. No retries permitted until 2026-06-01 21:41:52.9221737 +0000 UTC m=+4.228612961 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-bsn9v" (UniqueName: "kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v") pod "network-check-target-2f284" (UID: "7251e65b-b26e-47de-b8a7-c043aeb3b26f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:52.135423 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.135381    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3458e253_32bd_4931_8ca1_73f8c439709d.slice/crio-33cf4ea7999d33672e981fe0bb6f3ecd6f84989a0201c8a95f9536a7aebe04b0 WatchSource:0}: Error finding container 33cf4ea7999d33672e981fe0bb6f3ecd6f84989a0201c8a95f9536a7aebe04b0: Status 404 returned error can't find the container with id 33cf4ea7999d33672e981fe0bb6f3ecd6f84989a0201c8a95f9536a7aebe04b0
Jun 01 21:41:52.138150 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.137781    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca587687_8789_4585_862d_d9ffe57c9023.slice/crio-350b48161e1951ad22ef61699be2e07e7bc232398a8733bf6d2f1db37e096d7d WatchSource:0}: Error finding container 350b48161e1951ad22ef61699be2e07e7bc232398a8733bf6d2f1db37e096d7d: Status 404 returned error can't find the container with id 350b48161e1951ad22ef61699be2e07e7bc232398a8733bf6d2f1db37e096d7d
Jun 01 21:41:52.140235 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.140202    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ea91858_06b1_4def_baf4_504ef8ed92f9.slice/crio-be7828aeacc37718a5e759789aab531fac9490859353f93e7aabdb4efeb2e6a1 WatchSource:0}: Error finding container be7828aeacc37718a5e759789aab531fac9490859353f93e7aabdb4efeb2e6a1: Status 404 returned error can't find the container with id be7828aeacc37718a5e759789aab531fac9490859353f93e7aabdb4efeb2e6a1
Jun 01 21:41:52.140993 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.140972    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93fd91fe_2457_4345_8ad2_ecd5bbb800ea.slice/crio-39fe71b9a380c5ce02590ecfec89229f23c5e7a694e5510332f27e2d227e3c24 WatchSource:0}: Error finding container 39fe71b9a380c5ce02590ecfec89229f23c5e7a694e5510332f27e2d227e3c24: Status 404 returned error can't find the container with id 39fe71b9a380c5ce02590ecfec89229f23c5e7a694e5510332f27e2d227e3c24
Jun 01 21:41:52.141683 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.141528    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f200d20_7476_4a36_9dbe_e027c51d9811.slice/crio-0d96eaf2247e0d2f1b0c87038854c547f6574912f041cc060319199d7beeca31 WatchSource:0}: Error finding container 0d96eaf2247e0d2f1b0c87038854c547f6574912f041cc060319199d7beeca31: Status 404 returned error can't find the container with id 0d96eaf2247e0d2f1b0c87038854c547f6574912f041cc060319199d7beeca31
Jun 01 21:41:52.142721 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.142698    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3123e555_e462_42c0_8c96_96f4f5fd50b9.slice/crio-a30df94eff85a9ebac2cce7e8a980ea358a04cd4503c52d077bf593f53b5afbf WatchSource:0}: Error finding container a30df94eff85a9ebac2cce7e8a980ea358a04cd4503c52d077bf593f53b5afbf: Status 404 returned error can't find the container with id a30df94eff85a9ebac2cce7e8a980ea358a04cd4503c52d077bf593f53b5afbf
Jun 01 21:41:52.143497 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.143397    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod011bd4d5_d3f7_4fde_a2b9_98c89b43b8cd.slice/crio-c1d1b27d1babf147357220025fc02160beccbdfa5dfd94869c8fa5612809b292 WatchSource:0}: Error finding container c1d1b27d1babf147357220025fc02160beccbdfa5dfd94869c8fa5612809b292: Status 404 returned error can't find the container with id c1d1b27d1babf147357220025fc02160beccbdfa5dfd94869c8fa5612809b292
Jun 01 21:41:52.144876 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.144826    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod125de1d5_be72_4d3b_b32e_15ad4df1d3a9.slice/crio-360a5d247475ef0d549e9cd356b88fbcf5e1afb5137c58102d9b890b231572f7 WatchSource:0}: Error finding container 360a5d247475ef0d549e9cd356b88fbcf5e1afb5137c58102d9b890b231572f7: Status 404 returned error can't find the container with id 360a5d247475ef0d549e9cd356b88fbcf5e1afb5137c58102d9b890b231572f7
Jun 01 21:41:52.146483 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:41:52.145716    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod739a841c_3f77_4217_b400_80ef7ed39f53.slice/crio-97330128b46343d73ccb164afc2e73fc3bfe7016d82b390435516f0fbe1cdeb0 WatchSource:0}: Error finding container 97330128b46343d73ccb164afc2e73fc3bfe7016d82b390435516f0fbe1cdeb0: Status 404 returned error can't find the container with id 97330128b46343d73ccb164afc2e73fc3bfe7016d82b390435516f0fbe1cdeb0
Jun 01 21:41:52.252677 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.252649    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-05-31 21:36:50 +0000 UTC" deadline="2027-12-26 10:39:04.027704426 +0000 UTC"
Jun 01 21:41:52.252677 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.252676    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13740h57m11.775031022s"
Jun 01 21:41:52.308844 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.308809    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerStarted","Data":"350b48161e1951ad22ef61699be2e07e7bc232398a8733bf6d2f1db37e096d7d"}
Jun 01 21:41:52.310243 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.310217    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal" event={"ID":"6401c04a440f4f89d2d403cc6c765190","Type":"ContainerStarted","Data":"801adb2985a69a0c2cc16070bb8486d74ed2841cb21f5763b834e469fedf3da5"}
Jun 01 21:41:52.311203 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.311181    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6c5z" event={"ID":"739a841c-3f77-4217-b400-80ef7ed39f53","Type":"ContainerStarted","Data":"97330128b46343d73ccb164afc2e73fc3bfe7016d82b390435516f0fbe1cdeb0"}
Jun 01 21:41:52.312050 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.312030    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qm4bj" event={"ID":"3123e555-e462-42c0-8c96-96f4f5fd50b9","Type":"ContainerStarted","Data":"a30df94eff85a9ebac2cce7e8a980ea358a04cd4503c52d077bf593f53b5afbf"}
Jun 01 21:41:52.312878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.312860    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8gtd5" event={"ID":"93fd91fe-2457-4345-8ad2-ecd5bbb800ea","Type":"ContainerStarted","Data":"39fe71b9a380c5ce02590ecfec89229f23c5e7a694e5510332f27e2d227e3c24"}
Jun 01 21:41:52.313761 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.313742    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-65792" event={"ID":"3458e253-32bd-4931-8ca1-73f8c439709d","Type":"ContainerStarted","Data":"33cf4ea7999d33672e981fe0bb6f3ecd6f84989a0201c8a95f9536a7aebe04b0"}
Jun 01 21:41:52.314672 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.314647    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"360a5d247475ef0d549e9cd356b88fbcf5e1afb5137c58102d9b890b231572f7"}
Jun 01 21:41:52.315531 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.315495    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2fq6l" event={"ID":"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd","Type":"ContainerStarted","Data":"c1d1b27d1babf147357220025fc02160beccbdfa5dfd94869c8fa5612809b292"}
Jun 01 21:41:52.317494 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.317474    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm" event={"ID":"3f200d20-7476-4a36-9dbe-e027c51d9811","Type":"ContainerStarted","Data":"0d96eaf2247e0d2f1b0c87038854c547f6574912f041cc060319199d7beeca31"}
Jun 01 21:41:52.319310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.319292    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fdt8z" event={"ID":"9ea91858-06b1-4def-baf4-504ef8ed92f9","Type":"ContainerStarted","Data":"be7828aeacc37718a5e759789aab531fac9490859353f93e7aabdb4efeb2e6a1"}
Jun 01 21:41:52.323735 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.323686    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-134-181.ec2.internal" podStartSLOduration=2.323672862 podStartE2EDuration="2.323672862s" podCreationTimestamp="2026-06-01 21:41:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 21:41:52.3233501 +0000 UTC m=+3.629789364" watchObservedRunningTime="2026-06-01 21:41:52.323672862 +0000 UTC m=+3.630112127"
Jun 01 21:41:52.827666 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.827567    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:52.827844 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:52.827736    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:52.827844 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:52.827810    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:41:54.827784926 +0000 UTC m=+6.134224174 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:52.928690 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:52.928653    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:52.928884 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:52.928848    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 01 21:41:52.928884 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:52.928868    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 01 21:41:52.928884 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:52.928881    2562 projected.go:194] Error preparing data for projected volume kube-api-access-bsn9v for pod openshift-network-diagnostics/network-check-target-2f284: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:52.929270 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:52.929240    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v podName:7251e65b-b26e-47de-b8a7-c043aeb3b26f nodeName:}" failed. No retries permitted until 2026-06-01 21:41:54.92892945 +0000 UTC m=+6.235368696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-bsn9v" (UniqueName: "kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v") pod "network-check-target-2f284" (UID: "7251e65b-b26e-47de-b8a7-c043aeb3b26f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:53.304654 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:53.304582    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:53.305056 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:53.304597    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:53.305056 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:53.304733    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:41:53.305056 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:53.304784    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:41:53.334963 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:53.334932    2562 generic.go:358] "Generic (PLEG): container finished" podID="4dc87949f8a9c885caf7a824abecf768" containerID="bc29a9e02152f767905d9aee10af78151f2a4bf3c243f3a9eebe423638476711" exitCode=0
Jun 01 21:41:53.335556 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:53.335128    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal" event={"ID":"4dc87949f8a9c885caf7a824abecf768","Type":"ContainerDied","Data":"bc29a9e02152f767905d9aee10af78151f2a4bf3c243f3a9eebe423638476711"}
Jun 01 21:41:54.342943 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:54.342263    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal" event={"ID":"4dc87949f8a9c885caf7a824abecf768","Type":"ContainerStarted","Data":"8dec6f747ce088ffa963101b300420350db71ee684cf1c095af0235b271b8394"}
Jun 01 21:41:54.845398 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:54.845360    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:54.845587 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:54.845520    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:54.845656 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:54.845592    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:41:58.845571281 +0000 UTC m=+10.152010530 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:54.946224 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:54.946125    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:54.946393 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:54.946288    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 01 21:41:54.946393 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:54.946316    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 01 21:41:54.946393 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:54.946328    2562 projected.go:194] Error preparing data for projected volume kube-api-access-bsn9v for pod openshift-network-diagnostics/network-check-target-2f284: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:54.946393 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:54.946383    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v podName:7251e65b-b26e-47de-b8a7-c043aeb3b26f nodeName:}" failed. No retries permitted until 2026-06-01 21:41:58.946366088 +0000 UTC m=+10.252805349 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-bsn9v" (UniqueName: "kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v") pod "network-check-target-2f284" (UID: "7251e65b-b26e-47de-b8a7-c043aeb3b26f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:55.304109 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:55.303554    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:55.304109 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:55.303684    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:41:55.304109 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:55.303818    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:55.304109 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:55.303939    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:41:57.302393 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:57.301909    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:57.302393 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:57.302058    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:57.302393 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:57.302200    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:41:57.302393 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:57.302056    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:41:58.879023 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:58.878985    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:58.879491 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:58.879146    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:58.879491 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:58.879215    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:06.879195236 +0000 UTC m=+18.185634479 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:41:58.979579 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:58.979543    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:58.980216 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:58.979770    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 01 21:41:58.980216 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:58.979794    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 01 21:41:58.980216 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:58.979817    2562 projected.go:194] Error preparing data for projected volume kube-api-access-bsn9v for pod openshift-network-diagnostics/network-check-target-2f284: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:58.980216 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:58.979875    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v podName:7251e65b-b26e-47de-b8a7-c043aeb3b26f nodeName:}" failed. No retries permitted until 2026-06-01 21:42:06.979856786 +0000 UTC m=+18.286296031 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-bsn9v" (UniqueName: "kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v") pod "network-check-target-2f284" (UID: "7251e65b-b26e-47de-b8a7-c043aeb3b26f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:41:59.303015 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:59.302921    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:41:59.303171 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:59.303043    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:41:59.303425 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:41:59.303277    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:41:59.303425 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:41:59.303377    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:01.301740 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:01.301707    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:01.302176 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:01.301711    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:01.302176 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:01.301833    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:01.302176 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:01.301962    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:03.302618 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:03.302575    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:03.302618 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:03.302598    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:03.303113 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:03.302720    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:03.303113 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:03.302832    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:05.302537 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:05.302496    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:05.302982 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:05.302496    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:05.302982 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:05.302642    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:05.302982 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:05.302697    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:06.937086 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:06.937051    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:06.937613 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:06.937196    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:42:06.937613 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:06.937257    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:22.937238906 +0000 UTC m=+34.243678148 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:42:07.037560 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:07.037468    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:07.037739 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:07.037650    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 01 21:42:07.037739 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:07.037679    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 01 21:42:07.037739 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:07.037692    2562 projected.go:194] Error preparing data for projected volume kube-api-access-bsn9v for pod openshift-network-diagnostics/network-check-target-2f284: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:42:07.037865 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:07.037754    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v podName:7251e65b-b26e-47de-b8a7-c043aeb3b26f nodeName:}" failed. No retries permitted until 2026-06-01 21:42:23.03773496 +0000 UTC m=+34.344174206 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-bsn9v" (UniqueName: "kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v") pod "network-check-target-2f284" (UID: "7251e65b-b26e-47de-b8a7-c043aeb3b26f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:42:07.302464 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:07.302369    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:07.302622 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:07.302509    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:07.302622 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:07.302574    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:07.303047 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:07.302992    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:09.303422 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:09.303157    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:09.303821 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:09.303226    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:09.303821 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:09.303531    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:09.303821 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:09.303603    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:11.302901 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.302662    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:11.303763 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:11.302919    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:11.303763 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.302673    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:11.303763 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:11.303272    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:11.370934 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.370897    2562 generic.go:358] "Generic (PLEG): container finished" podID="ca587687-8789-4585-862d-d9ffe57c9023" containerID="e22116931607bde40fa32291aa1edf6f2b0172d78b42e3e06ccd436eb8ca866b" exitCode=0
Jun 01 21:42:11.371117 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.370989    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerDied","Data":"e22116931607bde40fa32291aa1edf6f2b0172d78b42e3e06ccd436eb8ca866b"}
Jun 01 21:42:11.372435 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.372370    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-n6c5z" event={"ID":"739a841c-3f77-4217-b400-80ef7ed39f53","Type":"ContainerStarted","Data":"fdff3acc7dbb08a1ef806c7ed65d1b03be1f2ac7e16b38021c2179967006861b"}
Jun 01 21:42:11.374260 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.374223    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qm4bj" event={"ID":"3123e555-e462-42c0-8c96-96f4f5fd50b9","Type":"ContainerStarted","Data":"eda541f53ff302e5afc37d828e9e08eaaecc3d79becc47b0829aeba1f59e6fb1"}
Jun 01 21:42:11.375774 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.375753    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8gtd5" event={"ID":"93fd91fe-2457-4345-8ad2-ecd5bbb800ea","Type":"ContainerStarted","Data":"6a97afb032a1909726d9183d01839ff55f005983a289a9f6bbb93d316ffb9362"}
Jun 01 21:42:11.378508 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378486    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:42:11.378867 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378844    2562 generic.go:358] "Generic (PLEG): container finished" podID="125de1d5-be72-4d3b-b32e-15ad4df1d3a9" containerID="81ab8592bc47e667609ee08bd856ac15ad79dca8d436063bf90a13f279042964" exitCode=1
Jun 01 21:42:11.378954 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378910    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"134de88d73a23ea3438979ba6960e134edd0cb645bd4fac0716acae9c3d0fb7b"}
Jun 01 21:42:11.378954 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378939    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"16f0a2f2a4f1dfb3b65817d8b4d40b35d3fce481f61b22a12265fa13c68b9753"}
Jun 01 21:42:11.379071 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378954    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"22ee1e13de30f128978f406daf3e82b1ce8a8703502ec9ccca90620e9c5a10be"}
Jun 01 21:42:11.379071 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378966    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"36a715faf060616c7775abb6653558b14ee9f2aa38879bb6e907aeee38bc352a"}
Jun 01 21:42:11.379071 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378978    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerDied","Data":"81ab8592bc47e667609ee08bd856ac15ad79dca8d436063bf90a13f279042964"}
Jun 01 21:42:11.379071 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.378992    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"b3b56d198b1aeb5efdf6cebd0e3f72c8fb02c0430267019b02a6867ce6fb60ee"}
Jun 01 21:42:11.380270 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.380247    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2fq6l" event={"ID":"011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd","Type":"ContainerStarted","Data":"ee8316b1b0975e5cd6fa266c158cfa413ebe14358d3903beb62bee3e2c516079"}
Jun 01 21:42:11.381631 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.381602    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm" event={"ID":"3f200d20-7476-4a36-9dbe-e027c51d9811","Type":"ContainerStarted","Data":"d25cb8214167499fe2f9a419de8e12babce85cfb6d5cb47afb01a658c54e2915"}
Jun 01 21:42:11.383055 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.383004    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fdt8z" event={"ID":"9ea91858-06b1-4def-baf4-504ef8ed92f9","Type":"ContainerStarted","Data":"88fae5c69dedd3c3b31316301daa68dd0b078d20d84b7b6d08f7782d99dfecaa"}
Jun 01 21:42:11.393673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.393636    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-134-181.ec2.internal" podStartSLOduration=21.393622752 podStartE2EDuration="21.393622752s" podCreationTimestamp="2026-06-01 21:41:50 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 21:41:54.358448146 +0000 UTC m=+5.664887411" watchObservedRunningTime="2026-06-01 21:42:11.393622752 +0000 UTC m=+22.700062015"
Jun 01 21:42:11.411623 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.411573    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-8gtd5" podStartSLOduration=4.223512842 podStartE2EDuration="22.411561715s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.142909116 +0000 UTC m=+3.449348358" lastFinishedPulling="2026-06-01 21:42:10.33095798 +0000 UTC m=+21.637397231" observedRunningTime="2026-06-01 21:42:11.411477083 +0000 UTC m=+22.717916349" watchObservedRunningTime="2026-06-01 21:42:11.411561715 +0000 UTC m=+22.718000979"
Jun 01 21:42:11.440922 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.440866    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2fq6l" podStartSLOduration=9.152326616 podStartE2EDuration="22.440848278s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.145081856 +0000 UTC m=+3.451521102" lastFinishedPulling="2026-06-01 21:42:05.433603517 +0000 UTC m=+16.740042764" observedRunningTime="2026-06-01 21:42:11.425012162 +0000 UTC m=+22.731451447" watchObservedRunningTime="2026-06-01 21:42:11.440848278 +0000 UTC m=+22.747287543"
Jun 01 21:42:11.441353 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.441321    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-n6c5z" podStartSLOduration=4.26416904 podStartE2EDuration="22.441313626s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.147555419 +0000 UTC m=+3.453994670" lastFinishedPulling="2026-06-01 21:42:10.324700011 +0000 UTC m=+21.631139256" observedRunningTime="2026-06-01 21:42:11.440538059 +0000 UTC m=+22.746977335" watchObservedRunningTime="2026-06-01 21:42:11.441313626 +0000 UTC m=+22.747752889"
Jun 01 21:42:11.455096 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.455058    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/node-resolver-fdt8z" podStartSLOduration=4.274095409 podStartE2EDuration="22.455046528s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.141828858 +0000 UTC m=+3.448268107" lastFinishedPulling="2026-06-01 21:42:10.322779969 +0000 UTC m=+21.629219226" observedRunningTime="2026-06-01 21:42:11.454966307 +0000 UTC m=+22.761405572" watchObservedRunningTime="2026-06-01 21:42:11.455046528 +0000 UTC m=+22.761485791"
Jun 01 21:42:11.799306 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.799054    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:42:11.799728 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.799711    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:42:11.814475 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:11.814434    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qm4bj" podStartSLOduration=4.63581415 podStartE2EDuration="22.814421732s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.14487392 +0000 UTC m=+3.451313162" lastFinishedPulling="2026-06-01 21:42:10.323481501 +0000 UTC m=+21.629920744" observedRunningTime="2026-06-01 21:42:11.469425308 +0000 UTC m=+22.775864566" watchObservedRunningTime="2026-06-01 21:42:11.814421732 +0000 UTC m=+23.120860987"
Jun 01 21:42:12.028099 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.028071    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jun 01 21:42:12.283187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.283022    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-01T21:42:12.028091421Z","UUID":"0266200c-0b6b-4a8b-bc5e-0580701a557d","Handler":null,"Name":"","Endpoint":""}
Jun 01 21:42:12.284855 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.284834    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jun 01 21:42:12.284965 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.284864    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jun 01 21:42:12.386764 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.386731    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm" event={"ID":"3f200d20-7476-4a36-9dbe-e027c51d9811","Type":"ContainerStarted","Data":"a73e4bdd80def54cec850f91f08c067934be6e5cafae94c184c7cd4f7ab5d813"}
Jun 01 21:42:12.388196 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.388168    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-65792" event={"ID":"3458e253-32bd-4931-8ca1-73f8c439709d","Type":"ContainerStarted","Data":"ff22594cae8b5703bb581c21764d24e7af6be110775a2a33babf6b8d5625cc0d"}
Jun 01 21:42:12.388652 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.388631    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:42:12.389207 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.389188    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qm4bj"
Jun 01 21:42:12.403034 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:12.402979    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-65792" podStartSLOduration=5.21684884 podStartE2EDuration="23.402964664s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.137321305 +0000 UTC m=+3.443760553" lastFinishedPulling="2026-06-01 21:42:10.323437133 +0000 UTC m=+21.629876377" observedRunningTime="2026-06-01 21:42:12.402574636 +0000 UTC m=+23.709013900" watchObservedRunningTime="2026-06-01 21:42:12.402964664 +0000 UTC m=+23.709403929"
Jun 01 21:42:13.303995 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:13.303091    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:13.303995 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:13.303135    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:13.303995 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:13.303237    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:13.303995 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:13.303369    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:13.392659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:13.392594    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm" event={"ID":"3f200d20-7476-4a36-9dbe-e027c51d9811","Type":"ContainerStarted","Data":"f409bb094bb87944155acd85b523c92c24fb39c70262eb9cfa6319e1a2b55d1f"}
Jun 01 21:42:13.395455 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:13.395437    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:42:13.395809 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:13.395763    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"1f23a440d9420cfa4f4a7a047f10ef51bf89974c858ab0df04a175ad96318102"}
Jun 01 21:42:14.414097 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:14.414047    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-d7wnm" podStartSLOduration=4.314754231 podStartE2EDuration="25.414034333s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.143934766 +0000 UTC m=+3.450374012" lastFinishedPulling="2026-06-01 21:42:13.243214858 +0000 UTC m=+24.549654114" observedRunningTime="2026-06-01 21:42:14.41389045 +0000 UTC m=+25.720329725" watchObservedRunningTime="2026-06-01 21:42:14.414034333 +0000 UTC m=+25.720473596"
Jun 01 21:42:15.301925 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:15.301886    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:15.302081 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:15.301889    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:15.302081 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:15.302033    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:15.302081 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:15.302063    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:17.305083 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.304900    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:17.305624 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.304908    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:17.305624 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:17.305147    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:17.305624 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:17.305236    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:17.406049 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.406023    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:42:17.406377 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.406349    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"5cd55b0c7d78cc83006eb71a1cc2e273d380c67d928f7197a50d7ececb3da860"}
Jun 01 21:42:17.406692 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.406664    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:42:17.406829 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.406815    2562 scope.go:117] "RemoveContainer" containerID="81ab8592bc47e667609ee08bd856ac15ad79dca8d436063bf90a13f279042964"
Jun 01 21:42:17.409798 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.409777    2562 generic.go:358] "Generic (PLEG): container finished" podID="ca587687-8789-4585-862d-d9ffe57c9023" containerID="053cff7e4907fb758584334fb0d1ad1b22052d5b12e944a1c44d89fc6f6b7a11" exitCode=0
Jun 01 21:42:17.409917 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.409807    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerDied","Data":"053cff7e4907fb758584334fb0d1ad1b22052d5b12e944a1c44d89fc6f6b7a11"}
Jun 01 21:42:17.424006 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:17.423985    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:42:18.417650 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.417475    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:42:18.418709 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.418658    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" event={"ID":"125de1d5-be72-4d3b-b32e-15ad4df1d3a9","Type":"ContainerStarted","Data":"4de9f1a6a6866470092942259ca360011ff3d05e55efb42a5d24d2c22a8d90fe"}
Jun 01 21:42:18.418835 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.418820    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 01 21:42:18.419285 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.419262    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:42:18.439507 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.439476    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:42:18.456736 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.456687    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" podStartSLOduration=11.22467644 podStartE2EDuration="29.456672874s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.147216174 +0000 UTC m=+3.453655429" lastFinishedPulling="2026-06-01 21:42:10.37921262 +0000 UTC m=+21.685651863" observedRunningTime="2026-06-01 21:42:18.456122345 +0000 UTC m=+29.762561608" watchObservedRunningTime="2026-06-01 21:42:18.456672874 +0000 UTC m=+29.763112139"
Jun 01 21:42:18.514427 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.514372    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2f284"]
Jun 01 21:42:18.514551 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.514528    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:18.514656 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:18.514626    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:18.517282 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.517258    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nc7qb"]
Jun 01 21:42:18.517390 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:18.517378    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:18.517512 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:18.517493    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:19.422877 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:19.422846    2562 generic.go:358] "Generic (PLEG): container finished" podID="ca587687-8789-4585-862d-d9ffe57c9023" containerID="198d2663dec9f267fc10bc972844a97aa0f010783b338607e4a9a521ccb312ee" exitCode=0
Jun 01 21:42:19.423471 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:19.422928    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerDied","Data":"198d2663dec9f267fc10bc972844a97aa0f010783b338607e4a9a521ccb312ee"}
Jun 01 21:42:19.423471 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:19.423142    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 01 21:42:20.302478 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:20.302445    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:20.302632 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:20.302575    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:20.302695 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:20.302649    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:20.302807 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:20.302779    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:20.427108 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:20.427069    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerStarted","Data":"29b9a479a7c1055201990af8d633e471402ca396635717d06fdcd8454f6f97ca"}
Jun 01 21:42:20.427635 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:20.427211    2562 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness"
Jun 01 21:42:20.957673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:20.957580    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:42:21.430361 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:21.430322    2562 generic.go:358] "Generic (PLEG): container finished" podID="ca587687-8789-4585-862d-d9ffe57c9023" containerID="29b9a479a7c1055201990af8d633e471402ca396635717d06fdcd8454f6f97ca" exitCode=0
Jun 01 21:42:21.430842 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:21.430402    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerDied","Data":"29b9a479a7c1055201990af8d633e471402ca396635717d06fdcd8454f6f97ca"}
Jun 01 21:42:21.448683 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:21.448645    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52" podUID="125de1d5-be72-4d3b-b32e-15ad4df1d3a9" containerName="ovnkube-controller" probeResult="failure" output=""
Jun 01 21:42:22.302493 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:22.302456    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:22.302686 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:22.302456    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:22.302686 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:22.302567    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-2f284" podUID="7251e65b-b26e-47de-b8a7-c043aeb3b26f"
Jun 01 21:42:22.302686 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:22.302664    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-nc7qb" podUID="764970ef-ec62-4e03-a3a6-e5c3382b1d91"
Jun 01 21:42:22.962334 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:22.962293    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:22.962850 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:22.962496    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:42:22.962850 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:22.962572    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:54.962552271 +0000 UTC m=+66.268991729 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jun 01 21:42:23.033349 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.033321    2562 kubelet_node_status.go:736] "Recording event message for node" node="ip-10-0-134-181.ec2.internal" event="NodeReady"
Jun 01 21:42:23.033553 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.033478    2562 kubelet_node_status.go:550] "Fast updating node status as it just became ready"
Jun 01 21:42:23.063307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.063273    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:23.063514 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.063451    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jun 01 21:42:23.063514 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.063474    2562 projected.go:289] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jun 01 21:42:23.063514 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.063484    2562 projected.go:194] Error preparing data for projected volume kube-api-access-bsn9v for pod openshift-network-diagnostics/network-check-target-2f284: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:42:23.063677 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.063536    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v podName:7251e65b-b26e-47de-b8a7-c043aeb3b26f nodeName:}" failed. No retries permitted until 2026-06-01 21:42:55.063521016 +0000 UTC m=+66.369960258 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-bsn9v" (UniqueName: "kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v") pod "network-check-target-2f284" (UID: "7251e65b-b26e-47de-b8a7-c043aeb3b26f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jun 01 21:42:23.092167 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.092135    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-8nhns"]
Jun 01 21:42:23.105638 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.105579    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-kbh6p"]
Jun 01 21:42:23.105803 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.105740    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.109810 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.109605    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jun 01 21:42:23.110045 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.110021    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jun 01 21:42:23.110147 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.110060    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6g4lx\""
Jun 01 21:42:23.120018 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.119992    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8nhns"]
Jun 01 21:42:23.120018 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.120022    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kbh6p"]
Jun 01 21:42:23.120164 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.120111    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:23.122662 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.122638    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jun 01 21:42:23.122851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.122815    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jun 01 21:42:23.122968 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.122853    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqpsx\""
Jun 01 21:42:23.122968 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.122883    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jun 01 21:42:23.264667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.264589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.264667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.264639    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78gwg\" (UniqueName: \"kubernetes.io/projected/39aea332-d0c6-40b9-b9df-9e38e7abea05-kube-api-access-78gwg\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.264870 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.264710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39aea332-d0c6-40b9-b9df-9e38e7abea05-config-volume\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.264870 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.264749    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:23.264870 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.264821    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mcb2w\" (UniqueName: \"kubernetes.io/projected/19155057-e59a-46c6-8d0d-6550843180dd-kube-api-access-mcb2w\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:23.264870 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.264847    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39aea332-d0c6-40b9-b9df-9e38e7abea05-tmp-dir\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.365234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365197    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.365234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365236    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-78gwg\" (UniqueName: \"kubernetes.io/projected/39aea332-d0c6-40b9-b9df-9e38e7abea05-kube-api-access-78gwg\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.365468 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365267    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39aea332-d0c6-40b9-b9df-9e38e7abea05-config-volume\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.365468 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365283    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:23.365468 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365319    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-mcb2w\" (UniqueName: \"kubernetes.io/projected/19155057-e59a-46c6-8d0d-6550843180dd-kube-api-access-mcb2w\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:23.365468 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365334    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39aea332-d0c6-40b9-b9df-9e38e7abea05-tmp-dir\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.365468 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.365368    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 01 21:42:23.365468 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.365464    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 01 21:42:23.365691 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.365465    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls podName:39aea332-d0c6-40b9-b9df-9e38e7abea05 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:23.865443869 +0000 UTC m=+35.171883114 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls") pod "dns-default-8nhns" (UID: "39aea332-d0c6-40b9-b9df-9e38e7abea05") : secret "dns-default-metrics-tls" not found
Jun 01 21:42:23.365691 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.365525    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert podName:19155057-e59a-46c6-8d0d-6550843180dd nodeName:}" failed. No retries permitted until 2026-06-01 21:42:23.865509331 +0000 UTC m=+35.171948573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert") pod "ingress-canary-kbh6p" (UID: "19155057-e59a-46c6-8d0d-6550843180dd") : secret "canary-serving-cert" not found
Jun 01 21:42:23.365775 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365699    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/39aea332-d0c6-40b9-b9df-9e38e7abea05-tmp-dir\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.365903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.365885    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/39aea332-d0c6-40b9-b9df-9e38e7abea05-config-volume\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.376039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.375914    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78gwg\" (UniqueName: \"kubernetes.io/projected/39aea332-d0c6-40b9-b9df-9e38e7abea05-kube-api-access-78gwg\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.376155 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.375989    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mcb2w\" (UniqueName: \"kubernetes.io/projected/19155057-e59a-46c6-8d0d-6550843180dd-kube-api-access-mcb2w\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:23.868635 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.868590    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:23.868897 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:23.868675    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:23.868897 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.868744    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 01 21:42:23.868897 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.868794    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 01 21:42:23.868897 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.868815    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert podName:19155057-e59a-46c6-8d0d-6550843180dd nodeName:}" failed. No retries permitted until 2026-06-01 21:42:24.868797226 +0000 UTC m=+36.175236468 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert") pod "ingress-canary-kbh6p" (UID: "19155057-e59a-46c6-8d0d-6550843180dd") : secret "canary-serving-cert" not found
Jun 01 21:42:23.868897 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:23.868852    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls podName:39aea332-d0c6-40b9-b9df-9e38e7abea05 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:24.868833785 +0000 UTC m=+36.175273041 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls") pod "dns-default-8nhns" (UID: "39aea332-d0c6-40b9-b9df-9e38e7abea05") : secret "dns-default-metrics-tls" not found
Jun 01 21:42:24.302823 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.302736    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:24.303350 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.302750    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:24.306776 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.306750    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 01 21:42:24.306776 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.306765    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vgrbz\""
Jun 01 21:42:24.306989 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.306954    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlgnh\""
Jun 01 21:42:24.306989 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.306963    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 01 21:42:24.307098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.307050    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 01 21:42:24.878104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.878067    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:24.878352 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:24.878124    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:24.878352 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:24.878245    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 01 21:42:24.878352 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:24.878315    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls podName:39aea332-d0c6-40b9-b9df-9e38e7abea05 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:26.878294357 +0000 UTC m=+38.184733599 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls") pod "dns-default-8nhns" (UID: "39aea332-d0c6-40b9-b9df-9e38e7abea05") : secret "dns-default-metrics-tls" not found
Jun 01 21:42:24.878352 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:24.878248    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 01 21:42:24.878557 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:24.878399    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert podName:19155057-e59a-46c6-8d0d-6550843180dd nodeName:}" failed. No retries permitted until 2026-06-01 21:42:26.878384018 +0000 UTC m=+38.184823261 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert") pod "ingress-canary-kbh6p" (UID: "19155057-e59a-46c6-8d0d-6550843180dd") : secret "canary-serving-cert" not found
Jun 01 21:42:26.893532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:26.893494    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:26.893977 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:26.893561    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:26.893977 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:26.893672    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 01 21:42:26.893977 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:26.893677    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 01 21:42:26.893977 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:26.893735    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert podName:19155057-e59a-46c6-8d0d-6550843180dd nodeName:}" failed. No retries permitted until 2026-06-01 21:42:30.893715645 +0000 UTC m=+42.200154910 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert") pod "ingress-canary-kbh6p" (UID: "19155057-e59a-46c6-8d0d-6550843180dd") : secret "canary-serving-cert" not found
Jun 01 21:42:26.893977 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:26.893751    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls podName:39aea332-d0c6-40b9-b9df-9e38e7abea05 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:30.893744986 +0000 UTC m=+42.200184227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls") pod "dns-default-8nhns" (UID: "39aea332-d0c6-40b9-b9df-9e38e7abea05") : secret "dns-default-metrics-tls" not found
Jun 01 21:42:28.447317 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:28.447287    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerStarted","Data":"e57d02537e4b99807fb99572ad489c9fe1e7890b1ef9fa92cfddd19a58ba856f"}
Jun 01 21:42:29.451991 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:29.451953    2562 generic.go:358] "Generic (PLEG): container finished" podID="ca587687-8789-4585-862d-d9ffe57c9023" containerID="e57d02537e4b99807fb99572ad489c9fe1e7890b1ef9fa92cfddd19a58ba856f" exitCode=0
Jun 01 21:42:29.452365 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:29.451999    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerDied","Data":"e57d02537e4b99807fb99572ad489c9fe1e7890b1ef9fa92cfddd19a58ba856f"}
Jun 01 21:42:30.456363 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:30.456328    2562 generic.go:358] "Generic (PLEG): container finished" podID="ca587687-8789-4585-862d-d9ffe57c9023" containerID="a2aea9c81c246c235e0b8c1278c11a1d69ff5684af18e8d6776b8ededf64d5c3" exitCode=0
Jun 01 21:42:30.456739 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:30.456376    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerDied","Data":"a2aea9c81c246c235e0b8c1278c11a1d69ff5684af18e8d6776b8ededf64d5c3"}
Jun 01 21:42:30.925899 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:30.925864    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:30.926063 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:30.925917    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:30.926063 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:30.926007    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 01 21:42:30.926063 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:30.926012    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 01 21:42:30.926063 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:30.926058    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert podName:19155057-e59a-46c6-8d0d-6550843180dd nodeName:}" failed. No retries permitted until 2026-06-01 21:42:38.92604502 +0000 UTC m=+50.232484263 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert") pod "ingress-canary-kbh6p" (UID: "19155057-e59a-46c6-8d0d-6550843180dd") : secret "canary-serving-cert" not found
Jun 01 21:42:30.926207 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:30.926070    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls podName:39aea332-d0c6-40b9-b9df-9e38e7abea05 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:38.926064349 +0000 UTC m=+50.232503591 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls") pod "dns-default-8nhns" (UID: "39aea332-d0c6-40b9-b9df-9e38e7abea05") : secret "dns-default-metrics-tls" not found
Jun 01 21:42:31.463465 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:31.463432    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-56cnv" event={"ID":"ca587687-8789-4585-862d-d9ffe57c9023","Type":"ContainerStarted","Data":"db1cd3394cb9b64d721f01b2a6bcf8b54faf90c9f8ac47544a6fdd7d6444cca3"}
Jun 01 21:42:31.486171 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:31.486121    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-56cnv" podStartSLOduration=6.391842999 podStartE2EDuration="42.486107669s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:41:52.140380168 +0000 UTC m=+3.446819410" lastFinishedPulling="2026-06-01 21:42:28.234644838 +0000 UTC m=+39.541084080" observedRunningTime="2026-06-01 21:42:31.485914361 +0000 UTC m=+42.792353639" watchObservedRunningTime="2026-06-01 21:42:31.486107669 +0000 UTC m=+42.792546932"
Jun 01 21:42:38.981763 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:38.981712    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:38.982255 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:38.981777    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:38.982255 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:38.981888    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 01 21:42:38.982255 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:38.981958    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert podName:19155057-e59a-46c6-8d0d-6550843180dd nodeName:}" failed. No retries permitted until 2026-06-01 21:42:54.981942041 +0000 UTC m=+66.288381283 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert") pod "ingress-canary-kbh6p" (UID: "19155057-e59a-46c6-8d0d-6550843180dd") : secret "canary-serving-cert" not found
Jun 01 21:42:38.982255 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:38.981888    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 01 21:42:38.982255 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:38.982035    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls podName:39aea332-d0c6-40b9-b9df-9e38e7abea05 nodeName:}" failed. No retries permitted until 2026-06-01 21:42:54.982019168 +0000 UTC m=+66.288458410 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls") pod "dns-default-8nhns" (UID: "39aea332-d0c6-40b9-b9df-9e38e7abea05") : secret "dns-default-metrics-tls" not found
Jun 01 21:42:51.440968 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:51.440940    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-cbn52"
Jun 01 21:42:54.989870 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:54.989813    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:42:54.989870 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:54.989873    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:42:54.990347 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:54.989924    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:42:54.990347 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:54.989963    2562 secret.go:189] Couldn't get secret openshift-ingress-canary/canary-serving-cert: secret "canary-serving-cert" not found
Jun 01 21:42:54.990347 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:54.990028    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert podName:19155057-e59a-46c6-8d0d-6550843180dd nodeName:}" failed. No retries permitted until 2026-06-01 21:43:26.990012079 +0000 UTC m=+98.296451322 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert") pod "ingress-canary-kbh6p" (UID: "19155057-e59a-46c6-8d0d-6550843180dd") : secret "canary-serving-cert" not found
Jun 01 21:42:54.990347 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:54.990030    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jun 01 21:42:54.990347 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:54.990082    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls podName:39aea332-d0c6-40b9-b9df-9e38e7abea05 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:26.990067717 +0000 UTC m=+98.296506958 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls") pod "dns-default-8nhns" (UID: "39aea332-d0c6-40b9-b9df-9e38e7abea05") : secret "dns-default-metrics-tls" not found
Jun 01 21:42:54.992763 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:54.992746    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jun 01 21:42:55.000734 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:55.000710    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jun 01 21:42:55.000797 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:42:55.000769    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs podName:764970ef-ec62-4e03-a3a6-e5c3382b1d91 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:59.000753552 +0000 UTC m=+130.307192793 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs") pod "network-metrics-daemon-nc7qb" (UID: "764970ef-ec62-4e03-a3a6-e5c3382b1d91") : secret "metrics-daemon-secret" not found
Jun 01 21:42:55.090274 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.090236    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:55.093213 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.093195    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jun 01 21:42:55.103434 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.103394    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jun 01 21:42:55.114574 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.114545    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsn9v\" (UniqueName: \"kubernetes.io/projected/7251e65b-b26e-47de-b8a7-c043aeb3b26f-kube-api-access-bsn9v\") pod \"network-check-target-2f284\" (UID: \"7251e65b-b26e-47de-b8a7-c043aeb3b26f\") " pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:55.217796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.217770    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-dlgnh\""
Jun 01 21:42:55.225777 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.225753    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:55.358846 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.358806    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-2f284"]
Jun 01 21:42:55.363651 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:42:55.363625    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7251e65b_b26e_47de_b8a7_c043aeb3b26f.slice/crio-0fb68a3f17541e376a061a7a419096aa143d309e700ef023f74b6c2e7eda3e0b WatchSource:0}: Error finding container 0fb68a3f17541e376a061a7a419096aa143d309e700ef023f74b6c2e7eda3e0b: Status 404 returned error can't find the container with id 0fb68a3f17541e376a061a7a419096aa143d309e700ef023f74b6c2e7eda3e0b
Jun 01 21:42:55.507128 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:55.507092    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2f284" event={"ID":"7251e65b-b26e-47de-b8a7-c043aeb3b26f","Type":"ContainerStarted","Data":"0fb68a3f17541e376a061a7a419096aa143d309e700ef023f74b6c2e7eda3e0b"}
Jun 01 21:42:59.517357 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.517319    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-2f284" event={"ID":"7251e65b-b26e-47de-b8a7-c043aeb3b26f","Type":"ContainerStarted","Data":"70ca1bccbaa7e5166c31f07535cef71496fdbfa9492cb88d01d06544ba8367f6"}
Jun 01 21:42:59.517739 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.517438    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:42:59.532020 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.531974    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-2f284" podStartSLOduration=66.931985736 podStartE2EDuration="1m10.531958599s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:42:55.365481886 +0000 UTC m=+66.671921129" lastFinishedPulling="2026-06-01 21:42:58.965454751 +0000 UTC m=+70.271893992" observedRunningTime="2026-06-01 21:42:59.531698311 +0000 UTC m=+70.838137574" watchObservedRunningTime="2026-06-01 21:42:59.531958599 +0000 UTC m=+70.838397864"
Jun 01 21:42:59.983858 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.983821    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"]
Jun 01 21:42:59.986688 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.986662    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"]
Jun 01 21:42:59.986839 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.986826    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:42:59.989312 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.989292    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-hdt9q"]
Jun 01 21:42:59.989455 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.989439    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"
Jun 01 21:42:59.992132 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.992112    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:42:59.992459 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.992437    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-7d67cf6f97-g2knr"]
Jun 01 21:42:59.993820 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.993748    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jun 01 21:42:59.993902 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.993871    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jun 01 21:42:59.994024 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.993993    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jun 01 21:42:59.994151 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.994134    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-2hnbt\""
Jun 01 21:42:59.994255 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.994192    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jun 01 21:42:59.995103 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:42:59.995062    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.001322 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.001168    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jun 01 21:43:00.001322 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.001169    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jun 01 21:43:00.001322 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.001202    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jun 01 21:43:00.001659 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.001645    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jun 01 21:43:00.002557 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.002355    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jun 01 21:43:00.002557 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.002384    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jun 01 21:43:00.002557 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.002385    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jun 01 21:43:00.002557 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.002464    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-l74l5\""
Jun 01 21:43:00.002825 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.002802    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-zdd7q\""
Jun 01 21:43:00.002912 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.002867    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jun 01 21:43:00.003082 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.003067    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-mg7ff\""
Jun 01 21:43:00.003211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.003197    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jun 01 21:43:00.003320 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.003301    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jun 01 21:43:00.003557 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.003536    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jun 01 21:43:00.003695 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.003673    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"]
Jun 01 21:43:00.004558 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.004537    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"]
Jun 01 21:43:00.009217 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.009115    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jun 01 21:43:00.012282 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.010864    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-hdt9q"]
Jun 01 21:43:00.018345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.018272    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d67cf6f97-g2knr"]
Jun 01 21:43:00.031050 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031020    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzxlq\" (UniqueName: \"kubernetes.io/projected/bdfccc11-1004-479b-9687-1d056ee1b5c4-kube-api-access-bzxlq\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.031050 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-stats-auth\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031075    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9qlr\" (UniqueName: \"kubernetes.io/projected/13847c2e-6d93-46f4-b3c3-5897783b7454-kube-api-access-p9qlr\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031104    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdfccc11-1004-479b-9687-1d056ee1b5c4-config\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92qrc\" (UniqueName: \"kubernetes.io/projected/22a06d56-4027-4ec8-9365-aacb746bbcc0-kube-api-access-92qrc\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-default-certificate\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031229    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx6gp\" (UniqueName: \"kubernetes.io/projected/1e447f32-6a9e-49f5-b25d-fbcc33f6b783-kube-api-access-qx6gp\") pod \"volume-data-source-validator-7598fd5bd-nm8z2\" (UID: \"1e447f32-6a9e-49f5-b25d-fbcc33f6b783\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031274    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.031345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.031615 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdfccc11-1004-479b-9687-1d056ee1b5c4-trusted-ca\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.031615 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.031379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bdfccc11-1004-479b-9687-1d056ee1b5c4-serving-cert\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.083955 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.083927    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"]
Jun 01 21:43:00.087013 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.086998    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.089481 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.089459    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jun 01 21:43:00.089673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.089650    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jun 01 21:43:00.090091 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.090076    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jun 01 21:43:00.090132 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.090096    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-65x7g\""
Jun 01 21:43:00.090132 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.090083    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jun 01 21:43:00.096244 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.096220    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"]
Jun 01 21:43:00.132313 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132277    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-default-certificate\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132320    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132353    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qx6gp\" (UniqueName: \"kubernetes.io/projected/1e447f32-6a9e-49f5-b25d-fbcc33f6b783-kube-api-access-qx6gp\") pod \"volume-data-source-validator-7598fd5bd-nm8z2\" (UID: \"1e447f32-6a9e-49f5-b25d-fbcc33f6b783\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132378    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132425    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132454    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b552103b-2d2f-4d1d-86ae-593b9b51bd15-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.132463    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132500    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdfccc11-1004-479b-9687-1d056ee1b5c4-trusted-ca\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.132532 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132524    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b552103b-2d2f-4d1d-86ae-593b9b51bd15-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.132541    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls podName:13847c2e-6d93-46f4-b3c3-5897783b7454 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:00.632519312 +0000 UTC m=+71.938958571 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jtc2x" (UID: "13847c2e-6d93-46f4-b3c3-5897783b7454") : secret "samples-operator-tls" not found
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.132544    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.132564    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:00.632555958 +0000 UTC m=+71.938995202 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : configmap references non-existent config key: service-ca.crt
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.132606    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:00.632591963 +0000 UTC m=+71.939031208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : secret "router-metrics-certs-default" not found
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132646    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6prn2\" (UniqueName: \"kubernetes.io/projected/b552103b-2d2f-4d1d-86ae-593b9b51bd15-kube-api-access-6prn2\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132681    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bdfccc11-1004-479b-9687-1d056ee1b5c4-serving-cert\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132706    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bzxlq\" (UniqueName: \"kubernetes.io/projected/bdfccc11-1004-479b-9687-1d056ee1b5c4-kube-api-access-bzxlq\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132723    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-stats-auth\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.132851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132750    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p9qlr\" (UniqueName: \"kubernetes.io/projected/13847c2e-6d93-46f4-b3c3-5897783b7454-kube-api-access-p9qlr\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:00.133303 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132859    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdfccc11-1004-479b-9687-1d056ee1b5c4-config\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.133303 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.132896    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-92qrc\" (UniqueName: \"kubernetes.io/projected/22a06d56-4027-4ec8-9365-aacb746bbcc0-kube-api-access-92qrc\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.133638 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.133610    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bdfccc11-1004-479b-9687-1d056ee1b5c4-config\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.133708 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.133634    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/bdfccc11-1004-479b-9687-1d056ee1b5c4-trusted-ca\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.135030 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.135002    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bdfccc11-1004-479b-9687-1d056ee1b5c4-serving-cert\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.135118 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.135046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-default-certificate\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.135118 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.135077    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-stats-auth\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.141444 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.141361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx6gp\" (UniqueName: \"kubernetes.io/projected/1e447f32-6a9e-49f5-b25d-fbcc33f6b783-kube-api-access-qx6gp\") pod \"volume-data-source-validator-7598fd5bd-nm8z2\" (UID: \"1e447f32-6a9e-49f5-b25d-fbcc33f6b783\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"
Jun 01 21:43:00.141540 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.141526    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzxlq\" (UniqueName: \"kubernetes.io/projected/bdfccc11-1004-479b-9687-1d056ee1b5c4-kube-api-access-bzxlq\") pod \"console-operator-86d7c6cc77-hdt9q\" (UID: \"bdfccc11-1004-479b-9687-1d056ee1b5c4\") " pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.141616 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.141545    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92qrc\" (UniqueName: \"kubernetes.io/projected/22a06d56-4027-4ec8-9365-aacb746bbcc0-kube-api-access-92qrc\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.141616 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.141561    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9qlr\" (UniqueName: \"kubernetes.io/projected/13847c2e-6d93-46f4-b3c3-5897783b7454-kube-api-access-p9qlr\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:00.233682 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.233644    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b552103b-2d2f-4d1d-86ae-593b9b51bd15-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.233907 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.233702    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b552103b-2d2f-4d1d-86ae-593b9b51bd15-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.233907 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.233727    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-6prn2\" (UniqueName: \"kubernetes.io/projected/b552103b-2d2f-4d1d-86ae-593b9b51bd15-kube-api-access-6prn2\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.234369 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.234341    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b552103b-2d2f-4d1d-86ae-593b9b51bd15-config\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.235895 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.235879    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b552103b-2d2f-4d1d-86ae-593b9b51bd15-serving-cert\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.242036 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.242017    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6prn2\" (UniqueName: \"kubernetes.io/projected/b552103b-2d2f-4d1d-86ae-593b9b51bd15-kube-api-access-6prn2\") pod \"kube-storage-version-migrator-operator-96ddc787c-wr5ms\" (UID: \"b552103b-2d2f-4d1d-86ae-593b9b51bd15\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.304722 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.304687    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"
Jun 01 21:43:00.316559 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.316533    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:00.396473 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.396374    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"
Jun 01 21:43:00.429514 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.429476    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2"]
Jun 01 21:43:00.450388 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.450362    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-86d7c6cc77-hdt9q"]
Jun 01 21:43:00.454054 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:00.454025    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdfccc11_1004_479b_9687_1d056ee1b5c4.slice/crio-c5a70d9048304ed1bd14a4ac6560385ec146effd1b152b9e33044449d5a4f05a WatchSource:0}: Error finding container c5a70d9048304ed1bd14a4ac6560385ec146effd1b152b9e33044449d5a4f05a: Status 404 returned error can't find the container with id c5a70d9048304ed1bd14a4ac6560385ec146effd1b152b9e33044449d5a4f05a
Jun 01 21:43:00.519908 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.519827    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" event={"ID":"bdfccc11-1004-479b-9687-1d056ee1b5c4","Type":"ContainerStarted","Data":"c5a70d9048304ed1bd14a4ac6560385ec146effd1b152b9e33044449d5a4f05a"}
Jun 01 21:43:00.521051 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.521026    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2" event={"ID":"1e447f32-6a9e-49f5-b25d-fbcc33f6b783","Type":"ContainerStarted","Data":"71c87c85f6bf1f9a9c0b62a7eb4406395dc638466dbbe710d601a90b0c4db225"}
Jun 01 21:43:00.521745 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.521724    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms"]
Jun 01 21:43:00.525126 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:00.525094    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb552103b_2d2f_4d1d_86ae_593b9b51bd15.slice/crio-11fe2b63b444c8aeeb608ea249b88e20198c460b78a84f0deda42bb674eb1ca2 WatchSource:0}: Error finding container 11fe2b63b444c8aeeb608ea249b88e20198c460b78a84f0deda42bb674eb1ca2: Status 404 returned error can't find the container with id 11fe2b63b444c8aeeb608ea249b88e20198c460b78a84f0deda42bb674eb1ca2
Jun 01 21:43:00.636952 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.636903    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:00.636952 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.636951    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.637200 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:00.636983    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:00.637200 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.637059    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 01 21:43:00.637200 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.637126    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls podName:13847c2e-6d93-46f4-b3c3-5897783b7454 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:01.637107892 +0000 UTC m=+72.943547141 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jtc2x" (UID: "13847c2e-6d93-46f4-b3c3-5897783b7454") : secret "samples-operator-tls" not found
Jun 01 21:43:00.637200 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.637159    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 01 21:43:00.637354 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.637216    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:01.637199189 +0000 UTC m=+72.943638448 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : configmap references non-existent config key: service-ca.crt
Jun 01 21:43:00.637354 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:00.637238    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:01.637229747 +0000 UTC m=+72.943668989 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : secret "router-metrics-certs-default" not found
Jun 01 21:43:01.524017 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:01.523974    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms" event={"ID":"b552103b-2d2f-4d1d-86ae-593b9b51bd15","Type":"ContainerStarted","Data":"11fe2b63b444c8aeeb608ea249b88e20198c460b78a84f0deda42bb674eb1ca2"}
Jun 01 21:43:01.646159 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:01.646112    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:01.646351 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:01.646167    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:01.646351 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:01.646201    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:01.646550 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:01.646364    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 01 21:43:01.646550 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:01.646445    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:03.646425816 +0000 UTC m=+74.952865075 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : secret "router-metrics-certs-default" not found
Jun 01 21:43:01.646704 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:01.646661    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:03.646647328 +0000 UTC m=+74.953086580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : configmap references non-existent config key: service-ca.crt
Jun 01 21:43:01.646704 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:01.646686    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 01 21:43:01.646839 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:01.646761    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls podName:13847c2e-6d93-46f4-b3c3-5897783b7454 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:03.646742356 +0000 UTC m=+74.953181658 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jtc2x" (UID: "13847c2e-6d93-46f4-b3c3-5897783b7454") : secret "samples-operator-tls" not found
Jun 01 21:43:02.527502 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:02.527464    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2" event={"ID":"1e447f32-6a9e-49f5-b25d-fbcc33f6b783","Type":"ContainerStarted","Data":"e9e88a40b2b4cea6e47a21a4862c1b04e10730a6becfa7ad19a93a658f81e4cb"}
Jun 01 21:43:02.542585 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:02.542527    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-7598fd5bd-nm8z2" podStartSLOduration=1.8751507219999999 podStartE2EDuration="3.542513783s" podCreationTimestamp="2026-06-01 21:42:59 +0000 UTC" firstStartedPulling="2026-06-01 21:43:00.437896905 +0000 UTC m=+71.744336146" lastFinishedPulling="2026-06-01 21:43:02.105259961 +0000 UTC m=+73.411699207" observedRunningTime="2026-06-01 21:43:02.54222606 +0000 UTC m=+73.848665325" watchObservedRunningTime="2026-06-01 21:43:02.542513783 +0000 UTC m=+73.848953046"
Jun 01 21:43:03.530617 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.530573    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms" event={"ID":"b552103b-2d2f-4d1d-86ae-593b9b51bd15","Type":"ContainerStarted","Data":"f9190c438d06848f9120291a0a4d67e1f0976a38ef91460a3380164b93345d3d"}
Jun 01 21:43:03.531935 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.531905    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/0.log"
Jun 01 21:43:03.532054 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.531942    2562 generic.go:358] "Generic (PLEG): container finished" podID="bdfccc11-1004-479b-9687-1d056ee1b5c4" containerID="33eed6fb889192d6d8f61202f7a95b46af396b42f13217392ed78fdc8d4f2fcc" exitCode=255
Jun 01 21:43:03.532054 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.531966    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" event={"ID":"bdfccc11-1004-479b-9687-1d056ee1b5c4","Type":"ContainerDied","Data":"33eed6fb889192d6d8f61202f7a95b46af396b42f13217392ed78fdc8d4f2fcc"}
Jun 01 21:43:03.532232 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.532216    2562 scope.go:117] "RemoveContainer" containerID="33eed6fb889192d6d8f61202f7a95b46af396b42f13217392ed78fdc8d4f2fcc"
Jun 01 21:43:03.545200 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.545161    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms" podStartSLOduration=0.713060163 podStartE2EDuration="3.545149074s" podCreationTimestamp="2026-06-01 21:43:00 +0000 UTC" firstStartedPulling="2026-06-01 21:43:00.526829145 +0000 UTC m=+71.833268388" lastFinishedPulling="2026-06-01 21:43:03.358918054 +0000 UTC m=+74.665357299" observedRunningTime="2026-06-01 21:43:03.54443942 +0000 UTC m=+74.850878690" watchObservedRunningTime="2026-06-01 21:43:03.545149074 +0000 UTC m=+74.851588337"
Jun 01 21:43:03.664904 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.664865    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:03.665030 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.664919    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:03.665030 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:03.664960    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:03.665100 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:03.665019    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 01 21:43:03.665100 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:03.665063    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 01 21:43:03.665100 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:03.665084    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls podName:13847c2e-6d93-46f4-b3c3-5897783b7454 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:07.665068425 +0000 UTC m=+78.971507666 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jtc2x" (UID: "13847c2e-6d93-46f4-b3c3-5897783b7454") : secret "samples-operator-tls" not found
Jun 01 21:43:03.665100 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:03.665099    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:07.66509364 +0000 UTC m=+78.971532882 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : configmap references non-existent config key: service-ca.crt
Jun 01 21:43:03.665231 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:03.665110    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:07.665104634 +0000 UTC m=+78.971543875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : secret "router-metrics-certs-default" not found
Jun 01 21:43:04.502424 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.502377    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"]
Jun 01 21:43:04.505294 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.505278    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"
Jun 01 21:43:04.507927 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.507904    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jun 01 21:43:04.508362 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.508344    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-jzhp9\""
Jun 01 21:43:04.509093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.509078    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jun 01 21:43:04.515017 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.514997    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"]
Jun 01 21:43:04.536240 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.536213    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/1.log"
Jun 01 21:43:04.536613 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.536598    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/0.log"
Jun 01 21:43:04.536667 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.536630    2562 generic.go:358] "Generic (PLEG): container finished" podID="bdfccc11-1004-479b-9687-1d056ee1b5c4" containerID="153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5" exitCode=255
Jun 01 21:43:04.536721 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.536670    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" event={"ID":"bdfccc11-1004-479b-9687-1d056ee1b5c4","Type":"ContainerDied","Data":"153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5"}
Jun 01 21:43:04.536773 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.536719    2562 scope.go:117] "RemoveContainer" containerID="33eed6fb889192d6d8f61202f7a95b46af396b42f13217392ed78fdc8d4f2fcc"
Jun 01 21:43:04.536942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.536922    2562 scope.go:117] "RemoveContainer" containerID="153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5"
Jun 01 21:43:04.537138 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:04.537119    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hdt9q_openshift-console-operator(bdfccc11-1004-479b-9687-1d056ee1b5c4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podUID="bdfccc11-1004-479b-9687-1d056ee1b5c4"
Jun 01 21:43:04.572178 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.572155    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6jlf\" (UniqueName: \"kubernetes.io/projected/0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2-kube-api-access-l6jlf\") pod \"migrator-96c6f749-l6vr9\" (UID: \"0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"
Jun 01 21:43:04.673748 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.673706    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l6jlf\" (UniqueName: \"kubernetes.io/projected/0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2-kube-api-access-l6jlf\") pod \"migrator-96c6f749-l6vr9\" (UID: \"0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"
Jun 01 21:43:04.681718 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.681693    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6jlf\" (UniqueName: \"kubernetes.io/projected/0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2-kube-api-access-l6jlf\") pod \"migrator-96c6f749-l6vr9\" (UID: \"0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2\") " pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"
Jun 01 21:43:04.814126 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.813989    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"
Jun 01 21:43:04.935194 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:04.935164    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9"]
Jun 01 21:43:04.938293 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:04.938264    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0cb907c3_92c3_4c4d_82a1_f4dbb71fbfc2.slice/crio-347428cd8a3d6a2b1b04ecf3440c799b8b4559176e7d60e140070adeeee5ac7f WatchSource:0}: Error finding container 347428cd8a3d6a2b1b04ecf3440c799b8b4559176e7d60e140070adeeee5ac7f: Status 404 returned error can't find the container with id 347428cd8a3d6a2b1b04ecf3440c799b8b4559176e7d60e140070adeeee5ac7f
Jun 01 21:43:05.540137 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:05.540088    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9" event={"ID":"0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2","Type":"ContainerStarted","Data":"347428cd8a3d6a2b1b04ecf3440c799b8b4559176e7d60e140070adeeee5ac7f"}
Jun 01 21:43:05.542002 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:05.541981    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/1.log"
Jun 01 21:43:05.542396 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:05.542372    2562 scope.go:117] "RemoveContainer" containerID="153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5"
Jun 01 21:43:05.542592 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:05.542569    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hdt9q_openshift-console-operator(bdfccc11-1004-479b-9687-1d056ee1b5c4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podUID="bdfccc11-1004-479b-9687-1d056ee1b5c4"
Jun 01 21:43:06.194170 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:06.194141    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fdt8z_9ea91858-06b1-4def-baf4-504ef8ed92f9/dns-node-resolver/0.log"
Jun 01 21:43:06.992284 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:06.992258    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2fq6l_011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd/node-ca/0.log"
Jun 01 21:43:07.548330 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:07.548297    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9" event={"ID":"0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2","Type":"ContainerStarted","Data":"a846edd50e1ea5b1309c38eaa6fefb946af7725457dc62632dbd69761fda414c"}
Jun 01 21:43:07.548330 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:07.548338    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9" event={"ID":"0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2","Type":"ContainerStarted","Data":"a10c7438b30cad86b92b13726f4bd6d9bfdd5230f491c54880711047b7ab64f9"}
Jun 01 21:43:07.563112 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:07.563065    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-96c6f749-l6vr9" podStartSLOduration=1.9064417219999998 podStartE2EDuration="3.563051382s" podCreationTimestamp="2026-06-01 21:43:04 +0000 UTC" firstStartedPulling="2026-06-01 21:43:04.940198043 +0000 UTC m=+76.246637286" lastFinishedPulling="2026-06-01 21:43:06.596807692 +0000 UTC m=+77.903246946" observedRunningTime="2026-06-01 21:43:07.562513081 +0000 UTC m=+78.868952344" watchObservedRunningTime="2026-06-01 21:43:07.563051382 +0000 UTC m=+78.869490690"
Jun 01 21:43:07.700725 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:07.700687    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:07.700725 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:07.700734    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:07.700973 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:07.700825    2562 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jun 01 21:43:07.700973 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:07.700832    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:15.700818806 +0000 UTC m=+87.007258048 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : configmap references non-existent config key: service-ca.crt
Jun 01 21:43:07.700973 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:07.700886    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:07.700973 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:07.700953    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jun 01 21:43:07.701113 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:07.700985    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls podName:13847c2e-6d93-46f4-b3c3-5897783b7454 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:15.700969603 +0000 UTC m=+87.007408858 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls") pod "cluster-samples-operator-755bbf9bfb-jtc2x" (UID: "13847c2e-6d93-46f4-b3c3-5897783b7454") : secret "samples-operator-tls" not found
Jun 01 21:43:07.701113 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:07.701008    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs podName:22a06d56-4027-4ec8-9365-aacb746bbcc0 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:15.700998021 +0000 UTC m=+87.007437271 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs") pod "router-default-7d67cf6f97-g2knr" (UID: "22a06d56-4027-4ec8-9365-aacb746bbcc0") : secret "router-metrics-certs-default" not found
Jun 01 21:43:10.317638 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:10.317602    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:10.318146 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:10.317685    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:10.318146 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:10.318057    2562 scope.go:117] "RemoveContainer" containerID="153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5"
Jun 01 21:43:10.318291 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:10.318270    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hdt9q_openshift-console-operator(bdfccc11-1004-479b-9687-1d056ee1b5c4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podUID="bdfccc11-1004-479b-9687-1d056ee1b5c4"
Jun 01 21:43:10.555041 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:10.555010    2562 scope.go:117] "RemoveContainer" containerID="153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5"
Jun 01 21:43:10.555202 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:10.555175    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hdt9q_openshift-console-operator(bdfccc11-1004-479b-9687-1d056ee1b5c4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podUID="bdfccc11-1004-479b-9687-1d056ee1b5c4"
Jun 01 21:43:15.763952 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.763919    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:15.764351 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.764025    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:15.768375 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.764461    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:15.768375 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.766092    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22a06d56-4027-4ec8-9365-aacb746bbcc0-service-ca-bundle\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:15.769121 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.769099    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/13847c2e-6d93-46f4-b3c3-5897783b7454-samples-operator-tls\") pod \"cluster-samples-operator-755bbf9bfb-jtc2x\" (UID: \"13847c2e-6d93-46f4-b3c3-5897783b7454\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:15.769226 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.769210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/22a06d56-4027-4ec8-9365-aacb746bbcc0-metrics-certs\") pod \"router-default-7d67cf6f97-g2knr\" (UID: \"22a06d56-4027-4ec8-9365-aacb746bbcc0\") " pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:15.897686 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.897628    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"
Jun 01 21:43:15.921704 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:15.921676    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:16.029670 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.029595    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x"]
Jun 01 21:43:16.054229 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.054205    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-7d67cf6f97-g2knr"]
Jun 01 21:43:16.057399 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:16.057365    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22a06d56_4027_4ec8_9365_aacb746bbcc0.slice/crio-04c4e7dfc8e4d1a1fb935d9aebd5dc8241e71ea7ffca9482be69ad5b92724ad6 WatchSource:0}: Error finding container 04c4e7dfc8e4d1a1fb935d9aebd5dc8241e71ea7ffca9482be69ad5b92724ad6: Status 404 returned error can't find the container with id 04c4e7dfc8e4d1a1fb935d9aebd5dc8241e71ea7ffca9482be69ad5b92724ad6
Jun 01 21:43:16.571218 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.571179    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x" event={"ID":"13847c2e-6d93-46f4-b3c3-5897783b7454","Type":"ContainerStarted","Data":"80a42721761950de5e69dd47bbec820f65e02a0fa95929288b6df2f3c01b763b"}
Jun 01 21:43:16.572372 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.572346    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d67cf6f97-g2knr" event={"ID":"22a06d56-4027-4ec8-9365-aacb746bbcc0","Type":"ContainerStarted","Data":"d7f7157897d2448e94cc1a2a758aefad373d0ff7d4ec7c417cb39367f9aa3e1b"}
Jun 01 21:43:16.572372 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.572375    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-7d67cf6f97-g2knr" event={"ID":"22a06d56-4027-4ec8-9365-aacb746bbcc0","Type":"ContainerStarted","Data":"04c4e7dfc8e4d1a1fb935d9aebd5dc8241e71ea7ffca9482be69ad5b92724ad6"}
Jun 01 21:43:16.590776 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.590722    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/router-default-7d67cf6f97-g2knr" podStartSLOduration=17.590703523 podStartE2EDuration="17.590703523s" podCreationTimestamp="2026-06-01 21:42:59 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 21:43:16.589647358 +0000 UTC m=+87.896086623" watchObservedRunningTime="2026-06-01 21:43:16.590703523 +0000 UTC m=+87.897142779"
Jun 01 21:43:16.922247 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.922211    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:16.925491 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:16.925466    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:17.575060 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:17.575028    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:17.576337 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:17.576320    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-7d67cf6f97-g2knr"
Jun 01 21:43:18.579061 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:18.579016    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x" event={"ID":"13847c2e-6d93-46f4-b3c3-5897783b7454","Type":"ContainerStarted","Data":"f362c2d83bb952d1736e6e5222158cda15b59997e133a8416dee92d77379354c"}
Jun 01 21:43:18.579061 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:18.579064    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x" event={"ID":"13847c2e-6d93-46f4-b3c3-5897783b7454","Type":"ContainerStarted","Data":"f6da59785674c860e937e8c3673c1c19214904e1bdf5936fd7161da03f83da9a"}
Jun 01 21:43:18.596583 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:18.596522    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-755bbf9bfb-jtc2x" podStartSLOduration=17.555968372 podStartE2EDuration="19.596506558s" podCreationTimestamp="2026-06-01 21:42:59 +0000 UTC" firstStartedPulling="2026-06-01 21:43:16.067764581 +0000 UTC m=+87.374203823" lastFinishedPulling="2026-06-01 21:43:18.108302751 +0000 UTC m=+89.414742009" observedRunningTime="2026-06-01 21:43:18.595202218 +0000 UTC m=+89.901641497" watchObservedRunningTime="2026-06-01 21:43:18.596506558 +0000 UTC m=+89.902945821"
Jun 01 21:43:24.302277 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:24.302241    2562 scope.go:117] "RemoveContainer" containerID="153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5"
Jun 01 21:43:24.598091 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:24.598010    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:43:24.598356 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:24.598340    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/1.log"
Jun 01 21:43:24.598424 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:24.598371    2562 generic.go:358] "Generic (PLEG): container finished" podID="bdfccc11-1004-479b-9687-1d056ee1b5c4" containerID="ab0cc92cbae0a6c1086e274fd1e9e508ed285140186d3da7e272e6e7faa4b6ee" exitCode=255
Jun 01 21:43:24.598424 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:24.598401    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" event={"ID":"bdfccc11-1004-479b-9687-1d056ee1b5c4","Type":"ContainerDied","Data":"ab0cc92cbae0a6c1086e274fd1e9e508ed285140186d3da7e272e6e7faa4b6ee"}
Jun 01 21:43:24.598504 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:24.598446    2562 scope.go:117] "RemoveContainer" containerID="153aa407e1f9b2cb924439995679192ad5dd40b794c511f402dd66c807705dc5"
Jun 01 21:43:24.598859 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:24.598843    2562 scope.go:117] "RemoveContainer" containerID="ab0cc92cbae0a6c1086e274fd1e9e508ed285140186d3da7e272e6e7faa4b6ee"
Jun 01 21:43:24.599070 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:24.599048    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hdt9q_openshift-console-operator(bdfccc11-1004-479b-9687-1d056ee1b5c4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podUID="bdfccc11-1004-479b-9687-1d056ee1b5c4"
Jun 01 21:43:25.602201 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:25.602172    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:43:27.051034 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.050995    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:43:27.051396 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.051059    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:43:27.053434 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.053388    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/19155057-e59a-46c6-8d0d-6550843180dd-cert\") pod \"ingress-canary-kbh6p\" (UID: \"19155057-e59a-46c6-8d0d-6550843180dd\") " pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:43:27.053434 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.053402    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/39aea332-d0c6-40b9-b9df-9e38e7abea05-metrics-tls\") pod \"dns-default-8nhns\" (UID: \"39aea332-d0c6-40b9-b9df-9e38e7abea05\") " pod="openshift-dns/dns-default-8nhns"
Jun 01 21:43:27.321517 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.321398    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-6g4lx\""
Jun 01 21:43:27.329681 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.329661    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-8nhns"
Jun 01 21:43:27.332031 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.332016    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dqpsx\""
Jun 01 21:43:27.340857 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.340837    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-kbh6p"
Jun 01 21:43:27.467886 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.467851    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-8nhns"]
Jun 01 21:43:27.470931 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:27.470902    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod39aea332_d0c6_40b9_b9df_9e38e7abea05.slice/crio-c8ee60f993e5c10860d1a6b4b2a0a1a5c4d85a4936e33183951f18325ffee680 WatchSource:0}: Error finding container c8ee60f993e5c10860d1a6b4b2a0a1a5c4d85a4936e33183951f18325ffee680: Status 404 returned error can't find the container with id c8ee60f993e5c10860d1a6b4b2a0a1a5c4d85a4936e33183951f18325ffee680
Jun 01 21:43:27.481657 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.481621    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-kbh6p"]
Jun 01 21:43:27.486316 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:27.486286    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19155057_e59a_46c6_8d0d_6550843180dd.slice/crio-a93fcec5cd1115c71b1e39acceb1de16585436852831b4dd3ec70002a53d557f WatchSource:0}: Error finding container a93fcec5cd1115c71b1e39acceb1de16585436852831b4dd3ec70002a53d557f: Status 404 returned error can't find the container with id a93fcec5cd1115c71b1e39acceb1de16585436852831b4dd3ec70002a53d557f
Jun 01 21:43:27.556753 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.556716    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4qg9t"]
Jun 01 21:43:27.561519 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.561494    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.564144 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.564117    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jun 01 21:43:27.564291 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.564274    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jun 01 21:43:27.565287 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.565255    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jun 01 21:43:27.565287 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.565268    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n68nj\""
Jun 01 21:43:27.565492 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.565370    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jun 01 21:43:27.568960 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.568916    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4qg9t"]
Jun 01 21:43:27.608141 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.608068    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8nhns" event={"ID":"39aea332-d0c6-40b9-b9df-9e38e7abea05","Type":"ContainerStarted","Data":"c8ee60f993e5c10860d1a6b4b2a0a1a5c4d85a4936e33183951f18325ffee680"}
Jun 01 21:43:27.608960 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.608936    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kbh6p" event={"ID":"19155057-e59a-46c6-8d0d-6550843180dd","Type":"ContainerStarted","Data":"a93fcec5cd1115c71b1e39acceb1de16585436852831b4dd3ec70002a53d557f"}
Jun 01 21:43:27.656650 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.656612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d65bde5a-51e5-4599-9656-3f3aa8faaca7-data-volume\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.656782 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.656664    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d65bde5a-51e5-4599-9656-3f3aa8faaca7-crio-socket\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.656782 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.656682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d65bde5a-51e5-4599-9656-3f3aa8faaca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.656782 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.656741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d65bde5a-51e5-4599-9656-3f3aa8faaca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.656891 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.656799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p6s9g\" (UniqueName: \"kubernetes.io/projected/d65bde5a-51e5-4599-9656-3f3aa8faaca7-kube-api-access-p6s9g\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.757712 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.757675    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d65bde5a-51e5-4599-9656-3f3aa8faaca7-data-volume\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.757873 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.757732    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d65bde5a-51e5-4599-9656-3f3aa8faaca7-crio-socket\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.757873 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.757757    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d65bde5a-51e5-4599-9656-3f3aa8faaca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.757873 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.757788    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d65bde5a-51e5-4599-9656-3f3aa8faaca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.757873 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.757821    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-p6s9g\" (UniqueName: \"kubernetes.io/projected/d65bde5a-51e5-4599-9656-3f3aa8faaca7-kube-api-access-p6s9g\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.758121 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.757878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/d65bde5a-51e5-4599-9656-3f3aa8faaca7-crio-socket\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.758121 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.758020    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/d65bde5a-51e5-4599-9656-3f3aa8faaca7-data-volume\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.758293 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.758269    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/d65bde5a-51e5-4599-9656-3f3aa8faaca7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.760142 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.760126    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/d65bde5a-51e5-4599-9656-3f3aa8faaca7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.768976 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.768937    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p6s9g\" (UniqueName: \"kubernetes.io/projected/d65bde5a-51e5-4599-9656-3f3aa8faaca7-kube-api-access-p6s9g\") pod \"insights-runtime-extractor-4qg9t\" (UID: \"d65bde5a-51e5-4599-9656-3f3aa8faaca7\") " pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:27.871457 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:27.871424    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4qg9t"
Jun 01 21:43:28.012251 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:28.012213    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4qg9t"]
Jun 01 21:43:28.015662 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:28.015633    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd65bde5a_51e5_4599_9656_3f3aa8faaca7.slice/crio-e8495a5836ba9126b1e560ea2b0aac0f7145500a29d3f7c5f85f953f0b5cc719 WatchSource:0}: Error finding container e8495a5836ba9126b1e560ea2b0aac0f7145500a29d3f7c5f85f953f0b5cc719: Status 404 returned error can't find the container with id e8495a5836ba9126b1e560ea2b0aac0f7145500a29d3f7c5f85f953f0b5cc719
Jun 01 21:43:28.614344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:28.614303    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4qg9t" event={"ID":"d65bde5a-51e5-4599-9656-3f3aa8faaca7","Type":"ContainerStarted","Data":"9a67e7f8dcb81ae34e3531ef054cb1414446e895978a07178d9a518da3bcef5f"}
Jun 01 21:43:28.614771 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:28.614349    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4qg9t" event={"ID":"d65bde5a-51e5-4599-9656-3f3aa8faaca7","Type":"ContainerStarted","Data":"e8495a5836ba9126b1e560ea2b0aac0f7145500a29d3f7c5f85f953f0b5cc719"}
Jun 01 21:43:29.618344 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:29.618317    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4qg9t" event={"ID":"d65bde5a-51e5-4599-9656-3f3aa8faaca7","Type":"ContainerStarted","Data":"1b705cc8edc38cbff06456e6e44ee9ddbda341c9a060c5b0f612adba40a30a8c"}
Jun 01 21:43:29.619800 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:29.619779    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8nhns" event={"ID":"39aea332-d0c6-40b9-b9df-9e38e7abea05","Type":"ContainerStarted","Data":"0b59c152c9fd9e4a90b0b775ea32478606c733f2089ff833d51cf3b448dd46e5"}
Jun 01 21:43:29.619883 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:29.619805    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-8nhns" event={"ID":"39aea332-d0c6-40b9-b9df-9e38e7abea05","Type":"ContainerStarted","Data":"e4632972494452e67026966d48a92b4008581a195602d0f76cb0895103ef0566"}
Jun 01 21:43:29.619976 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:29.619957    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-8nhns"
Jun 01 21:43:29.638994 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:29.638955    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-dns/dns-default-8nhns" podStartSLOduration=65.303903567 podStartE2EDuration="1m6.638943114s" podCreationTimestamp="2026-06-01 21:42:23 +0000 UTC" firstStartedPulling="2026-06-01 21:43:27.472701515 +0000 UTC m=+98.779140759" lastFinishedPulling="2026-06-01 21:43:28.80774105 +0000 UTC m=+100.114180306" observedRunningTime="2026-06-01 21:43:29.637974461 +0000 UTC m=+100.944413722" watchObservedRunningTime="2026-06-01 21:43:29.638943114 +0000 UTC m=+100.945382377"
Jun 01 21:43:30.317541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:30.317506    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:30.317541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:30.317544    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:30.317911 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:30.317892    2562 scope.go:117] "RemoveContainer" containerID="ab0cc92cbae0a6c1086e274fd1e9e508ed285140186d3da7e272e6e7faa4b6ee"
Jun 01 21:43:30.318070 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:30.318053    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hdt9q_openshift-console-operator(bdfccc11-1004-479b-9687-1d056ee1b5c4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podUID="bdfccc11-1004-479b-9687-1d056ee1b5c4"
Jun 01 21:43:30.524232 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:30.524191    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-2f284"
Jun 01 21:43:30.624015 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:30.623979    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-kbh6p" event={"ID":"19155057-e59a-46c6-8d0d-6550843180dd","Type":"ContainerStarted","Data":"07ae3026387fcf4627e5fbbafdb22413ee8bb1d6cf4ce887b1a911a1fb5e9dbf"}
Jun 01 21:43:30.640221 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:30.640155    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-kbh6p" podStartSLOduration=65.551886549 podStartE2EDuration="1m7.640134487s" podCreationTimestamp="2026-06-01 21:42:23 +0000 UTC" firstStartedPulling="2026-06-01 21:43:27.488334878 +0000 UTC m=+98.794774121" lastFinishedPulling="2026-06-01 21:43:29.576582817 +0000 UTC m=+100.883022059" observedRunningTime="2026-06-01 21:43:30.639276415 +0000 UTC m=+101.945715679" watchObservedRunningTime="2026-06-01 21:43:30.640134487 +0000 UTC m=+101.946573751"
Jun 01 21:43:31.628383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:31.628346    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4qg9t" event={"ID":"d65bde5a-51e5-4599-9656-3f3aa8faaca7","Type":"ContainerStarted","Data":"4af9c7dc3d652f60744795fccf943c3f42bd4c588a39c335a25a12515c746b34"}
Jun 01 21:43:31.647393 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:31.647323    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4qg9t" podStartSLOduration=1.4761620579999999 podStartE2EDuration="4.647304933s" podCreationTimestamp="2026-06-01 21:43:27 +0000 UTC" firstStartedPulling="2026-06-01 21:43:28.10927829 +0000 UTC m=+99.415717549" lastFinishedPulling="2026-06-01 21:43:31.280420969 +0000 UTC m=+102.586860424" observedRunningTime="2026-06-01 21:43:31.644909895 +0000 UTC m=+102.951349162" watchObservedRunningTime="2026-06-01 21:43:31.647304933 +0000 UTC m=+102.953744197"
Jun 01 21:43:34.927166 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:34.927137    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"]
Jun 01 21:43:34.929994 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:34.929977    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"
Jun 01 21:43:34.933293 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:34.933263    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jun 01 21:43:34.933293 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:34.933271    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-v2jgm\""
Jun 01 21:43:34.941446 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:34.941420    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"]
Jun 01 21:43:35.020626 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:35.020580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aae2e291-860b-4427-88fe-f044b6b1aba9-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-flc48\" (UID: \"aae2e291-860b-4427-88fe-f044b6b1aba9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"
Jun 01 21:43:35.121890 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:35.121847    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aae2e291-860b-4427-88fe-f044b6b1aba9-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-flc48\" (UID: \"aae2e291-860b-4427-88fe-f044b6b1aba9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"
Jun 01 21:43:35.124190 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:35.124170    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/aae2e291-860b-4427-88fe-f044b6b1aba9-tls-certificates\") pod \"prometheus-operator-admission-webhook-59b7f8756b-flc48\" (UID: \"aae2e291-860b-4427-88fe-f044b6b1aba9\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"
Jun 01 21:43:35.238781 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:35.238687    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"
Jun 01 21:43:35.360094 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:35.360063    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"]
Jun 01 21:43:35.364595 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:35.364564    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae2e291_860b_4427_88fe_f044b6b1aba9.slice/crio-e02248f648eb6d605b5876beb399421f5894147b0459206414d7864040b4315d WatchSource:0}: Error finding container e02248f648eb6d605b5876beb399421f5894147b0459206414d7864040b4315d: Status 404 returned error can't find the container with id e02248f648eb6d605b5876beb399421f5894147b0459206414d7864040b4315d
Jun 01 21:43:35.640948 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:35.640908    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48" event={"ID":"aae2e291-860b-4427-88fe-f044b6b1aba9","Type":"ContainerStarted","Data":"e02248f648eb6d605b5876beb399421f5894147b0459206414d7864040b4315d"}
Jun 01 21:43:37.646627 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:37.646588    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48" event={"ID":"aae2e291-860b-4427-88fe-f044b6b1aba9","Type":"ContainerStarted","Data":"a8cd05567f602540be743b4f939a81ab333ce36d46cdb96f1c9196063be80266"}
Jun 01 21:43:37.647199 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:37.646812    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"
Jun 01 21:43:37.651502 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:37.651480    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48"
Jun 01 21:43:37.660997 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:37.660961    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-59b7f8756b-flc48" podStartSLOduration=2.373653057 podStartE2EDuration="3.660950733s" podCreationTimestamp="2026-06-01 21:43:34 +0000 UTC" firstStartedPulling="2026-06-01 21:43:35.366398551 +0000 UTC m=+106.672837793" lastFinishedPulling="2026-06-01 21:43:36.653696213 +0000 UTC m=+107.960135469" observedRunningTime="2026-06-01 21:43:37.660795972 +0000 UTC m=+108.967235236" watchObservedRunningTime="2026-06-01 21:43:37.660950733 +0000 UTC m=+108.967389997"
Jun 01 21:43:39.626001 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:39.625969    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-8nhns"
Jun 01 21:43:42.231077 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.231043    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"]
Jun 01 21:43:42.233103 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.233086    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.235794 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.235766    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\""
Jun 01 21:43:42.235794 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.235783    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jun 01 21:43:42.235982 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.235783    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\""
Jun 01 21:43:42.235982 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.235784    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jun 01 21:43:42.237002 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.236980    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jun 01 21:43:42.237002 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.236982    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2mzlb\""
Jun 01 21:43:42.244581 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.244556    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"]
Jun 01 21:43:42.366897 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.366863    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-wvz4d"]
Jun 01 21:43:42.369014 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.368998    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.371567 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.371544    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jun 01 21:43:42.371567 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.371557    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jun 01 21:43:42.371760 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.371615    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hq6rf\""
Jun 01 21:43:42.371760 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.371633    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jun 01 21:43:42.382266 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.382246    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15543026-23b0-44ba-8564-5cd9e348cc69-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.382361 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.382296    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15543026-23b0-44ba-8564-5cd9e348cc69-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.382361 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.382339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qwk4\" (UniqueName: \"kubernetes.io/projected/15543026-23b0-44ba-8564-5cd9e348cc69-kube-api-access-8qwk4\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.382453 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.382394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15543026-23b0-44ba-8564-5cd9e348cc69-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.483159 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483068    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15543026-23b0-44ba-8564-5cd9e348cc69-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.483159 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483106    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-8qwk4\" (UniqueName: \"kubernetes.io/projected/15543026-23b0-44ba-8564-5cd9e348cc69-kube-api-access-8qwk4\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.483159 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483167    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-textfile\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483187    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-sys\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483209    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twxg5\" (UniqueName: \"kubernetes.io/projected/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-kube-api-access-twxg5\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483241    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-metrics-client-ca\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483300    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15543026-23b0-44ba-8564-5cd9e348cc69-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.483394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-wtmp\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483646 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483646 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483525    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-tls\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.483646 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483550    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15543026-23b0-44ba-8564-5cd9e348cc69-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.483646 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.483574    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-root\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.484175 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.484153    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/15543026-23b0-44ba-8564-5cd9e348cc69-metrics-client-ca\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.485752 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.485731    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/15543026-23b0-44ba-8564-5cd9e348cc69-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.485840 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.485810    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/15543026-23b0-44ba-8564-5cd9e348cc69-openshift-state-metrics-tls\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.490696 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.490676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qwk4\" (UniqueName: \"kubernetes.io/projected/15543026-23b0-44ba-8564-5cd9e348cc69-kube-api-access-8qwk4\") pod \"openshift-state-metrics-85658796db-jd8bl\" (UID: \"15543026-23b0-44ba-8564-5cd9e348cc69\") " pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.544523 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.544485    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"
Jun 01 21:43:42.584862 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.584827    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-tls\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.584862 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.584866    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-root\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585099 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.584929    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-root\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585099 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:42.584988    2562 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jun 01 21:43:42.585099 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585013    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585099 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:42.585075    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-tls podName:1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f nodeName:}" failed. No retries permitted until 2026-06-01 21:43:43.085052208 +0000 UTC m=+114.391491470 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-tls") pod "node-exporter-wvz4d" (UID: "1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f") : secret "node-exporter-tls" not found
Jun 01 21:43:42.585307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585099    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-textfile\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585133    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-sys\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585168    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-twxg5\" (UniqueName: \"kubernetes.io/projected/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-kube-api-access-twxg5\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585210    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-metrics-client-ca\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585244    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-wtmp\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585273    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585635 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585502    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-wtmp\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585635 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585518    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-textfile\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585635 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-sys\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585893 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585872    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-accelerators-collector-config\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.585988 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.585967    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-metrics-client-ca\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.587303 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.587285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.594851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.594829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twxg5\" (UniqueName: \"kubernetes.io/projected/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-kube-api-access-twxg5\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:42.675554 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:42.675502    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-85658796db-jd8bl"]
Jun 01 21:43:42.680344 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:42.680309    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15543026_23b0_44ba_8564_5cd9e348cc69.slice/crio-f48ca8935fd76e3503dbb88d6a37aee27f8ed15b5bb048b4e79033f7d864e1be WatchSource:0}: Error finding container f48ca8935fd76e3503dbb88d6a37aee27f8ed15b5bb048b4e79033f7d864e1be: Status 404 returned error can't find the container with id f48ca8935fd76e3503dbb88d6a37aee27f8ed15b5bb048b4e79033f7d864e1be
Jun 01 21:43:43.090584 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.090483    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-tls\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:43.092808 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.092783    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f-node-exporter-tls\") pod \"node-exporter-wvz4d\" (UID: \"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f\") " pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:43.278628 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.278585    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-wvz4d"
Jun 01 21:43:43.286509 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:43.286474    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f62b7fd_4ba7_4e6b_ab5f_cec4c2179c2f.slice/crio-117540767afb28606a0ed8f9dc8c746e9a4c03c6cb44835ea9a17cdadd1a07bb WatchSource:0}: Error finding container 117540767afb28606a0ed8f9dc8c746e9a4c03c6cb44835ea9a17cdadd1a07bb: Status 404 returned error can't find the container with id 117540767afb28606a0ed8f9dc8c746e9a4c03c6cb44835ea9a17cdadd1a07bb
Jun 01 21:43:43.451028 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.450988    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:43:43.453622 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.453602    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.456175 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456154    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 01 21:43:43.456288 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456243    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 01 21:43:43.456288 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456245    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 01 21:43:43.456399 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456265    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 01 21:43:43.456648 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456626    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 01 21:43:43.456721 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456677    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 01 21:43:43.456721 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456709    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 01 21:43:43.456819 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456738    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 01 21:43:43.456819 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456774    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4mwzz\""
Jun 01 21:43:43.456819 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.456637    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 01 21:43:43.473529 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.473501    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:43:43.593610 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-config-out\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593610 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593618    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmmk8\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-kube-api-access-gmmk8\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593804 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593641    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-config-volume\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593804 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593660    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593804 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593726    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593804 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593759    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593804 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593783    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593804 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593798    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593983 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593983 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593983 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593886    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593983 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593923    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.593983 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.593948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-web-config\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.664831 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.664792    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl" event={"ID":"15543026-23b0-44ba-8564-5cd9e348cc69","Type":"ContainerStarted","Data":"471f1be22c12296a62f82ebefba8aa1170d280de49113fc6690e1d481aca724e"}
Jun 01 21:43:43.664831 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.664835    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl" event={"ID":"15543026-23b0-44ba-8564-5cd9e348cc69","Type":"ContainerStarted","Data":"a988aa1aca1cb17d56a7a8d7a685cf452c49dc8dd8b74122e94fbcd086333349"}
Jun 01 21:43:43.665063 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.664848    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl" event={"ID":"15543026-23b0-44ba-8564-5cd9e348cc69","Type":"ContainerStarted","Data":"f48ca8935fd76e3503dbb88d6a37aee27f8ed15b5bb048b4e79033f7d864e1be"}
Jun 01 21:43:43.665992 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.665961    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvz4d" event={"ID":"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f","Type":"ContainerStarted","Data":"117540767afb28606a0ed8f9dc8c746e9a4c03c6cb44835ea9a17cdadd1a07bb"}
Jun 01 21:43:43.694691 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.694640    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-config-out\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.694860 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.694701    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gmmk8\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-kube-api-access-gmmk8\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.694860 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.694825    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-config-volume\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.694962 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.694857    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695083 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695058    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695101    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695132    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695156    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695190    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695232    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695515 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695262    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695515 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695295    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.695515 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695329    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-web-config\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.696334 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:43.695756    2562 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found
Jun 01 21:43:43.696334 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:43.695825    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls podName:d68c0106-a696-412f-a57e-aa4b64577f23 nodeName:}" failed. No retries permitted until 2026-06-01 21:43:44.195804015 +0000 UTC m=+115.502243259 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23") : secret "alertmanager-main-tls" not found
Jun 01 21:43:43.696334 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.695865    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.696571 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.696455    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.698472 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.698108    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-config-volume\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.698472 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.698368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.698813 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.698776    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.699290 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.699246    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-web-config\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.699462 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.699441    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.701986 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.701927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.702274 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.702254    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-tls-assets\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.702400 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.702371    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.703623 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.703598    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-config-out\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:43.703980 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:43.703956    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmmk8\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-kube-api-access-gmmk8\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:44.200127 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.200098    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:44.202561 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.202537    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:44.302078 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.302042    2562 scope.go:117] "RemoveContainer" containerID="ab0cc92cbae0a6c1086e274fd1e9e508ed285140186d3da7e272e6e7faa4b6ee"
Jun 01 21:43:44.302458 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:43:44.302255    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-86d7c6cc77-hdt9q_openshift-console-operator(bdfccc11-1004-479b-9687-1d056ee1b5c4)\"" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podUID="bdfccc11-1004-479b-9687-1d056ee1b5c4"
Jun 01 21:43:44.365153 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.365119    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:43:44.501937 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.501913    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:43:44.503887 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:44.503845    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd68c0106_a696_412f_a57e_aa4b64577f23.slice/crio-0cf15651d956c356fc12de30f490cec4fd91f5e9af50e7eca10ae4cdf80e12f1 WatchSource:0}: Error finding container 0cf15651d956c356fc12de30f490cec4fd91f5e9af50e7eca10ae4cdf80e12f1: Status 404 returned error can't find the container with id 0cf15651d956c356fc12de30f490cec4fd91f5e9af50e7eca10ae4cdf80e12f1
Jun 01 21:43:44.669826 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.669785    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl" event={"ID":"15543026-23b0-44ba-8564-5cd9e348cc69","Type":"ContainerStarted","Data":"b543e53aed22f83d9c92f6fff7d1387a643e8b1b7b5848d9ff96a6889fdcd13d"}
Jun 01 21:43:44.671094 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.671066    2562 generic.go:358] "Generic (PLEG): container finished" podID="1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f" containerID="723bed8b82870a35320a87e6deb2c8348e62cefa0366c68cd3c96951d6a9f2ce" exitCode=0
Jun 01 21:43:44.671231 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.671128    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvz4d" event={"ID":"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f","Type":"ContainerDied","Data":"723bed8b82870a35320a87e6deb2c8348e62cefa0366c68cd3c96951d6a9f2ce"}
Jun 01 21:43:44.672096 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.672070    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerStarted","Data":"0cf15651d956c356fc12de30f490cec4fd91f5e9af50e7eca10ae4cdf80e12f1"}
Jun 01 21:43:44.689588 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:44.689471    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-85658796db-jd8bl" podStartSLOduration=1.299919589 podStartE2EDuration="2.689456749s" podCreationTimestamp="2026-06-01 21:43:42 +0000 UTC" firstStartedPulling="2026-06-01 21:43:42.802088441 +0000 UTC m=+114.108527692" lastFinishedPulling="2026-06-01 21:43:44.191625593 +0000 UTC m=+115.498064852" observedRunningTime="2026-06-01 21:43:44.688137594 +0000 UTC m=+115.994576859" watchObservedRunningTime="2026-06-01 21:43:44.689456749 +0000 UTC m=+115.995896012"
Jun 01 21:43:45.442295 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.442259    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"]
Jun 01 21:43:45.446150 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.446127    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.448700 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.448678    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\""
Jun 01 21:43:45.449036 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.448927    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-7j71fmfjdb4rt\""
Jun 01 21:43:45.449132 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.449052    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-pjsvk\""
Jun 01 21:43:45.449193 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.449134    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\""
Jun 01 21:43:45.449193 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.449139    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\""
Jun 01 21:43:45.449327 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.449303    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\""
Jun 01 21:43:45.449327 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.449322    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\""
Jun 01 21:43:45.461595 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.461572    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"]
Jun 01 21:43:45.510134 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510098    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.510294 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510150    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d78942d-e136-42e8-be2c-7c547d42db20-metrics-client-ca\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.510294 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510224    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.510383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-tls\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.510383 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.510500 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.510500 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510493    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-grpc-tls\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.510573 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.510522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55qrh\" (UniqueName: \"kubernetes.io/projected/6d78942d-e136-42e8-be2c-7c547d42db20-kube-api-access-55qrh\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.610977 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.610936    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611150 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611025    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-grpc-tls\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611150 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611052    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55qrh\" (UniqueName: \"kubernetes.io/projected/6d78942d-e136-42e8-be2c-7c547d42db20-kube-api-access-55qrh\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611150 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611088    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611150 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611120    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d78942d-e136-42e8-be2c-7c547d42db20-metrics-client-ca\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611150 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611153    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611441 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611192    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-tls\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611441 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611221    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.611910 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.611853    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/6d78942d-e136-42e8-be2c-7c547d42db20-metrics-client-ca\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.614827 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.614340    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.614827 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.614573    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-tls\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.614827 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.614814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.615007 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.614919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.615064 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.615012    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-grpc-tls\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.615332 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.615315    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/6d78942d-e136-42e8-be2c-7c547d42db20-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.622448 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.622423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55qrh\" (UniqueName: \"kubernetes.io/projected/6d78942d-e136-42e8-be2c-7c547d42db20-kube-api-access-55qrh\") pod \"thanos-querier-7c78bb6b7b-n7wkw\" (UID: \"6d78942d-e136-42e8-be2c-7c547d42db20\") " pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.677750 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.677708    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvz4d" event={"ID":"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f","Type":"ContainerStarted","Data":"9761c23525fb814394b3eea0db22e301995ac920a971aa435424f31c0fa8e0b8"}
Jun 01 21:43:45.677750 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.677753    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-wvz4d" event={"ID":"1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f","Type":"ContainerStarted","Data":"0102827d53b5acaa8fc2ec9901829549f2c4eb0bb87c774bda70b6c40288b5db"}
Jun 01 21:43:45.698171 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.698061    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-wvz4d" podStartSLOduration=2.792460762 podStartE2EDuration="3.698046102s" podCreationTimestamp="2026-06-01 21:43:42 +0000 UTC" firstStartedPulling="2026-06-01 21:43:43.288204147 +0000 UTC m=+114.594643390" lastFinishedPulling="2026-06-01 21:43:44.193789473 +0000 UTC m=+115.500228730" observedRunningTime="2026-06-01 21:43:45.696776443 +0000 UTC m=+117.003215709" watchObservedRunningTime="2026-06-01 21:43:45.698046102 +0000 UTC m=+117.004485367"
Jun 01 21:43:45.757264 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.757227    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:45.906274 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:45.906227    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"]
Jun 01 21:43:45.920359 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:45.920326    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d78942d_e136_42e8_be2c_7c547d42db20.slice/crio-f459953a3babc24248b33fb31a59b0559d3a59aa1a2c74f3da2bd25d74cf93d1 WatchSource:0}: Error finding container f459953a3babc24248b33fb31a59b0559d3a59aa1a2c74f3da2bd25d74cf93d1: Status 404 returned error can't find the container with id f459953a3babc24248b33fb31a59b0559d3a59aa1a2c74f3da2bd25d74cf93d1
Jun 01 21:43:46.682065 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.682018    2562 generic.go:358] "Generic (PLEG): container finished" podID="d68c0106-a696-412f-a57e-aa4b64577f23" containerID="d3f1b9356be8f67c8d26dbe674e0ea74d52cb38e67c176508d7f7c78f6dc0d10" exitCode=0
Jun 01 21:43:46.682525 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.682090    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"d3f1b9356be8f67c8d26dbe674e0ea74d52cb38e67c176508d7f7c78f6dc0d10"}
Jun 01 21:43:46.683268 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.683246    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" event={"ID":"6d78942d-e136-42e8-be2c-7c547d42db20","Type":"ContainerStarted","Data":"f459953a3babc24248b33fb31a59b0559d3a59aa1a2c74f3da2bd25d74cf93d1"}
Jun 01 21:43:46.746373 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.746337    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"]
Jun 01 21:43:46.749799 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.749776    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.752542 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.752512    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jun 01 21:43:46.752687 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.752591    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\""
Jun 01 21:43:46.752805 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.752709    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\""
Jun 01 21:43:46.752805 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.752731    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-tqkl6\""
Jun 01 21:43:46.752919 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.752810    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\""
Jun 01 21:43:46.753043 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.753025    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-1cmmqkms8jrrv\""
Jun 01 21:43:46.758163 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.758024    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"]
Jun 01 21:43:46.823502 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.823463    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-secret-metrics-server-tls\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.823665 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.823520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-secret-metrics-server-client-certs\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.823665 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.823600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.823665 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.823637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v9gft\" (UniqueName: \"kubernetes.io/projected/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-kube-api-access-v9gft\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.823794 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.823678    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-audit-log\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.823794 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.823705    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-client-ca-bundle\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.823794 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.823723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-metrics-server-audit-profiles\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.924673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.924579    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-secret-metrics-server-tls\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.924673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.924646    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-secret-metrics-server-client-certs\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.924898 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.924690    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.924898 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.924717    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-v9gft\" (UniqueName: \"kubernetes.io/projected/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-kube-api-access-v9gft\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.924898 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.924820    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-audit-log\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.925053 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.925017    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-client-ca-bundle\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.925139 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.925059    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-metrics-server-audit-profiles\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.925203 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.925171    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-audit-log\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.925557 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.925534    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.926020 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.925998    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-metrics-server-audit-profiles\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.927763 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.927718    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-secret-metrics-server-tls\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.927872 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.927798    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-secret-metrics-server-client-certs\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.927934 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.927887    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-client-ca-bundle\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:46.938342 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:46.938309    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v9gft\" (UniqueName: \"kubernetes.io/projected/7830270f-ba79-4c68-91fd-4e7bbc8ed9eb-kube-api-access-v9gft\") pod \"metrics-server-6f857d9dc4-g9cpj\" (UID: \"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb\") " pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:47.061877 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.061836    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:43:47.122636 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.122608    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"]
Jun 01 21:43:47.127147 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.127122    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"
Jun 01 21:43:47.129644 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.129589    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jun 01 21:43:47.129760 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.129719    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"default-dockercfg-g796z\""
Jun 01 21:43:47.132865 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.132843    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"]
Jun 01 21:43:47.200629 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.200533    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"]
Jun 01 21:43:47.203709 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:47.203678    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7830270f_ba79_4c68_91fd_4e7bbc8ed9eb.slice/crio-eadde6ab714a7257d3b664388550eac9fa02453cdd4d2b4d47cb621fe68b1f70 WatchSource:0}: Error finding container eadde6ab714a7257d3b664388550eac9fa02453cdd4d2b4d47cb621fe68b1f70: Status 404 returned error can't find the container with id eadde6ab714a7257d3b664388550eac9fa02453cdd4d2b4d47cb621fe68b1f70
Jun 01 21:43:47.227586 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.227558    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/caedf641-1e6a-413f-a6c2-790692116512-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-f85kn\" (UID: \"caedf641-1e6a-413f-a6c2-790692116512\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"
Jun 01 21:43:47.329054 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.329014    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/caedf641-1e6a-413f-a6c2-790692116512-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-f85kn\" (UID: \"caedf641-1e6a-413f-a6c2-790692116512\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"
Jun 01 21:43:47.332274 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.332221    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/caedf641-1e6a-413f-a6c2-790692116512-monitoring-plugin-cert\") pod \"monitoring-plugin-5768fcc9dd-f85kn\" (UID: \"caedf641-1e6a-413f-a6c2-790692116512\") " pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"
Jun 01 21:43:47.438765 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.438732    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"
Jun 01 21:43:47.583884 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.583842    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"]
Jun 01 21:43:47.587281 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:47.587253    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaedf641_1e6a_413f_a6c2_790692116512.slice/crio-cfe0dc029005c7f231c5f82a7ffbac0c9df888a89267d70939f5cb134680cd4e WatchSource:0}: Error finding container cfe0dc029005c7f231c5f82a7ffbac0c9df888a89267d70939f5cb134680cd4e: Status 404 returned error can't find the container with id cfe0dc029005c7f231c5f82a7ffbac0c9df888a89267d70939f5cb134680cd4e
Jun 01 21:43:47.687589 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.687531    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn" event={"ID":"caedf641-1e6a-413f-a6c2-790692116512","Type":"ContainerStarted","Data":"cfe0dc029005c7f231c5f82a7ffbac0c9df888a89267d70939f5cb134680cd4e"}
Jun 01 21:43:47.688645 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:47.688608    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj" event={"ID":"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb","Type":"ContainerStarted","Data":"eadde6ab714a7257d3b664388550eac9fa02453cdd4d2b4d47cb621fe68b1f70"}
Jun 01 21:43:48.654862 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.654824    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:43:48.661668 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.661631    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.664627 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.664602    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 01 21:43:48.665206 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.664942    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2hods8opk90i0\""
Jun 01 21:43:48.665206 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.664945    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 01 21:43:48.665206 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.664974    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 01 21:43:48.665206 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.665039    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xd5l2\""
Jun 01 21:43:48.665206 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.664946    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 01 21:43:48.665593 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.665212    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 01 21:43:48.665593 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.665291    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 01 21:43:48.665593 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.665370    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 01 21:43:48.665593 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.665585    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 01 21:43:48.665830 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.665810    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 01 21:43:48.666032 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.666012    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 01 21:43:48.666120 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.666069    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 01 21:43:48.669483 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.669461    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 01 21:43:48.674855 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.674830    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:43:48.743316 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743319    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-config\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743452    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743488    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743565    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743593    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743710    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743728    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.743758 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743743    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gccz8\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-kube-api-access-gccz8\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.744187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743767    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.744187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743795    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.744187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743841    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.744187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743870    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.744187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.743900    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845388 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845343    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845591 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845445    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845591 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845478    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845591 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845521    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-config\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845591 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845550    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845591 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845582    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845837 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845611    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845837 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845648    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845837 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845723    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.845837 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.845767    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.846909 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.846504    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.846909 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.846579    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.846909 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.846903    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.847531    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.847584    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.847615    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-gccz8\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-kube-api-access-gccz8\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.847657    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.847687    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.847729    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.847755    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.848208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.848113    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.848450    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.848792    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.849160    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.849316    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.851832    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.852156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-config-out\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.852706    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.852735    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.853021    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.854098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.853169    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.855498 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.855451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.855984 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.855961    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-web-config\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.856556 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.856534    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-config\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.858250 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.858230    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gccz8\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-kube-api-access-gccz8\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.858806 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.858766    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:48.975617 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:48.975516    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:49.783650 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:49.783597    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:43:49.789941 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:49.789903    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5a93c891_b8bc_425a_82f5_87b9f09fac72.slice/crio-852609e268e33d2c711c69770b7b22d85e66d11cb21c48bcfbfadc6996320ebb WatchSource:0}: Error finding container 852609e268e33d2c711c69770b7b22d85e66d11cb21c48bcfbfadc6996320ebb: Status 404 returned error can't find the container with id 852609e268e33d2c711c69770b7b22d85e66d11cb21c48bcfbfadc6996320ebb
Jun 01 21:43:50.704884 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.704855    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerStarted","Data":"9732ae6e37e6258410976b1c047a45d7c1bbe40684c094a6f35f1644cb336f88"}
Jun 01 21:43:50.705008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.704891    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerStarted","Data":"cad8685355650b1d6753eb1c6ba4229b4a84c6a8505d5021edd627a8f1205549"}
Jun 01 21:43:50.705008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.704906    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerStarted","Data":"f7fd64bb2574295f9ff1ea19535681331a94ffba3bad78267fbd0e05377650bb"}
Jun 01 21:43:50.705008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.704919    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerStarted","Data":"e77357d7e9da0eccce29e58f7e9a71f837e7a10a843970a4167e5fc8ad9a20e9"}
Jun 01 21:43:50.705008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.704932    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerStarted","Data":"42bf9249393764c0af116da0a1ad13496f111cd05680ea73b10776184e8c4f7e"}
Jun 01 21:43:50.706056 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.706021    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn" event={"ID":"caedf641-1e6a-413f-a6c2-790692116512","Type":"ContainerStarted","Data":"9afb0ae2ad092d5b7affee79911653fb2b428c204edb31c86059f076c1ec15ed"}
Jun 01 21:43:50.706396 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.706378    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"
Jun 01 21:43:50.707483 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.707462    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9" exitCode=0
Jun 01 21:43:50.707563 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.707525    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"}
Jun 01 21:43:50.707563 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.707556    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerStarted","Data":"852609e268e33d2c711c69770b7b22d85e66d11cb21c48bcfbfadc6996320ebb"}
Jun 01 21:43:50.709565 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.709534    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" event={"ID":"6d78942d-e136-42e8-be2c-7c547d42db20","Type":"ContainerStarted","Data":"52309892580b0d85ea3b83550ce5662dc4a6558155089a28b7bc1c9d99b5bd50"}
Jun 01 21:43:50.709565 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.709564    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" event={"ID":"6d78942d-e136-42e8-be2c-7c547d42db20","Type":"ContainerStarted","Data":"baa78d9cd6640cf2c49c78f01fd4f21e8a242b79c3fd8e6fac075242e119befd"}
Jun 01 21:43:50.709689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.709577    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" event={"ID":"6d78942d-e136-42e8-be2c-7c547d42db20","Type":"ContainerStarted","Data":"afea1884b5d982cff36e7066899f227d720df0d06a06be73d197cd062b7729f1"}
Jun 01 21:43:50.710903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.710883    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj" event={"ID":"7830270f-ba79-4c68-91fd-4e7bbc8ed9eb","Type":"ContainerStarted","Data":"40e2cb696a8fe962032a82a4516af4edb77f2e4ee571a0c46c2ea244945cc918"}
Jun 01 21:43:50.712594 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.712577    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn"
Jun 01 21:43:50.724508 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:50.724433    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5768fcc9dd-f85kn" podStartSLOduration=1.6310300359999998 podStartE2EDuration="3.724399614s" podCreationTimestamp="2026-06-01 21:43:47 +0000 UTC" firstStartedPulling="2026-06-01 21:43:47.589118812 +0000 UTC m=+118.895558054" lastFinishedPulling="2026-06-01 21:43:49.68248839 +0000 UTC m=+120.988927632" observedRunningTime="2026-06-01 21:43:50.720338526 +0000 UTC m=+122.026777802" watchObservedRunningTime="2026-06-01 21:43:50.724399614 +0000 UTC m=+122.030838875"
Jun 01 21:43:51.717757 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.717717    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" event={"ID":"6d78942d-e136-42e8-be2c-7c547d42db20","Type":"ContainerStarted","Data":"c519a6029bed0c709e2e81860f6350440fbc49331b39614bef94ab4d71c8dd9f"}
Jun 01 21:43:51.717757 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.717766    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" event={"ID":"6d78942d-e136-42e8-be2c-7c547d42db20","Type":"ContainerStarted","Data":"8994abceee944544f6a46be67c7db29804a76f600ef05e47bacf74e4b6e41985"}
Jun 01 21:43:51.718263 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.717784    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" event={"ID":"6d78942d-e136-42e8-be2c-7c547d42db20","Type":"ContainerStarted","Data":"93e562f0141e12f750fe061d016828816611e9544367fd19c3503c5ee9dd8d3e"}
Jun 01 21:43:51.718263 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.717869    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:51.721608 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.721579    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerStarted","Data":"424069859fad9155ebbeeb27cdb145af5b8ed43b29d93158da6a43974922f621"}
Jun 01 21:43:51.741719 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.741644    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj" podStartSLOduration=3.32914328 podStartE2EDuration="5.741625586s" podCreationTimestamp="2026-06-01 21:43:46 +0000 UTC" firstStartedPulling="2026-06-01 21:43:47.206276695 +0000 UTC m=+118.512715957" lastFinishedPulling="2026-06-01 21:43:49.618759016 +0000 UTC m=+120.925198263" observedRunningTime="2026-06-01 21:43:50.779912184 +0000 UTC m=+122.086351449" watchObservedRunningTime="2026-06-01 21:43:51.741625586 +0000 UTC m=+123.048064893"
Jun 01 21:43:51.741889 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.741830    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw" podStartSLOduration=1.970272648 podStartE2EDuration="6.741822135s" podCreationTimestamp="2026-06-01 21:43:45 +0000 UTC" firstStartedPulling="2026-06-01 21:43:45.922462002 +0000 UTC m=+117.228901245" lastFinishedPulling="2026-06-01 21:43:50.69401149 +0000 UTC m=+122.000450732" observedRunningTime="2026-06-01 21:43:51.740633054 +0000 UTC m=+123.047072319" watchObservedRunningTime="2026-06-01 21:43:51.741822135 +0000 UTC m=+123.048261399"
Jun 01 21:43:51.765533 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:51.765205    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.555472129 podStartE2EDuration="8.765183849s" podCreationTimestamp="2026-06-01 21:43:43 +0000 UTC" firstStartedPulling="2026-06-01 21:43:44.50580429 +0000 UTC m=+115.812243532" lastFinishedPulling="2026-06-01 21:43:50.715515993 +0000 UTC m=+122.021955252" observedRunningTime="2026-06-01 21:43:51.763246782 +0000 UTC m=+123.069686045" watchObservedRunningTime="2026-06-01 21:43:51.765183849 +0000 UTC m=+123.071623114"
Jun 01 21:43:54.735098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:54.735063    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerStarted","Data":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"}
Jun 01 21:43:54.735098 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:54.735100    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerStarted","Data":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"}
Jun 01 21:43:54.735527 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:54.735112    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerStarted","Data":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"}
Jun 01 21:43:54.735527 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:54.735135    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerStarted","Data":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"}
Jun 01 21:43:54.735527 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:54.735143    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerStarted","Data":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"}
Jun 01 21:43:54.735527 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:54.735152    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerStarted","Data":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"}
Jun 01 21:43:54.761474 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:54.761392    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.51090826 podStartE2EDuration="6.761373433s" podCreationTimestamp="2026-06-01 21:43:48 +0000 UTC" firstStartedPulling="2026-06-01 21:43:50.712797051 +0000 UTC m=+122.019236293" lastFinishedPulling="2026-06-01 21:43:53.963262222 +0000 UTC m=+125.269701466" observedRunningTime="2026-06-01 21:43:54.760117419 +0000 UTC m=+126.066556684" watchObservedRunningTime="2026-06-01 21:43:54.761373433 +0000 UTC m=+126.067812698"
Jun 01 21:43:56.302734 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:56.302700    2562 scope.go:117] "RemoveContainer" containerID="ab0cc92cbae0a6c1086e274fd1e9e508ed285140186d3da7e272e6e7faa4b6ee"
Jun 01 21:43:56.742143 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:56.742115    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:43:56.742320 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:56.742204    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" event={"ID":"bdfccc11-1004-479b-9687-1d056ee1b5c4","Type":"ContainerStarted","Data":"61e6c24249c414ce67dc748466b1a6013f6ee0b8e5cf629caf077873929f9fb9"}
Jun 01 21:43:56.742477 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:56.742447    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:56.747258 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:56.747239    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q"
Jun 01 21:43:56.757909 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:56.757870    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-console-operator/console-operator-86d7c6cc77-hdt9q" podStartSLOduration=54.859299295 podStartE2EDuration="57.757857108s" podCreationTimestamp="2026-06-01 21:42:59 +0000 UTC" firstStartedPulling="2026-06-01 21:43:00.457313703 +0000 UTC m=+71.763752958" lastFinishedPulling="2026-06-01 21:43:03.355871523 +0000 UTC m=+74.662310771" observedRunningTime="2026-06-01 21:43:56.757181764 +0000 UTC m=+128.063621066" watchObservedRunningTime="2026-06-01 21:43:56.757857108 +0000 UTC m=+128.064296371"
Jun 01 21:43:57.733062 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:57.733032    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7c78bb6b7b-n7wkw"
Jun 01 21:43:58.976497 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:58.976462    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:43:59.048983 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:59.048946    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:43:59.051512 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:59.051489    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/764970ef-ec62-4e03-a3a6-e5c3382b1d91-metrics-certs\") pod \"network-metrics-daemon-nc7qb\" (UID: \"764970ef-ec62-4e03-a3a6-e5c3382b1d91\") " pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:43:59.123600 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:59.123573    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-vgrbz\""
Jun 01 21:43:59.131926 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:59.131908    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-nc7qb"
Jun 01 21:43:59.249582 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:59.249506    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-nc7qb"]
Jun 01 21:43:59.252508 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:43:59.252477    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod764970ef_ec62_4e03_a3a6_e5c3382b1d91.slice/crio-75213a04234e2e04f1c7b2f1b39d0d4e313223b9c5ebb7fd065b57082c73c6ed WatchSource:0}: Error finding container 75213a04234e2e04f1c7b2f1b39d0d4e313223b9c5ebb7fd065b57082c73c6ed: Status 404 returned error can't find the container with id 75213a04234e2e04f1c7b2f1b39d0d4e313223b9c5ebb7fd065b57082c73c6ed
Jun 01 21:43:59.752741 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:43:59.752699    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nc7qb" event={"ID":"764970ef-ec62-4e03-a3a6-e5c3382b1d91","Type":"ContainerStarted","Data":"75213a04234e2e04f1c7b2f1b39d0d4e313223b9c5ebb7fd065b57082c73c6ed"}
Jun 01 21:44:01.761245 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:01.761206    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nc7qb" event={"ID":"764970ef-ec62-4e03-a3a6-e5c3382b1d91","Type":"ContainerStarted","Data":"8945b317c78dcb512c0dc7a111bb37184318c5b186d4fdb9348bebeed40bafe9"}
Jun 01 21:44:01.761245 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:01.761245    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-nc7qb" event={"ID":"764970ef-ec62-4e03-a3a6-e5c3382b1d91","Type":"ContainerStarted","Data":"fbbc1119f127a63b3df6e7d035f88b0f57065f040921c8adefade88bcb19146f"}
Jun 01 21:44:01.778376 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:01.778322    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-nc7qb" podStartSLOduration=131.360610481 podStartE2EDuration="2m12.7783074s" podCreationTimestamp="2026-06-01 21:41:49 +0000 UTC" firstStartedPulling="2026-06-01 21:43:59.254571781 +0000 UTC m=+130.561011026" lastFinishedPulling="2026-06-01 21:44:00.672268702 +0000 UTC m=+131.978707945" observedRunningTime="2026-06-01 21:44:01.776566307 +0000 UTC m=+133.083005572" watchObservedRunningTime="2026-06-01 21:44:01.7783074 +0000 UTC m=+133.084746686"
Jun 01 21:44:07.062958 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:07.062907    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:44:07.062958 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:07.062970    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:44:24.835032 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:24.834997    2562 generic.go:358] "Generic (PLEG): container finished" podID="b552103b-2d2f-4d1d-86ae-593b9b51bd15" containerID="f9190c438d06848f9120291a0a4d67e1f0976a38ef91460a3380164b93345d3d" exitCode=0
Jun 01 21:44:24.835433 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:24.835060    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms" event={"ID":"b552103b-2d2f-4d1d-86ae-593b9b51bd15","Type":"ContainerDied","Data":"f9190c438d06848f9120291a0a4d67e1f0976a38ef91460a3380164b93345d3d"}
Jun 01 21:44:24.835433 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:24.835365    2562 scope.go:117] "RemoveContainer" containerID="f9190c438d06848f9120291a0a4d67e1f0976a38ef91460a3380164b93345d3d"
Jun 01 21:44:25.839568 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:25.839535    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-96ddc787c-wr5ms" event={"ID":"b552103b-2d2f-4d1d-86ae-593b9b51bd15","Type":"ContainerStarted","Data":"a898d8f2dbbcb75979d1f6396a119a7a8081a6b9e125e0bfcad03cdf7722c261"}
Jun 01 21:44:27.067928 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:27.067884    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:44:27.071732 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:27.071708    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6f857d9dc4-g9cpj"
Jun 01 21:44:48.976653 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:48.976562    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:44:48.992356 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:48.992332    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:44:49.927393 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:44:49.927362    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:02.754046 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.754007    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:45:02.754587 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.754498    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="alertmanager" containerID="cri-o://42bf9249393764c0af116da0a1ad13496f111cd05680ea73b10776184e8c4f7e" gracePeriod=120
Jun 01 21:45:02.754662 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.754565    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-metric" containerID="cri-o://9732ae6e37e6258410976b1c047a45d7c1bbe40684c094a6f35f1644cb336f88" gracePeriod=120
Jun 01 21:45:02.754662 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.754592    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="config-reloader" containerID="cri-o://e77357d7e9da0eccce29e58f7e9a71f837e7a10a843970a4167e5fc8ad9a20e9" gracePeriod=120
Jun 01 21:45:02.754662 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.754621    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy" containerID="cri-o://cad8685355650b1d6753eb1c6ba4229b4a84c6a8505d5021edd627a8f1205549" gracePeriod=120
Jun 01 21:45:02.754789 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.754569    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-web" containerID="cri-o://f7fd64bb2574295f9ff1ea19535681331a94ffba3bad78267fbd0e05377650bb" gracePeriod=120
Jun 01 21:45:02.754789 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.754626    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="prom-label-proxy" containerID="cri-o://424069859fad9155ebbeeb27cdb145af5b8ed43b29d93158da6a43974922f621" gracePeriod=120
Jun 01 21:45:02.952879 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952846    2562 generic.go:358] "Generic (PLEG): container finished" podID="d68c0106-a696-412f-a57e-aa4b64577f23" containerID="424069859fad9155ebbeeb27cdb145af5b8ed43b29d93158da6a43974922f621" exitCode=0
Jun 01 21:45:02.952879 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952873    2562 generic.go:358] "Generic (PLEG): container finished" podID="d68c0106-a696-412f-a57e-aa4b64577f23" containerID="cad8685355650b1d6753eb1c6ba4229b4a84c6a8505d5021edd627a8f1205549" exitCode=0
Jun 01 21:45:02.952879 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952881    2562 generic.go:358] "Generic (PLEG): container finished" podID="d68c0106-a696-412f-a57e-aa4b64577f23" containerID="e77357d7e9da0eccce29e58f7e9a71f837e7a10a843970a4167e5fc8ad9a20e9" exitCode=0
Jun 01 21:45:02.952879 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952887    2562 generic.go:358] "Generic (PLEG): container finished" podID="d68c0106-a696-412f-a57e-aa4b64577f23" containerID="42bf9249393764c0af116da0a1ad13496f111cd05680ea73b10776184e8c4f7e" exitCode=0
Jun 01 21:45:02.953162 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952924    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"424069859fad9155ebbeeb27cdb145af5b8ed43b29d93158da6a43974922f621"}
Jun 01 21:45:02.953162 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952965    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"cad8685355650b1d6753eb1c6ba4229b4a84c6a8505d5021edd627a8f1205549"}
Jun 01 21:45:02.953162 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952978    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"e77357d7e9da0eccce29e58f7e9a71f837e7a10a843970a4167e5fc8ad9a20e9"}
Jun 01 21:45:02.953162 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:02.952989    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"42bf9249393764c0af116da0a1ad13496f111cd05680ea73b10776184e8c4f7e"}
Jun 01 21:45:03.962370 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:03.962332    2562 generic.go:358] "Generic (PLEG): container finished" podID="d68c0106-a696-412f-a57e-aa4b64577f23" containerID="9732ae6e37e6258410976b1c047a45d7c1bbe40684c094a6f35f1644cb336f88" exitCode=0
Jun 01 21:45:03.962370 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:03.962367    2562 generic.go:358] "Generic (PLEG): container finished" podID="d68c0106-a696-412f-a57e-aa4b64577f23" containerID="f7fd64bb2574295f9ff1ea19535681331a94ffba3bad78267fbd0e05377650bb" exitCode=0
Jun 01 21:45:03.962766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:03.962398    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"9732ae6e37e6258410976b1c047a45d7c1bbe40684c094a6f35f1644cb336f88"}
Jun 01 21:45:03.962766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:03.962451    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"f7fd64bb2574295f9ff1ea19535681331a94ffba3bad78267fbd0e05377650bb"}
Jun 01 21:45:04.005000 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.004975    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:04.095693 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095606    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-web\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.095693 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095649    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-tls-assets\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.095693 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095690    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-main-db\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.095973 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095706    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-metrics-client-ca\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.095973 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095721    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-web-config\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.095973 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095748    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-metric\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.095973 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095902    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-trusted-ca-bundle\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.095973 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095962    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-config-out\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.096211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.095985    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 01 21:45:04.096211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096011    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.096211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096048    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-cluster-tls-config\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.096211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096089    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gmmk8\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-kube-api-access-gmmk8\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.096211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096125    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.096211 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096151    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-config-volume\") pod \"d68c0106-a696-412f-a57e-aa4b64577f23\" (UID: \"d68c0106-a696-412f-a57e-aa4b64577f23\") "
Jun 01 21:45:04.096523 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096151    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 01 21:45:04.096523 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096308    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 01 21:45:04.096523 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096485    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-main-db\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.096523 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096505    2562 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-metrics-client-ca\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.096523 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.096520    2562 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d68c0106-a696-412f-a57e-aa4b64577f23-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.098856 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.098805    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:04.098998 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.098959    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:04.099116 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.099063    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 21:45:04.099497 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.099454    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-config-out" (OuterVolumeSpecName: "config-out") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 01 21:45:04.099704 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.099680    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-config-volume" (OuterVolumeSpecName: "config-volume") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:04.099779 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.099687    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-kube-api-access-gmmk8" (OuterVolumeSpecName: "kube-api-access-gmmk8") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "kube-api-access-gmmk8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 21:45:04.099932 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.099908    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:04.100634 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.100613    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:04.103616 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.103488    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:04.110527 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.110499    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-web-config" (OuterVolumeSpecName: "web-config") pod "d68c0106-a696-412f-a57e-aa4b64577f23" (UID: "d68c0106-a696-412f-a57e-aa4b64577f23"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:04.197440 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197378    2562 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-cluster-tls-config\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197440 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197435    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gmmk8\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-kube-api-access-gmmk8\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197440 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197446    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-main-tls\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197440 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197456    2562 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-config-volume\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197466    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197475    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d68c0106-a696-412f-a57e-aa4b64577f23-tls-assets\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197485    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-web-config\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197492    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197501    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d68c0106-a696-412f-a57e-aa4b64577f23-config-out\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.197705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.197509    2562 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d68c0106-a696-412f-a57e-aa4b64577f23-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:04.968029 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.967989    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"d68c0106-a696-412f-a57e-aa4b64577f23","Type":"ContainerDied","Data":"0cf15651d956c356fc12de30f490cec4fd91f5e9af50e7eca10ae4cdf80e12f1"}
Jun 01 21:45:04.968451 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.968041    2562 scope.go:117] "RemoveContainer" containerID="424069859fad9155ebbeeb27cdb145af5b8ed43b29d93158da6a43974922f621"
Jun 01 21:45:04.968451 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.968055    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:04.976352 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.976314    2562 scope.go:117] "RemoveContainer" containerID="9732ae6e37e6258410976b1c047a45d7c1bbe40684c094a6f35f1644cb336f88"
Jun 01 21:45:04.983487 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.983468    2562 scope.go:117] "RemoveContainer" containerID="cad8685355650b1d6753eb1c6ba4229b4a84c6a8505d5021edd627a8f1205549"
Jun 01 21:45:04.990042 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.989995    2562 scope.go:117] "RemoveContainer" containerID="f7fd64bb2574295f9ff1ea19535681331a94ffba3bad78267fbd0e05377650bb"
Jun 01 21:45:04.992871 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.992821    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:45:04.997486 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.997433    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:45:04.998266 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:04.998247    2562 scope.go:117] "RemoveContainer" containerID="e77357d7e9da0eccce29e58f7e9a71f837e7a10a843970a4167e5fc8ad9a20e9"
Jun 01 21:45:05.004988 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.004967    2562 scope.go:117] "RemoveContainer" containerID="42bf9249393764c0af116da0a1ad13496f111cd05680ea73b10776184e8c4f7e"
Jun 01 21:45:05.011649 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.011611    2562 scope.go:117] "RemoveContainer" containerID="d3f1b9356be8f67c8d26dbe674e0ea74d52cb38e67c176508d7f7c78f6dc0d10"
Jun 01 21:45:05.021172 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021148    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:45:05.021471 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021458    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-web"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021472    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-web"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021482    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="init-config-reloader"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021488    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="init-config-reloader"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021495    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021500    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021516    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="config-reloader"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021521    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="config-reloader"
Jun 01 21:45:05.021526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021527    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="alertmanager"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021533    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="alertmanager"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021545    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="prom-label-proxy"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021551    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="prom-label-proxy"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021560    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-metric"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021565    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-metric"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021609    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-metric"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021619    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="config-reloader"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021628    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy-web"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021635    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="prom-label-proxy"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021641    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="alertmanager"
Jun 01 21:45:05.021795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.021647    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" containerName="kube-rbac-proxy"
Jun 01 21:45:05.026864 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.026846    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.029297 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029272    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jun 01 21:45:05.029429 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029293    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jun 01 21:45:05.029429 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029305    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jun 01 21:45:05.029429 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029305    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jun 01 21:45:05.029429 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029391    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jun 01 21:45:05.029634 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029606    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-4mwzz\""
Jun 01 21:45:05.029688 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029672    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jun 01 21:45:05.029881 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029868    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jun 01 21:45:05.029930 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.029919    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jun 01 21:45:05.034154 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.034090    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jun 01 21:45:05.036766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.036746    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:45:05.106008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.105918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.105974    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106000    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-476b9\" (UniqueName: \"kubernetes.io/projected/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-kube-api-access-476b9\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106053    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106151    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106173    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106211    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-web-config\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.106460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.106302    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-config-out\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.206992 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.206937    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207009    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207044    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207072    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207096    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207120    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-web-config\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207161    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207187 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207182    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207558 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207206    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-config-out\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207558 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207235    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207558 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207298    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207558 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207324    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-476b9\" (UniqueName: \"kubernetes.io/projected/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-kube-api-access-476b9\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207558 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207356    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207733 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207704    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.207997 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.207975    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.210261 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.210232    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.210433 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.210243    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-config-out\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.210655 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.210535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.210764 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.210672    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.210764 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.210681    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.210881 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.210857    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-config-volume\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.210943 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.210918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.211097 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.211072    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.211266 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.211250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-web-config\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.212560 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.212540    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.218746 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.218724    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-476b9\" (UniqueName: \"kubernetes.io/projected/ddc088b8-cf6e-46b6-b816-306f1d0f7be6-kube-api-access-476b9\") pod \"alertmanager-main-0\" (UID: \"ddc088b8-cf6e-46b6-b816-306f1d0f7be6\") " pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.306250 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.306218    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d68c0106-a696-412f-a57e-aa4b64577f23" path="/var/lib/kubelet/pods/d68c0106-a696-412f-a57e-aa4b64577f23/volumes"
Jun 01 21:45:05.337728 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.337695    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jun 01 21:45:05.470783 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.470711    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jun 01 21:45:05.473922 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:45:05.473894    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podddc088b8_cf6e_46b6_b816_306f1d0f7be6.slice/crio-5fdaf4407e6606248319eefcbe8833761978f821e6b7c5ceeb0c09247666b5d7 WatchSource:0}: Error finding container 5fdaf4407e6606248319eefcbe8833761978f821e6b7c5ceeb0c09247666b5d7: Status 404 returned error can't find the container with id 5fdaf4407e6606248319eefcbe8833761978f821e6b7c5ceeb0c09247666b5d7
Jun 01 21:45:05.973008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.972969    2562 generic.go:358] "Generic (PLEG): container finished" podID="ddc088b8-cf6e-46b6-b816-306f1d0f7be6" containerID="1025c1b69835e4ed9ad47b4219c4304795b2e9a4a311f9d68b77db3a05ad378f" exitCode=0
Jun 01 21:45:05.973354 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.973024    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerDied","Data":"1025c1b69835e4ed9ad47b4219c4304795b2e9a4a311f9d68b77db3a05ad378f"}
Jun 01 21:45:05.973354 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:05.973052    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerStarted","Data":"5fdaf4407e6606248319eefcbe8833761978f821e6b7c5ceeb0c09247666b5d7"}
Jun 01 21:45:06.978979 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:06.978942    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerStarted","Data":"76b0085798c493070543b0d34bb3766e61156a7511e622ab5498c047115b3a8e"}
Jun 01 21:45:06.979455 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:06.978987    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerStarted","Data":"4746b781939b97ebfb548c81e4e0e4a43748a815a07e43dbe5d472285854de81"}
Jun 01 21:45:06.979455 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:06.979002    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerStarted","Data":"500213b3cd7376cc469a69ed3416ed48e3247a9ae25d41b76d0fa2cd535b2d27"}
Jun 01 21:45:06.979455 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:06.979013    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerStarted","Data":"a7ced39d6c38e75e6b1fcfe3f789f5d94f8c8ad5d3a8f671e3ffd5e6128c459a"}
Jun 01 21:45:06.979455 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:06.979024    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerStarted","Data":"6ecbdf68ab8a002ab8d8e513fd2df5013626e1a8502e6fbdeb8c7255b560ddc8"}
Jun 01 21:45:06.979455 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:06.979054    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ddc088b8-cf6e-46b6-b816-306f1d0f7be6","Type":"ContainerStarted","Data":"154ef06494a4bce7af64e49f72bfdd0bc9ef208cac6c42eea2ea43fbc16d9162"}
Jun 01 21:45:07.005194 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.005145    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.00512834 podStartE2EDuration="2.00512834s" podCreationTimestamp="2026-06-01 21:45:05 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 21:45:07.003058549 +0000 UTC m=+198.309497812" watchObservedRunningTime="2026-06-01 21:45:07.00512834 +0000 UTC m=+198.311567603"
Jun 01 21:45:07.083501 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.083468    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:45:07.083951 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.083898    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-web" containerID="cri-o://05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e" gracePeriod=600
Jun 01 21:45:07.083951 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.083926    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="config-reloader" containerID="cri-o://48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec" gracePeriod=600
Jun 01 21:45:07.084104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.083940    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08" gracePeriod=600
Jun 01 21:45:07.084104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.083895    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="prometheus" containerID="cri-o://ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de" gracePeriod=600
Jun 01 21:45:07.084104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.083926    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="thanos-sidecar" containerID="cri-o://15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587" gracePeriod=600
Jun 01 21:45:07.084104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.083946    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy" containerID="cri-o://8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c" gracePeriod=600
Jun 01 21:45:07.345512 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.345487    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:07.433176 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433144    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-rulefiles-0\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433353 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433208    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-config-out\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433353 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433306    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433353 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433341    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-tls-assets\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433366    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-metrics-client-ca\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433384    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-kube-rbac-proxy\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433541 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433510    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-grpc-tls\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433692 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433557    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-serving-certs-ca-bundle\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433692 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433585    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-config\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433692 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433635    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-thanos-prometheus-http-client-file\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433692 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433666    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-metrics-client-certs\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433715    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433745    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gccz8\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-kube-api-access-gccz8\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433782    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-web-config\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433814    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-tls\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433843    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-kubelet-serving-ca-bundle\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.433878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433867    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 01 21:45:07.434202 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433897    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-trusted-ca-bundle\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.434202 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.433924    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-db\") pod \"5a93c891-b8bc-425a-82f5-87b9f09fac72\" (UID: \"5a93c891-b8bc-425a-82f5-87b9f09fac72\") "
Jun 01 21:45:07.435441 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.435034    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-metrics-client-ca\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.435563 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.435484    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 01 21:45:07.435835 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.435805    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 01 21:45:07.436617 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.436338    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-config-out" (OuterVolumeSpecName: "config-out") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 01 21:45:07.436617 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.436434    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.436617 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.436506    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 21:45:07.436809 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.436618    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.437861 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.437766    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jun 01 21:45:07.438003 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.437979    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-config" (OuterVolumeSpecName: "config") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.438307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.438221    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 01 21:45:07.438391 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.438300    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jun 01 21:45:07.438648 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.438617    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.438820 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.438778    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.438898 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.438819    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.440453 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.438986    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.440453 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.440261    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.440453 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.440400    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-kube-api-access-gccz8" (OuterVolumeSpecName: "kube-api-access-gccz8") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "kube-api-access-gccz8". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 21:45:07.451942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.451907    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-web-config" (OuterVolumeSpecName: "web-config") pod "5a93c891-b8bc-425a-82f5-87b9f09fac72" (UID: "5a93c891-b8bc-425a-82f5-87b9f09fac72"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jun 01 21:45:07.535550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535466    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535498    2562 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-config\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535512    2562 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-thanos-prometheus-http-client-file\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535524    2562 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-metrics-client-certs\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535535    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535546    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gccz8\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-kube-api-access-gccz8\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535550 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535556    2562 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-web-config\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535565    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-tls\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535575    2562 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535583    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-trusted-ca-bundle\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535592    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-db\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535601    2562 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5a93c891-b8bc-425a-82f5-87b9f09fac72-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535609    2562 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5a93c891-b8bc-425a-82f5-87b9f09fac72-config-out\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535618    2562 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535626    2562 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5a93c891-b8bc-425a-82f5-87b9f09fac72-tls-assets\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535635    2562 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-kube-rbac-proxy\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.535851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.535642    2562 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5a93c891-b8bc-425a-82f5-87b9f09fac72-secret-grpc-tls\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:45:07.985199 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985163    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08" exitCode=0
Jun 01 21:45:07.985199 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985190    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c" exitCode=0
Jun 01 21:45:07.985199 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985196    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e" exitCode=0
Jun 01 21:45:07.985199 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985202    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587" exitCode=0
Jun 01 21:45:07.985199 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985207    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec" exitCode=0
Jun 01 21:45:07.985199 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985212    2562 generic.go:358] "Generic (PLEG): container finished" podID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de" exitCode=0
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985252    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"}
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985298    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"}
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985313    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"}
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985327    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"}
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985342    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"}
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985356    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"}
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985367    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5a93c891-b8bc-425a-82f5-87b9f09fac72","Type":"ContainerDied","Data":"852609e268e33d2c711c69770b7b22d85e66d11cb21c48bcfbfadc6996320ebb"}
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985327    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:07.985766 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.985342    2562 scope.go:117] "RemoveContainer" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:07.993320 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.993303    2562 scope.go:117] "RemoveContainer" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:07.999977 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:07.999960    2562 scope.go:117] "RemoveContainer" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.006961 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.006935    2562 scope.go:117] "RemoveContainer" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.009306 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.009264    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:45:08.013304 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.013281    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:45:08.014626 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.014604    2562 scope.go:117] "RemoveContainer" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.021283 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.021265    2562 scope.go:117] "RemoveContainer" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.028760 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.028731    2562 scope.go:117] "RemoveContainer" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.035911 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.035889    2562 scope.go:117] "RemoveContainer" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:08.036247 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:45:08.036225    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": container with ID starting with d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08 not found: ID does not exist" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:08.036323 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.036257    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"} err="failed to get container status \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": rpc error: code = NotFound desc = could not find container \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": container with ID starting with d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08 not found: ID does not exist"
Jun 01 21:45:08.036323 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.036297    2562 scope.go:117] "RemoveContainer" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:08.036566 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:45:08.036542    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": container with ID starting with 8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c not found: ID does not exist" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:08.036625 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.036575    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"} err="failed to get container status \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": rpc error: code = NotFound desc = could not find container \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": container with ID starting with 8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c not found: ID does not exist"
Jun 01 21:45:08.036625 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.036603    2562 scope.go:117] "RemoveContainer" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.036852 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:45:08.036834    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": container with ID starting with 05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e not found: ID does not exist" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.036911 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.036857    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"} err="failed to get container status \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": rpc error: code = NotFound desc = could not find container \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": container with ID starting with 05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e not found: ID does not exist"
Jun 01 21:45:08.036911 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.036871    2562 scope.go:117] "RemoveContainer" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.037102 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:45:08.037086    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": container with ID starting with 15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587 not found: ID does not exist" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.037153 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037105    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"} err="failed to get container status \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": rpc error: code = NotFound desc = could not find container \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": container with ID starting with 15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587 not found: ID does not exist"
Jun 01 21:45:08.037153 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037117    2562 scope.go:117] "RemoveContainer" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.037251 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037149    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:45:08.037319 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:45:08.037301    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": container with ID starting with 48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec not found: ID does not exist" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.037368 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037321    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"} err="failed to get container status \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": rpc error: code = NotFound desc = could not find container \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": container with ID starting with 48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec not found: ID does not exist"
Jun 01 21:45:08.037368 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037334    2562 scope.go:117] "RemoveContainer" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.037563 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:45:08.037544    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": container with ID starting with ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de not found: ID does not exist" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.037614 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037567    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"} err="failed to get container status \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": rpc error: code = NotFound desc = could not find container \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": container with ID starting with ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de not found: ID does not exist"
Jun 01 21:45:08.037614 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037579    2562 scope.go:117] "RemoveContainer" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.037705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037647    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-web"
Jun 01 21:45:08.037705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037664    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-web"
Jun 01 21:45:08.037705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037679    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="config-reloader"
Jun 01 21:45:08.037705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037691    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="config-reloader"
Jun 01 21:45:08.037705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037701    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-thanos"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037710    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-thanos"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037723    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037732    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:45:08.037741    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": container with ID starting with 251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9 not found: ID does not exist" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037753    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="prometheus"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037761    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="prometheus"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037762    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"} err="failed to get container status \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": rpc error: code = NotFound desc = could not find container \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": container with ID starting with 251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9 not found: ID does not exist"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037774    2562 scope.go:117] "RemoveContainer" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037778    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="thanos-sidecar"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037787    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="thanos-sidecar"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037798    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="init-config-reloader"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037807    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="init-config-reloader"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037878    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="prometheus"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037894    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-thanos"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037906    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037918    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="thanos-sidecar"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037927    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="config-reloader"
Jun 01 21:45:08.037942 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037936    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" containerName="kube-rbac-proxy-web"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037947    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"} err="failed to get container status \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": rpc error: code = NotFound desc = could not find container \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": container with ID starting with d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08 not found: ID does not exist"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.037973    2562 scope.go:117] "RemoveContainer" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038180    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"} err="failed to get container status \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": rpc error: code = NotFound desc = could not find container \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": container with ID starting with 8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c not found: ID does not exist"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038196    2562 scope.go:117] "RemoveContainer" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038426    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"} err="failed to get container status \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": rpc error: code = NotFound desc = could not find container \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": container with ID starting with 05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e not found: ID does not exist"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038445    2562 scope.go:117] "RemoveContainer" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038698    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"} err="failed to get container status \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": rpc error: code = NotFound desc = could not find container \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": container with ID starting with 15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587 not found: ID does not exist"
Jun 01 21:45:08.038796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038713    2562 scope.go:117] "RemoveContainer" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.039160 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038896    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"} err="failed to get container status \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": rpc error: code = NotFound desc = could not find container \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": container with ID starting with 48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec not found: ID does not exist"
Jun 01 21:45:08.039160 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.038912    2562 scope.go:117] "RemoveContainer" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.039160 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039112    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"} err="failed to get container status \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": rpc error: code = NotFound desc = could not find container \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": container with ID starting with ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de not found: ID does not exist"
Jun 01 21:45:08.039160 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039125    2562 scope.go:117] "RemoveContainer" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.039345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039284    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"} err="failed to get container status \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": rpc error: code = NotFound desc = could not find container \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": container with ID starting with 251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9 not found: ID does not exist"
Jun 01 21:45:08.039345 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039298    2562 scope.go:117] "RemoveContainer" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:08.039555 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039535    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"} err="failed to get container status \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": rpc error: code = NotFound desc = could not find container \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": container with ID starting with d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08 not found: ID does not exist"
Jun 01 21:45:08.039555 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039553    2562 scope.go:117] "RemoveContainer" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:08.039774 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039756    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"} err="failed to get container status \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": rpc error: code = NotFound desc = could not find container \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": container with ID starting with 8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c not found: ID does not exist"
Jun 01 21:45:08.039827 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039774    2562 scope.go:117] "RemoveContainer" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.039959 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039939    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"} err="failed to get container status \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": rpc error: code = NotFound desc = could not find container \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": container with ID starting with 05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e not found: ID does not exist"
Jun 01 21:45:08.039995 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.039959    2562 scope.go:117] "RemoveContainer" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.040158 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040142    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"} err="failed to get container status \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": rpc error: code = NotFound desc = could not find container \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": container with ID starting with 15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587 not found: ID does not exist"
Jun 01 21:45:08.040200 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040158    2562 scope.go:117] "RemoveContainer" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.040376 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040354    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"} err="failed to get container status \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": rpc error: code = NotFound desc = could not find container \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": container with ID starting with 48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec not found: ID does not exist"
Jun 01 21:45:08.040376 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040374    2562 scope.go:117] "RemoveContainer" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.040589 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040570    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"} err="failed to get container status \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": rpc error: code = NotFound desc = could not find container \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": container with ID starting with ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de not found: ID does not exist"
Jun 01 21:45:08.040654 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040590    2562 scope.go:117] "RemoveContainer" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.040809 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040788    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"} err="failed to get container status \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": rpc error: code = NotFound desc = could not find container \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": container with ID starting with 251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9 not found: ID does not exist"
Jun 01 21:45:08.040809 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040807    2562 scope.go:117] "RemoveContainer" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:08.040999 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.040980    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"} err="failed to get container status \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": rpc error: code = NotFound desc = could not find container \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": container with ID starting with d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08 not found: ID does not exist"
Jun 01 21:45:08.041066 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041002    2562 scope.go:117] "RemoveContainer" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:08.041214 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041198    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"} err="failed to get container status \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": rpc error: code = NotFound desc = could not find container \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": container with ID starting with 8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c not found: ID does not exist"
Jun 01 21:45:08.041282 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041216    2562 scope.go:117] "RemoveContainer" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.041457 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041440    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"} err="failed to get container status \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": rpc error: code = NotFound desc = could not find container \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": container with ID starting with 05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e not found: ID does not exist"
Jun 01 21:45:08.041519 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041458    2562 scope.go:117] "RemoveContainer" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.041655 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041636    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"} err="failed to get container status \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": rpc error: code = NotFound desc = could not find container \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": container with ID starting with 15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587 not found: ID does not exist"
Jun 01 21:45:08.041726 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041656    2562 scope.go:117] "RemoveContainer" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.041862 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041846    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"} err="failed to get container status \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": rpc error: code = NotFound desc = could not find container \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": container with ID starting with 48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec not found: ID does not exist"
Jun 01 21:45:08.041937 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.041863    2562 scope.go:117] "RemoveContainer" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.042084 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042068    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"} err="failed to get container status \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": rpc error: code = NotFound desc = could not find container \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": container with ID starting with ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de not found: ID does not exist"
Jun 01 21:45:08.042143 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042096    2562 scope.go:117] "RemoveContainer" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.042290 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042271    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"} err="failed to get container status \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": rpc error: code = NotFound desc = could not find container \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": container with ID starting with 251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9 not found: ID does not exist"
Jun 01 21:45:08.042329 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042290    2562 scope.go:117] "RemoveContainer" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:08.042501 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042483    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"} err="failed to get container status \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": rpc error: code = NotFound desc = could not find container \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": container with ID starting with d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08 not found: ID does not exist"
Jun 01 21:45:08.042574 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042502    2562 scope.go:117] "RemoveContainer" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:08.042691 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042674    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"} err="failed to get container status \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": rpc error: code = NotFound desc = could not find container \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": container with ID starting with 8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c not found: ID does not exist"
Jun 01 21:45:08.042750 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042692    2562 scope.go:117] "RemoveContainer" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.042901 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042882    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"} err="failed to get container status \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": rpc error: code = NotFound desc = could not find container \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": container with ID starting with 05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e not found: ID does not exist"
Jun 01 21:45:08.042948 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.042902    2562 scope.go:117] "RemoveContainer" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.043088 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043070    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"} err="failed to get container status \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": rpc error: code = NotFound desc = could not find container \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": container with ID starting with 15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587 not found: ID does not exist"
Jun 01 21:45:08.043148 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043090    2562 scope.go:117] "RemoveContainer" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.043317 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043300    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"} err="failed to get container status \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": rpc error: code = NotFound desc = could not find container \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": container with ID starting with 48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec not found: ID does not exist"
Jun 01 21:45:08.043385 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043318    2562 scope.go:117] "RemoveContainer" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.043535 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043518    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"} err="failed to get container status \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": rpc error: code = NotFound desc = could not find container \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": container with ID starting with ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de not found: ID does not exist"
Jun 01 21:45:08.043583 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043536    2562 scope.go:117] "RemoveContainer" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.043788 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043770    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"} err="failed to get container status \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": rpc error: code = NotFound desc = could not find container \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": container with ID starting with 251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9 not found: ID does not exist"
Jun 01 21:45:08.043838 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043790    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.043891 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.043789    2562 scope.go:117] "RemoveContainer" containerID="d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"
Jun 01 21:45:08.044175 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044149    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08"} err="failed to get container status \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": rpc error: code = NotFound desc = could not find container \"d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08\": container with ID starting with d72ae8469903dd6fa54d4f7bc8a444d7ec0648c32450dd22270c790764599c08 not found: ID does not exist"
Jun 01 21:45:08.044272 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044179    2562 scope.go:117] "RemoveContainer" containerID="8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"
Jun 01 21:45:08.044516 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044488    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c"} err="failed to get container status \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": rpc error: code = NotFound desc = could not find container \"8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c\": container with ID starting with 8483634e07b509bd8e3b3c17bde0bb05fa2bf06c46d7409e32f64cd00bd8981c not found: ID does not exist"
Jun 01 21:45:08.044572 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044522    2562 scope.go:117] "RemoveContainer" containerID="05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"
Jun 01 21:45:08.044742 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044722    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e"} err="failed to get container status \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": rpc error: code = NotFound desc = could not find container \"05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e\": container with ID starting with 05ea4ea3ff65966a9e5776784a6997537974336bfb103f5291ff84d7c0c1f38e not found: ID does not exist"
Jun 01 21:45:08.044805 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044745    2562 scope.go:117] "RemoveContainer" containerID="15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"
Jun 01 21:45:08.044966 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044944    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587"} err="failed to get container status \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": rpc error: code = NotFound desc = could not find container \"15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587\": container with ID starting with 15cd9da06da74d7fcbc7c47408b7c563ff7f97bb3fa01ad5a5b94019e9cae587 not found: ID does not exist"
Jun 01 21:45:08.045011 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.044968    2562 scope.go:117] "RemoveContainer" containerID="48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"
Jun 01 21:45:08.045179 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.045159    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec"} err="failed to get container status \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": rpc error: code = NotFound desc = could not find container \"48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec\": container with ID starting with 48211ae3b7a380e90d8e7554796069955184058f793351d1764abd7f6d2a3bec not found: ID does not exist"
Jun 01 21:45:08.045226 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.045180    2562 scope.go:117] "RemoveContainer" containerID="ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"
Jun 01 21:45:08.045538 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.045517    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de"} err="failed to get container status \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": rpc error: code = NotFound desc = could not find container \"ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de\": container with ID starting with ebbcf9aafea21627feb1fb6e87c2503a5b7a089c16822cd5e5b9cc9c164652de not found: ID does not exist"
Jun 01 21:45:08.045593 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.045541    2562 scope.go:117] "RemoveContainer" containerID="251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"
Jun 01 21:45:08.045790 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.045768    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9"} err="failed to get container status \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": rpc error: code = NotFound desc = could not find container \"251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9\": container with ID starting with 251b419254bcdd7cd724699a9308cd5712ab0ff84e4f8d4d0fefece0a417d4c9 not found: ID does not exist"
Jun 01 21:45:08.046803 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.046783    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jun 01 21:45:08.046803 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.046800    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jun 01 21:45:08.046992 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.046975    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jun 01 21:45:08.047050 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.047017    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jun 01 21:45:08.047104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.046976    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jun 01 21:45:08.047104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.047085    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jun 01 21:45:08.047395 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.047381    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jun 01 21:45:08.047971 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.047952    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-xd5l2\""
Jun 01 21:45:08.048073 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.048029    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jun 01 21:45:08.048073 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.048050    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jun 01 21:45:08.048176 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.048078    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jun 01 21:45:08.048176 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.048150    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-2hods8opk90i0\""
Jun 01 21:45:08.049190 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.049173    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jun 01 21:45:08.053453 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.053392    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:45:08.055390 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.055188    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jun 01 21:45:08.142165 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142129    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142321 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142170    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-config\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142387 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142333    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142387 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hwr2c\" (UniqueName: \"kubernetes.io/projected/eeee4026-4665-4fa7-b717-ecc0be89f6f1-kube-api-access-hwr2c\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142603 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142580    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeee4026-4665-4fa7-b717-ecc0be89f6f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142656 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142620    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeee4026-4665-4fa7-b717-ecc0be89f6f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142677    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142698    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142802 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142732    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142802 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142772    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142870 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142944 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142927    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.142982 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142958    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.143018 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.142994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.143119 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.143091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.143178 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.143127    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244058    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244094    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244402 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244119    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244402 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244135    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-config\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244402 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244300    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244402 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244346    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hwr2c\" (UniqueName: \"kubernetes.io/projected/eeee4026-4665-4fa7-b717-ecc0be89f6f1-kube-api-access-hwr2c\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244402 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244391    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244461    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeee4026-4665-4fa7-b717-ecc0be89f6f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244490    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244518    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244522    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeee4026-4665-4fa7-b717-ecc0be89f6f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244580    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244611    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244644    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.244694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244687    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.245093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244735    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.245093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244767    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.245093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244795    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.245093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244832    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.245093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244922    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.245093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.244974    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.245394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.245378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.246126 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.246103    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.247182 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.247150    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/eeee4026-4665-4fa7-b717-ecc0be89f6f1-config-out\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.247283 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.247267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-config\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.247763 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.247606    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.248184 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.248156    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-web-config\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.248452 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.248401    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/eeee4026-4665-4fa7-b717-ecc0be89f6f1-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.248602 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.248451    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.248821 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.248801    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/eeee4026-4665-4fa7-b717-ecc0be89f6f1-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.249326 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.249305    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.249729 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.249704    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.249845 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.249831    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.249960 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.249936    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.250557 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.250543    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/eeee4026-4665-4fa7-b717-ecc0be89f6f1-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.253628 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.253608    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hwr2c\" (UniqueName: \"kubernetes.io/projected/eeee4026-4665-4fa7-b717-ecc0be89f6f1-kube-api-access-hwr2c\") pod \"prometheus-k8s-0\" (UID: \"eeee4026-4665-4fa7-b717-ecc0be89f6f1\") " pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.356497 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.356442    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:45:08.490699 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.490666    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jun 01 21:45:08.493616 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:45:08.493591    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeeee4026_4665_4fa7_b717_ecc0be89f6f1.slice/crio-50dcd5a194d22fc9d25bfa06870e5679f877ca431f7ee54f49536371dce8e21b WatchSource:0}: Error finding container 50dcd5a194d22fc9d25bfa06870e5679f877ca431f7ee54f49536371dce8e21b: Status 404 returned error can't find the container with id 50dcd5a194d22fc9d25bfa06870e5679f877ca431f7ee54f49536371dce8e21b
Jun 01 21:45:08.990492 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.990462    2562 generic.go:358] "Generic (PLEG): container finished" podID="eeee4026-4665-4fa7-b717-ecc0be89f6f1" containerID="7185a56e0ce1524eca05799102cc58f1d449f604173be3bd85de9ea7ed8c4e54" exitCode=0
Jun 01 21:45:08.990872 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.990499    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerDied","Data":"7185a56e0ce1524eca05799102cc58f1d449f604173be3bd85de9ea7ed8c4e54"}
Jun 01 21:45:08.990872 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:08.990520    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerStarted","Data":"50dcd5a194d22fc9d25bfa06870e5679f877ca431f7ee54f49536371dce8e21b"}
Jun 01 21:45:09.309969 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:09.309865    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a93c891-b8bc-425a-82f5-87b9f09fac72" path="/var/lib/kubelet/pods/5a93c891-b8bc-425a-82f5-87b9f09fac72/volumes"
Jun 01 21:45:09.996705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:09.996669    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerStarted","Data":"ac7906f234c016872a43cadb4555a17ef72cce749e103c1d5572275c97741e25"}
Jun 01 21:45:09.996705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:09.996705    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerStarted","Data":"1b04bb3cfd2ff3202452985061357e0005340fc284059b783437b26d6ba68f78"}
Jun 01 21:45:09.996705 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:09.996714    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerStarted","Data":"b73d47f30e64081e11103ccdc6473694b23d501e9a5825faeac0905524ae0605"}
Jun 01 21:45:09.997160 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:09.996722    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerStarted","Data":"b5fc75435826febb05d26f876d559e4160e96b103f565eb9166cdc8626dcf5b6"}
Jun 01 21:45:09.997160 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:09.996730    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerStarted","Data":"6b8d3f1126c58c9859658fd71c236689484451aa6ecc7aaf47e124274125f345"}
Jun 01 21:45:09.997160 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:09.996740    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"eeee4026-4665-4fa7-b717-ecc0be89f6f1","Type":"ContainerStarted","Data":"88db7ccca049c5600d4d1e8ee9d23b1b50a126f51760c8e9fe7e4aed35e0d4a5"}
Jun 01 21:45:10.026443 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:10.026359    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.026338768 podStartE2EDuration="2.026338768s" podCreationTimestamp="2026-06-01 21:45:08 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 21:45:10.024559035 +0000 UTC m=+201.330998298" watchObservedRunningTime="2026-06-01 21:45:10.026338768 +0000 UTC m=+201.332778033"
Jun 01 21:45:13.357251 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:45:13.357200    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:46:08.356817 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:08.356720    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:46:08.372173 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:08.372148    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:46:09.197827 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:09.197801    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jun 01 21:46:49.221528 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:49.221492    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:46:49.222084 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:49.221799    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:46:49.224316 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:49.224295    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:46:49.224519 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:49.224503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:46:49.230651 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:46:49.230633    2562 kubelet.go:1628] "Image garbage collection succeeded"
Jun 01 21:47:13.444371 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.444336    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-zdqwj"]
Jun 01 21:47:13.447615 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.447599    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.449953 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.449933    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jun 01 21:47:13.454119 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.454094    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdqwj"]
Jun 01 21:47:13.589995 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.589954    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e89a157a-c422-437f-a8b8-0d40d73aaf53-kubelet-config\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.590171 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.590025    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e89a157a-c422-437f-a8b8-0d40d73aaf53-dbus\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.590171 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.590091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89a157a-c422-437f-a8b8-0d40d73aaf53-original-pull-secret\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.690792 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.690751    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89a157a-c422-437f-a8b8-0d40d73aaf53-original-pull-secret\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.690970 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.690809    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e89a157a-c422-437f-a8b8-0d40d73aaf53-kubelet-config\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.690970 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.690856    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e89a157a-c422-437f-a8b8-0d40d73aaf53-dbus\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.690970 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.690948    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e89a157a-c422-437f-a8b8-0d40d73aaf53-kubelet-config\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.691088 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.691003    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e89a157a-c422-437f-a8b8-0d40d73aaf53-dbus\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.693095 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.693075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e89a157a-c422-437f-a8b8-0d40d73aaf53-original-pull-secret\") pod \"global-pull-secret-syncer-zdqwj\" (UID: \"e89a157a-c422-437f-a8b8-0d40d73aaf53\") " pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.757258 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.757158    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-zdqwj"
Jun 01 21:47:13.881578 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.881541    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-zdqwj"]
Jun 01 21:47:13.884705 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:47:13.884677    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode89a157a_c422_437f_a8b8_0d40d73aaf53.slice/crio-92a06208ed687e847398d2993ecda81c9f0079c337f958f5cfdb0f9938bbcc90 WatchSource:0}: Error finding container 92a06208ed687e847398d2993ecda81c9f0079c337f958f5cfdb0f9938bbcc90: Status 404 returned error can't find the container with id 92a06208ed687e847398d2993ecda81c9f0079c337f958f5cfdb0f9938bbcc90
Jun 01 21:47:13.886133 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:13.886113    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 01 21:47:14.371863 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:14.371817    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdqwj" event={"ID":"e89a157a-c422-437f-a8b8-0d40d73aaf53","Type":"ContainerStarted","Data":"92a06208ed687e847398d2993ecda81c9f0079c337f958f5cfdb0f9938bbcc90"}
Jun 01 21:47:19.388638 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:19.388602    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-zdqwj" event={"ID":"e89a157a-c422-437f-a8b8-0d40d73aaf53","Type":"ContainerStarted","Data":"f78df471135d63067ba4b6edc9a5b9e8ba6668e4b0078fbec72f1b3b4482a67b"}
Jun 01 21:47:19.405272 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:47:19.405224    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-zdqwj" podStartSLOduration=1.8356544160000001 podStartE2EDuration="6.405208181s" podCreationTimestamp="2026-06-01 21:47:13 +0000 UTC" firstStartedPulling="2026-06-01 21:47:13.886244377 +0000 UTC m=+325.192683618" lastFinishedPulling="2026-06-01 21:47:18.455798136 +0000 UTC m=+329.762237383" observedRunningTime="2026-06-01 21:47:19.403544359 +0000 UTC m=+330.709983624" watchObservedRunningTime="2026-06-01 21:47:19.405208181 +0000 UTC m=+330.711647445"
Jun 01 21:48:18.223466 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.223430    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-79c8d999ff-7vqkf"]
Jun 01 21:48:18.226755 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.226739    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.229205 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.229187    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jun 01 21:48:18.229298 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.229211    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jun 01 21:48:18.230122 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.230105    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-qnrs7\""
Jun 01 21:48:18.233876 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.233670    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-7vqkf"]
Jun 01 21:48:18.236692 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.236669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55zl4\" (UniqueName: \"kubernetes.io/projected/bacb3ec1-692c-4705-a27f-e00a62e43986-kube-api-access-55zl4\") pod \"cert-manager-79c8d999ff-7vqkf\" (UID: \"bacb3ec1-692c-4705-a27f-e00a62e43986\") " pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.236784 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.236714    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bacb3ec1-692c-4705-a27f-e00a62e43986-bound-sa-token\") pod \"cert-manager-79c8d999ff-7vqkf\" (UID: \"bacb3ec1-692c-4705-a27f-e00a62e43986\") " pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.337173 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.337135    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-55zl4\" (UniqueName: \"kubernetes.io/projected/bacb3ec1-692c-4705-a27f-e00a62e43986-kube-api-access-55zl4\") pod \"cert-manager-79c8d999ff-7vqkf\" (UID: \"bacb3ec1-692c-4705-a27f-e00a62e43986\") " pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.337360 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.337190    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bacb3ec1-692c-4705-a27f-e00a62e43986-bound-sa-token\") pod \"cert-manager-79c8d999ff-7vqkf\" (UID: \"bacb3ec1-692c-4705-a27f-e00a62e43986\") " pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.345129 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.345096    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bacb3ec1-692c-4705-a27f-e00a62e43986-bound-sa-token\") pod \"cert-manager-79c8d999ff-7vqkf\" (UID: \"bacb3ec1-692c-4705-a27f-e00a62e43986\") " pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.345252 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.345231    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-55zl4\" (UniqueName: \"kubernetes.io/projected/bacb3ec1-692c-4705-a27f-e00a62e43986-kube-api-access-55zl4\") pod \"cert-manager-79c8d999ff-7vqkf\" (UID: \"bacb3ec1-692c-4705-a27f-e00a62e43986\") " pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.545745 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.545644    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-79c8d999ff-7vqkf"
Jun 01 21:48:18.672798 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:18.672765    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-79c8d999ff-7vqkf"]
Jun 01 21:48:18.676621 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:48:18.676592    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbacb3ec1_692c_4705_a27f_e00a62e43986.slice/crio-9bccf28c6126d23763cf19ebb2c2fb95b2c0ca33f039ebedac54da0bd7ed11d9 WatchSource:0}: Error finding container 9bccf28c6126d23763cf19ebb2c2fb95b2c0ca33f039ebedac54da0bd7ed11d9: Status 404 returned error can't find the container with id 9bccf28c6126d23763cf19ebb2c2fb95b2c0ca33f039ebedac54da0bd7ed11d9
Jun 01 21:48:19.566359 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:19.566321    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-7vqkf" event={"ID":"bacb3ec1-692c-4705-a27f-e00a62e43986","Type":"ContainerStarted","Data":"9bccf28c6126d23763cf19ebb2c2fb95b2c0ca33f039ebedac54da0bd7ed11d9"}
Jun 01 21:48:21.575304 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:21.575266    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-79c8d999ff-7vqkf" event={"ID":"bacb3ec1-692c-4705-a27f-e00a62e43986","Type":"ContainerStarted","Data":"b6a9f9f743594fbd41798b8a82219e7e57addc7a3537dec066775c513ed94905"}
Jun 01 21:48:21.590660 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:21.590611    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="cert-manager/cert-manager-79c8d999ff-7vqkf" podStartSLOduration=0.833898335 podStartE2EDuration="3.590596648s" podCreationTimestamp="2026-06-01 21:48:18 +0000 UTC" firstStartedPulling="2026-06-01 21:48:18.678222296 +0000 UTC m=+389.984661538" lastFinishedPulling="2026-06-01 21:48:21.434920604 +0000 UTC m=+392.741359851" observedRunningTime="2026-06-01 21:48:21.58903988 +0000 UTC m=+392.895479146" watchObservedRunningTime="2026-06-01 21:48:21.590596648 +0000 UTC m=+392.897035912"
Jun 01 21:48:24.324207 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.324171    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"]
Jun 01 21:48:24.327552 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.327535    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.330497 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.330473    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jun 01 21:48:24.330497 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.330473    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jun 01 21:48:24.331638 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.331618    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jun 01 21:48:24.331773 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.331664    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-r5796\""
Jun 01 21:48:24.331773 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.331664    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jun 01 21:48:24.331773 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.331750    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jun 01 21:48:24.335113 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.334864    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"]
Jun 01 21:48:24.392824 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.392785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa85b75c-13a3-49e2-82ae-73308bd158e4-manager-config\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.392824 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.392822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa85b75c-13a3-49e2-82ae-73308bd158e4-metrics-cert\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.393027 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.392865    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b85xn\" (UniqueName: \"kubernetes.io/projected/aa85b75c-13a3-49e2-82ae-73308bd158e4-kube-api-access-b85xn\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.393027 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.392889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa85b75c-13a3-49e2-82ae-73308bd158e4-cert\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.493797 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.493751    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa85b75c-13a3-49e2-82ae-73308bd158e4-manager-config\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.493797 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.493794    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa85b75c-13a3-49e2-82ae-73308bd158e4-metrics-cert\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.494003 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.493827    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-b85xn\" (UniqueName: \"kubernetes.io/projected/aa85b75c-13a3-49e2-82ae-73308bd158e4-kube-api-access-b85xn\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.494003 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.493862    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa85b75c-13a3-49e2-82ae-73308bd158e4-cert\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.494463 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.494444    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/aa85b75c-13a3-49e2-82ae-73308bd158e4-manager-config\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.496446 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.496423    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aa85b75c-13a3-49e2-82ae-73308bd158e4-cert\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.496545 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.496466    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/aa85b75c-13a3-49e2-82ae-73308bd158e4-metrics-cert\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.503438 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.503391    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b85xn\" (UniqueName: \"kubernetes.io/projected/aa85b75c-13a3-49e2-82ae-73308bd158e4-kube-api-access-b85xn\") pod \"lws-controller-manager-64fd4455d7-fmbpz\" (UID: \"aa85b75c-13a3-49e2-82ae-73308bd158e4\") " pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.638369 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.638336    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:24.769838 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:24.769813    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"]
Jun 01 21:48:24.772470 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:48:24.772434    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa85b75c_13a3_49e2_82ae_73308bd158e4.slice/crio-984f563dea5a737caa84ab8c03ff35be0c3f2bb83d4c9cbf143413634805cc96 WatchSource:0}: Error finding container 984f563dea5a737caa84ab8c03ff35be0c3f2bb83d4c9cbf143413634805cc96: Status 404 returned error can't find the container with id 984f563dea5a737caa84ab8c03ff35be0c3f2bb83d4c9cbf143413634805cc96
Jun 01 21:48:25.588154 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:25.588115    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz" event={"ID":"aa85b75c-13a3-49e2-82ae-73308bd158e4","Type":"ContainerStarted","Data":"984f563dea5a737caa84ab8c03ff35be0c3f2bb83d4c9cbf143413634805cc96"}
Jun 01 21:48:28.598419 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:28.598379    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz" event={"ID":"aa85b75c-13a3-49e2-82ae-73308bd158e4","Type":"ContainerStarted","Data":"be01c08d1debf77422138fc04419da36763832330e7d0b7e409a60df63fd71be"}
Jun 01 21:48:28.598807 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:28.598545    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:28.614885 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:28.614829    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz" podStartSLOduration=1.179660707 podStartE2EDuration="4.614811539s" podCreationTimestamp="2026-06-01 21:48:24 +0000 UTC" firstStartedPulling="2026-06-01 21:48:24.774312157 +0000 UTC m=+396.080751399" lastFinishedPulling="2026-06-01 21:48:28.209462989 +0000 UTC m=+399.515902231" observedRunningTime="2026-06-01 21:48:28.613950618 +0000 UTC m=+399.920389879" watchObservedRunningTime="2026-06-01 21:48:28.614811539 +0000 UTC m=+399.921250809"
Jun 01 21:48:30.835855 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.835814    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"]
Jun 01 21:48:30.839454 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.839430    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:30.844362 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:48:30.844332    2562 reflector.go:200] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-134-181.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-181.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jun 01 21:48:30.844537 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.844444    2562 status_manager.go:895] "Failed to get status for pod" podUID="cbd81485-ac02-413f-94ca-80c712dd3527" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct" err="pods \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" is forbidden: User \"system:node:ip-10-0-134-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-134-181.ec2.internal' and this object"
Jun 01 21:48:30.844991 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.844968    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jun 01 21:48:30.845156 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.845055    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jun 01 21:48:30.845500 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.845478    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jun 01 21:48:30.845618 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.845526    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-d54dr\""
Jun 01 21:48:30.893259 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.893229    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"]
Jun 01 21:48:30.953472 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.953436    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rpwn\" (UniqueName: \"kubernetes.io/projected/cbd81485-ac02-413f-94ca-80c712dd3527-kube-api-access-9rpwn\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:30.953649 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.953486    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cbd81485-ac02-413f-94ca-80c712dd3527-manifests\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:30.953649 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.953526    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cbd81485-ac02-413f-94ca-80c712dd3527-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:30.953649 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.953588    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbd81485-ac02-413f-94ca-80c712dd3527-tmp\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:30.953649 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:30.953615    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbd81485-ac02-413f-94ca-80c712dd3527-webhook-cert\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.054484 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.054442    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cbd81485-ac02-413f-94ca-80c712dd3527-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.054673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.054502    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbd81485-ac02-413f-94ca-80c712dd3527-tmp\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.054673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.054533    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbd81485-ac02-413f-94ca-80c712dd3527-webhook-cert\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.054673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.054586    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-9rpwn\" (UniqueName: \"kubernetes.io/projected/cbd81485-ac02-413f-94ca-80c712dd3527-kube-api-access-9rpwn\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.054673 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.054605    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cbd81485-ac02-413f-94ca-80c712dd3527-manifests\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.055076 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.055046    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cbd81485-ac02-413f-94ca-80c712dd3527-manifests\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.056825 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.056799    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cbd81485-ac02-413f-94ca-80c712dd3527-tmp\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.057049 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.057031    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cbd81485-ac02-413f-94ca-80c712dd3527-webhook-cert\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.057174 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.057153    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cbd81485-ac02-413f-94ca-80c712dd3527-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:31.897121 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.897087    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jun 01 21:48:31.905093 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:31.905075    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rpwn\" (UniqueName: \"kubernetes.io/projected/cbd81485-ac02-413f-94ca-80c712dd3527-kube-api-access-9rpwn\") pod \"opendatahub-operator-controller-manager-5568c4bcd5-vtqct\" (UID: \"cbd81485-ac02-413f-94ca-80c712dd3527\") " pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:32.049650 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:32.049601    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:32.177661 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:32.177624    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"]
Jun 01 21:48:32.184328 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:48:32.184300    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbd81485_ac02_413f_94ca_80c712dd3527.slice/crio-15612f540ef9086dca403f9d912db4486665c56c08066b5577d5c49ec2091106 WatchSource:0}: Error finding container 15612f540ef9086dca403f9d912db4486665c56c08066b5577d5c49ec2091106: Status 404 returned error can't find the container with id 15612f540ef9086dca403f9d912db4486665c56c08066b5577d5c49ec2091106
Jun 01 21:48:32.614890 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:32.614837    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct" event={"ID":"cbd81485-ac02-413f-94ca-80c712dd3527","Type":"ContainerStarted","Data":"15612f540ef9086dca403f9d912db4486665c56c08066b5577d5c49ec2091106"}
Jun 01 21:48:35.626247 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:35.626206    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct" event={"ID":"cbd81485-ac02-413f-94ca-80c712dd3527","Type":"ContainerStarted","Data":"3170a02ab21242f5a9d79185121090d4abb51bf46e050b53013c9fca6b235b4a"}
Jun 01 21:48:36.631399 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:36.631361    2562 generic.go:358] "Generic (PLEG): container finished" podID="cbd81485-ac02-413f-94ca-80c712dd3527" containerID="3170a02ab21242f5a9d79185121090d4abb51bf46e050b53013c9fca6b235b4a" exitCode=0
Jun 01 21:48:36.631897 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:36.631438    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct" event={"ID":"cbd81485-ac02-413f-94ca-80c712dd3527","Type":"ContainerDied","Data":"3170a02ab21242f5a9d79185121090d4abb51bf46e050b53013c9fca6b235b4a"}
Jun 01 21:48:37.636462 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:37.636391    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct" event={"ID":"cbd81485-ac02-413f-94ca-80c712dd3527","Type":"ContainerStarted","Data":"b185bccb1957165ae6cae7ec819c671eef73b86ce4abc895e41fd20bd6e21d50"}
Jun 01 21:48:37.636939 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:37.636579    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:48:37.673984 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:37.673930    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct" podStartSLOduration=2.897053585 podStartE2EDuration="7.673913202s" podCreationTimestamp="2026-06-01 21:48:30 +0000 UTC" firstStartedPulling="2026-06-01 21:48:32.186609563 +0000 UTC m=+403.493048804" lastFinishedPulling="2026-06-01 21:48:36.963469168 +0000 UTC m=+408.269908421" observedRunningTime="2026-06-01 21:48:37.671019489 +0000 UTC m=+408.977458754" watchObservedRunningTime="2026-06-01 21:48:37.673913202 +0000 UTC m=+408.980352466"
Jun 01 21:48:39.603967 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:39.603936    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-64fd4455d7-fmbpz"
Jun 01 21:48:48.641835 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:48:48.641801    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5568c4bcd5-vtqct"
Jun 01 21:49:29.762014 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.761975    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"]
Jun 01 21:49:29.765712 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.765682    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.768686 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.768654    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jun 01 21:49:29.769151 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.769128    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-h2r8l\""
Jun 01 21:49:29.782201 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.782165    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"]
Jun 01 21:49:29.858786 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.858750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.858786 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.858787    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.859001 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.858844    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.859001 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.858911    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.859001 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.858928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.859001 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.858956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.859140 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.859017    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-thfhl\" (UniqueName: \"kubernetes.io/projected/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-kube-api-access-thfhl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.859140 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.859048    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.859140 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.859069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960198 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960155    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960198 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960198    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960220    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960241    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-thfhl\" (UniqueName: \"kubernetes.io/projected/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-kube-api-access-thfhl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960259    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960278    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960460 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960430    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960708 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960469    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960708 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960519    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960708 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960655    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960858 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.960943 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960918    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.961002 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.960928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.961288 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.961265    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.962586 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.962565    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.962803 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.962784    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.982127 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.982097    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:29.982458 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:29.982440    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-thfhl\" (UniqueName: \"kubernetes.io/projected/aff5ea39-74c7-4ab5-9a33-0d849b311e7e-kube-api-access-thfhl\") pod \"data-science-gateway-data-science-gateway-class-686dffbf4bzt665\" (UID: \"aff5ea39-74c7-4ab5-9a33-0d849b311e7e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:30.078183 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:30.078084    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:30.212508 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:30.212479    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"]
Jun 01 21:49:30.215519 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:49:30.215487    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaff5ea39_74c7_4ab5_9a33_0d849b311e7e.slice/crio-d01fd02253d7ac6a9ba419979e3ed81d9cffce9045d4460c62bb71aa2a10d3fe WatchSource:0}: Error finding container d01fd02253d7ac6a9ba419979e3ed81d9cffce9045d4460c62bb71aa2a10d3fe: Status 404 returned error can't find the container with id d01fd02253d7ac6a9ba419979e3ed81d9cffce9045d4460c62bb71aa2a10d3fe
Jun 01 21:49:30.806566 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:30.806527    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665" event={"ID":"aff5ea39-74c7-4ab5-9a33-0d849b311e7e","Type":"ContainerStarted","Data":"d01fd02253d7ac6a9ba419979e3ed81d9cffce9045d4460c62bb71aa2a10d3fe"}
Jun 01 21:49:32.562231 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:32.562176    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 01 21:49:32.562616 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:32.562286    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 01 21:49:32.562616 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:32.562338    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 01 21:49:32.814902 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:32.814817    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665" event={"ID":"aff5ea39-74c7-4ab5-9a33-0d849b311e7e","Type":"ContainerStarted","Data":"886fdb1b7656baca1f8a3fc46449d74b7ea1646605380619f6ea8c0ed0c2a50f"}
Jun 01 21:49:32.836991 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:32.836940    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665" podStartSLOduration=1.492532922 podStartE2EDuration="3.836924723s" podCreationTimestamp="2026-06-01 21:49:29 +0000 UTC" firstStartedPulling="2026-06-01 21:49:30.217521354 +0000 UTC m=+461.523960597" lastFinishedPulling="2026-06-01 21:49:32.561913153 +0000 UTC m=+463.868352398" observedRunningTime="2026-06-01 21:49:32.83547836 +0000 UTC m=+464.141917619" watchObservedRunningTime="2026-06-01 21:49:32.836924723 +0000 UTC m=+464.143363987"
Jun 01 21:49:33.079044 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.078944    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:33.083694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.083670    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:33.220714 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.220683    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-8c87cb59-cfhdp"]
Jun 01 21:49:33.224520 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.224495    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.228573 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.228554    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\""
Jun 01 21:49:33.228713 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.228576    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-8k7dw\""
Jun 01 21:49:33.237832 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.237808    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8c87cb59-cfhdp"]
Jun 01 21:49:33.291823 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.291786    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3e3cc008-f299-4764-8639-687bbf183884-redirect-config\") pod \"dashboard-redirect-8c87cb59-cfhdp\" (UID: \"3e3cc008-f299-4764-8639-687bbf183884\") " pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.292007 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.291867    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwxth\" (UniqueName: \"kubernetes.io/projected/3e3cc008-f299-4764-8639-687bbf183884-kube-api-access-qwxth\") pod \"dashboard-redirect-8c87cb59-cfhdp\" (UID: \"3e3cc008-f299-4764-8639-687bbf183884\") " pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.392323 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.392285    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3e3cc008-f299-4764-8639-687bbf183884-redirect-config\") pod \"dashboard-redirect-8c87cb59-cfhdp\" (UID: \"3e3cc008-f299-4764-8639-687bbf183884\") " pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.392529 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.392508    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-qwxth\" (UniqueName: \"kubernetes.io/projected/3e3cc008-f299-4764-8639-687bbf183884-kube-api-access-qwxth\") pod \"dashboard-redirect-8c87cb59-cfhdp\" (UID: \"3e3cc008-f299-4764-8639-687bbf183884\") " pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.393065 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.393041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/3e3cc008-f299-4764-8639-687bbf183884-redirect-config\") pod \"dashboard-redirect-8c87cb59-cfhdp\" (UID: \"3e3cc008-f299-4764-8639-687bbf183884\") " pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.401019 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.400992    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwxth\" (UniqueName: \"kubernetes.io/projected/3e3cc008-f299-4764-8639-687bbf183884-kube-api-access-qwxth\") pod \"dashboard-redirect-8c87cb59-cfhdp\" (UID: \"3e3cc008-f299-4764-8639-687bbf183884\") " pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.535313 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.535275    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp"
Jun 01 21:49:33.663423 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.663376    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-8c87cb59-cfhdp"]
Jun 01 21:49:33.665867 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:49:33.665838    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e3cc008_f299_4764_8639_687bbf183884.slice/crio-24d1eecb6e73fea6d0edd77cbe254f1c0ea7e5090a6049c3c18653f440af7829 WatchSource:0}: Error finding container 24d1eecb6e73fea6d0edd77cbe254f1c0ea7e5090a6049c3c18653f440af7829: Status 404 returned error can't find the container with id 24d1eecb6e73fea6d0edd77cbe254f1c0ea7e5090a6049c3c18653f440af7829
Jun 01 21:49:33.820063 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.820020    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp" event={"ID":"3e3cc008-f299-4764-8639-687bbf183884","Type":"ContainerStarted","Data":"24d1eecb6e73fea6d0edd77cbe254f1c0ea7e5090a6049c3c18653f440af7829"}
Jun 01 21:49:33.820256 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.820237    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:33.821734 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:33.821716    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-686dffbf4bzt665"
Jun 01 21:49:35.828524 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:35.828436    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp" event={"ID":"3e3cc008-f299-4764-8639-687bbf183884","Type":"ContainerStarted","Data":"82efe748316fbd0db65fa11459c457d2f095843fbbe02a584b1ec0b457ccd6ee"}
Jun 01 21:49:35.845783 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:35.845729    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-8c87cb59-cfhdp" podStartSLOduration=0.996540388 podStartE2EDuration="2.845714504s" podCreationTimestamp="2026-06-01 21:49:33 +0000 UTC" firstStartedPulling="2026-06-01 21:49:33.667386995 +0000 UTC m=+464.973826237" lastFinishedPulling="2026-06-01 21:49:35.516561107 +0000 UTC m=+466.823000353" observedRunningTime="2026-06-01 21:49:35.843638449 +0000 UTC m=+467.150077716" watchObservedRunningTime="2026-06-01 21:49:35.845714504 +0000 UTC m=+467.152153769"
Jun 01 21:49:51.896378 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:51.896335    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kkj98"]
Jun 01 21:49:51.900920 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:51.900895    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kkj98"
Jun 01 21:49:51.903380 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:51.903356    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jun 01 21:49:51.903547 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:51.903501    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jun 01 21:49:51.903618 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:51.903396    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-84h5d\""
Jun 01 21:49:51.911725 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:51.911699    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kkj98"]
Jun 01 21:49:51.969585 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:51.969547    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7rbz\" (UniqueName: \"kubernetes.io/projected/a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c-kube-api-access-q7rbz\") pod \"kuadrant-operator-catalog-kkj98\" (UID: \"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c\") " pod="kuadrant-system/kuadrant-operator-catalog-kkj98"
Jun 01 21:49:52.070760 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.070727    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-q7rbz\" (UniqueName: \"kubernetes.io/projected/a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c-kube-api-access-q7rbz\") pod \"kuadrant-operator-catalog-kkj98\" (UID: \"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c\") " pod="kuadrant-system/kuadrant-operator-catalog-kkj98"
Jun 01 21:49:52.078651 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.078616    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7rbz\" (UniqueName: \"kubernetes.io/projected/a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c-kube-api-access-q7rbz\") pod \"kuadrant-operator-catalog-kkj98\" (UID: \"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c\") " pod="kuadrant-system/kuadrant-operator-catalog-kkj98"
Jun 01 21:49:52.212268 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.212185    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kkj98"
Jun 01 21:49:52.264000 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.263966    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kkj98"]
Jun 01 21:49:52.346306 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.346275    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kkj98"]
Jun 01 21:49:52.348983 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:49:52.348952    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2c02951_ba7b_4da2_b4ed_a7ebb4ce2c3c.slice/crio-e4f5eabceed24e202912d59761d05c16399154b473995c6284a4c0db81b55232 WatchSource:0}: Error finding container e4f5eabceed24e202912d59761d05c16399154b473995c6284a4c0db81b55232: Status 404 returned error can't find the container with id e4f5eabceed24e202912d59761d05c16399154b473995c6284a4c0db81b55232
Jun 01 21:49:52.471573 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.471489    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vt67s"]
Jun 01 21:49:52.476395 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.476379    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:49:52.482010 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.481985    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vt67s"]
Jun 01 21:49:52.575153 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.575118    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqkwl\" (UniqueName: \"kubernetes.io/projected/70d678eb-52a2-46ed-8d6c-5be7c9a45f11-kube-api-access-wqkwl\") pod \"kuadrant-operator-catalog-vt67s\" (UID: \"70d678eb-52a2-46ed-8d6c-5be7c9a45f11\") " pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:49:52.676388 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.676350    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-wqkwl\" (UniqueName: \"kubernetes.io/projected/70d678eb-52a2-46ed-8d6c-5be7c9a45f11-kube-api-access-wqkwl\") pod \"kuadrant-operator-catalog-vt67s\" (UID: \"70d678eb-52a2-46ed-8d6c-5be7c9a45f11\") " pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:49:52.684781 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.684755    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqkwl\" (UniqueName: \"kubernetes.io/projected/70d678eb-52a2-46ed-8d6c-5be7c9a45f11-kube-api-access-wqkwl\") pod \"kuadrant-operator-catalog-vt67s\" (UID: \"70d678eb-52a2-46ed-8d6c-5be7c9a45f11\") " pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:49:52.787615 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.787518    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:49:52.888878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.888842    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kkj98" event={"ID":"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c","Type":"ContainerStarted","Data":"e4f5eabceed24e202912d59761d05c16399154b473995c6284a4c0db81b55232"}
Jun 01 21:49:52.916462 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:52.916430    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-vt67s"]
Jun 01 21:49:52.920110 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:49:52.920081    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70d678eb_52a2_46ed_8d6c_5be7c9a45f11.slice/crio-8c65aa4fa0f59bbb25afe85fc7c88095f6d08a4a39a07dcc95b7557bdeb3b3ca WatchSource:0}: Error finding container 8c65aa4fa0f59bbb25afe85fc7c88095f6d08a4a39a07dcc95b7557bdeb3b3ca: Status 404 returned error can't find the container with id 8c65aa4fa0f59bbb25afe85fc7c88095f6d08a4a39a07dcc95b7557bdeb3b3ca
Jun 01 21:49:53.896903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:53.896845    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vt67s" event={"ID":"70d678eb-52a2-46ed-8d6c-5be7c9a45f11","Type":"ContainerStarted","Data":"8c65aa4fa0f59bbb25afe85fc7c88095f6d08a4a39a07dcc95b7557bdeb3b3ca"}
Jun 01 21:49:54.901987 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:54.901881    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kkj98" event={"ID":"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c","Type":"ContainerStarted","Data":"7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3"}
Jun 01 21:49:54.901987 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:54.901926    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-kkj98" podUID="a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c" containerName="registry-server" containerID="cri-o://7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3" gracePeriod=2
Jun 01 21:49:54.903303 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:54.903278    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-vt67s" event={"ID":"70d678eb-52a2-46ed-8d6c-5be7c9a45f11","Type":"ContainerStarted","Data":"764928f7b69a5c65a12fa8a6e1ff39d5ad9f1380ff34ae6cf6898b0a20723dc7"}
Jun 01 21:49:54.918981 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:54.918927    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-kkj98" podStartSLOduration=1.646256539 podStartE2EDuration="3.91891455s" podCreationTimestamp="2026-06-01 21:49:51 +0000 UTC" firstStartedPulling="2026-06-01 21:49:52.350466416 +0000 UTC m=+483.656905658" lastFinishedPulling="2026-06-01 21:49:54.623124423 +0000 UTC m=+485.929563669" observedRunningTime="2026-06-01 21:49:54.916881886 +0000 UTC m=+486.223321152" watchObservedRunningTime="2026-06-01 21:49:54.91891455 +0000 UTC m=+486.225353813"
Jun 01 21:49:54.931579 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:54.931522    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-vt67s" podStartSLOduration=1.227136238 podStartE2EDuration="2.931504362s" podCreationTimestamp="2026-06-01 21:49:52 +0000 UTC" firstStartedPulling="2026-06-01 21:49:52.921513319 +0000 UTC m=+484.227952560" lastFinishedPulling="2026-06-01 21:49:54.625881442 +0000 UTC m=+485.932320684" observedRunningTime="2026-06-01 21:49:54.930695947 +0000 UTC m=+486.237135213" watchObservedRunningTime="2026-06-01 21:49:54.931504362 +0000 UTC m=+486.237943630"
Jun 01 21:49:55.148817 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.148791    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kkj98"
Jun 01 21:49:55.197307 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.197210    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q7rbz\" (UniqueName: \"kubernetes.io/projected/a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c-kube-api-access-q7rbz\") pod \"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c\" (UID: \"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c\") "
Jun 01 21:49:55.201033 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.200442    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c-kube-api-access-q7rbz" (OuterVolumeSpecName: "kube-api-access-q7rbz") pod "a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c" (UID: "a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c"). InnerVolumeSpecName "kube-api-access-q7rbz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 21:49:55.301739 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.301691    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q7rbz\" (UniqueName: \"kubernetes.io/projected/a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c-kube-api-access-q7rbz\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:49:55.908224 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.908132    2562 generic.go:358] "Generic (PLEG): container finished" podID="a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c" containerID="7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3" exitCode=0
Jun 01 21:49:55.908224 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.908211    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kkj98" event={"ID":"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c","Type":"ContainerDied","Data":"7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3"}
Jun 01 21:49:55.908666 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.908220    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-kkj98"
Jun 01 21:49:55.908666 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.908248    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-kkj98" event={"ID":"a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c","Type":"ContainerDied","Data":"e4f5eabceed24e202912d59761d05c16399154b473995c6284a4c0db81b55232"}
Jun 01 21:49:55.908666 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.908258    2562 scope.go:117] "RemoveContainer" containerID="7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3"
Jun 01 21:49:55.917537 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.917509    2562 scope.go:117] "RemoveContainer" containerID="7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3"
Jun 01 21:49:55.917782 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:49:55.917764    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3\": container with ID starting with 7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3 not found: ID does not exist" containerID="7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3"
Jun 01 21:49:55.917831 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.917789    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3"} err="failed to get container status \"7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3\": rpc error: code = NotFound desc = could not find container \"7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3\": container with ID starting with 7269d3e8c82e7cb633e1a2c5b8961f7950dee20811a97550480b02ff2d2741d3 not found: ID does not exist"
Jun 01 21:49:55.924768 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.924742    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kkj98"]
Jun 01 21:49:55.927656 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:55.927634    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-kkj98"]
Jun 01 21:49:57.306358 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:49:57.306323    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c" path="/var/lib/kubelet/pods/a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c/volumes"
Jun 01 21:50:02.788310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:02.788275    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:50:02.788310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:02.788318    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:50:02.810689 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:02.810663    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:50:02.954796 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:02.954762    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-vt67s"
Jun 01 21:50:28.185303 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.185266    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"]
Jun 01 21:50:28.185701 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.185686    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c" containerName="registry-server"
Jun 01 21:50:28.185744 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.185702    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c" containerName="registry-server"
Jun 01 21:50:28.185777 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.185756    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="a2c02951-ba7b-4da2-b4ed-a7ebb4ce2c3c" containerName="registry-server"
Jun 01 21:50:28.199551 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.199517    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"]
Jun 01 21:50:28.199717 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.199621    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:28.202178 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.202151    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-lzqfw\""
Jun 01 21:50:28.300379 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.300339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5zrd\" (UniqueName: \"kubernetes.io/projected/becdb4f1-8a0c-4ff1-ab85-69e1cac63074-kube-api-access-l5zrd\") pod \"limitador-operator-controller-manager-85c4996f8c-zc67b\" (UID: \"becdb4f1-8a0c-4ff1-ab85-69e1cac63074\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:28.401852 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.401813    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-l5zrd\" (UniqueName: \"kubernetes.io/projected/becdb4f1-8a0c-4ff1-ab85-69e1cac63074-kube-api-access-l5zrd\") pod \"limitador-operator-controller-manager-85c4996f8c-zc67b\" (UID: \"becdb4f1-8a0c-4ff1-ab85-69e1cac63074\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:28.419865 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.419829    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5zrd\" (UniqueName: \"kubernetes.io/projected/becdb4f1-8a0c-4ff1-ab85-69e1cac63074-kube-api-access-l5zrd\") pod \"limitador-operator-controller-manager-85c4996f8c-zc67b\" (UID: \"becdb4f1-8a0c-4ff1-ab85-69e1cac63074\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:28.510535 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.510497    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:28.653468 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:28.651225    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"]
Jun 01 21:50:28.655183 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:50:28.655153    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbecdb4f1_8a0c_4ff1_ab85_69e1cac63074.slice/crio-e4dd3b052cec93b97134b6148a8d523bb460b3a8b1d3cc5f8972a69f5d294b6f WatchSource:0}: Error finding container e4dd3b052cec93b97134b6148a8d523bb460b3a8b1d3cc5f8972a69f5d294b6f: Status 404 returned error can't find the container with id e4dd3b052cec93b97134b6148a8d523bb460b3a8b1d3cc5f8972a69f5d294b6f
Jun 01 21:50:29.025092 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:29.025003    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b" event={"ID":"becdb4f1-8a0c-4ff1-ab85-69e1cac63074","Type":"ContainerStarted","Data":"e4dd3b052cec93b97134b6148a8d523bb460b3a8b1d3cc5f8972a69f5d294b6f"}
Jun 01 21:50:31.033499 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:31.033458    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b" event={"ID":"becdb4f1-8a0c-4ff1-ab85-69e1cac63074","Type":"ContainerStarted","Data":"d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb"}
Jun 01 21:50:31.033885 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:31.033522    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:31.052590 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:31.052540    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b" podStartSLOduration=1.243733968 podStartE2EDuration="3.052525437s" podCreationTimestamp="2026-06-01 21:50:28 +0000 UTC" firstStartedPulling="2026-06-01 21:50:28.65755211 +0000 UTC m=+519.963991355" lastFinishedPulling="2026-06-01 21:50:30.466343579 +0000 UTC m=+521.772782824" observedRunningTime="2026-06-01 21:50:31.051326072 +0000 UTC m=+522.357765363" watchObservedRunningTime="2026-06-01 21:50:31.052525437 +0000 UTC m=+522.358964701"
Jun 01 21:50:36.127645 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.127550    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"]
Jun 01 21:50:36.131279 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.131256    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"
Jun 01 21:50:36.133826 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.133796    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jun 01 21:50:36.133940 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.133828    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-wggcq\""
Jun 01 21:50:36.149157 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.149123    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"]
Jun 01 21:50:36.278713 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.278676    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5lplf\" (UniqueName: \"kubernetes.io/projected/cb5ba4c7-93a7-4767-92ee-4a6a869a997c-kube-api-access-5lplf\") pod \"dns-operator-controller-manager-648d5c98bc-rxd2f\" (UID: \"cb5ba4c7-93a7-4767-92ee-4a6a869a997c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"
Jun 01 21:50:36.379807 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.379706    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-5lplf\" (UniqueName: \"kubernetes.io/projected/cb5ba4c7-93a7-4767-92ee-4a6a869a997c-kube-api-access-5lplf\") pod \"dns-operator-controller-manager-648d5c98bc-rxd2f\" (UID: \"cb5ba4c7-93a7-4767-92ee-4a6a869a997c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"
Jun 01 21:50:36.391593 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.391563    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5lplf\" (UniqueName: \"kubernetes.io/projected/cb5ba4c7-93a7-4767-92ee-4a6a869a997c-kube-api-access-5lplf\") pod \"dns-operator-controller-manager-648d5c98bc-rxd2f\" (UID: \"cb5ba4c7-93a7-4767-92ee-4a6a869a997c\") " pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"
Jun 01 21:50:36.441191 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.441154    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"
Jun 01 21:50:36.584641 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:36.584607    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"]
Jun 01 21:50:36.588082 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:50:36.588058    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb5ba4c7_93a7_4767_92ee_4a6a869a997c.slice/crio-bbd7176df3e766fcbb055ece99a873725c76b41c29d4082c1018cb1773032fbe WatchSource:0}: Error finding container bbd7176df3e766fcbb055ece99a873725c76b41c29d4082c1018cb1773032fbe: Status 404 returned error can't find the container with id bbd7176df3e766fcbb055ece99a873725c76b41c29d4082c1018cb1773032fbe
Jun 01 21:50:37.055615 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:37.055580    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f" event={"ID":"cb5ba4c7-93a7-4767-92ee-4a6a869a997c","Type":"ContainerStarted","Data":"bbd7176df3e766fcbb055ece99a873725c76b41c29d4082c1018cb1773032fbe"}
Jun 01 21:50:39.578568 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.578530    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-xwxst"]
Jun 01 21:50:39.582089 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.582071    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-xwxst"
Jun 01 21:50:39.585649 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.585631    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-dr8fd\""
Jun 01 21:50:39.599961 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.599934    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-xwxst"]
Jun 01 21:50:39.615206 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.615178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-776km\" (UniqueName: \"kubernetes.io/projected/501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963-kube-api-access-776km\") pod \"authorino-operator-657f44b778-xwxst\" (UID: \"501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963\") " pod="kuadrant-system/authorino-operator-657f44b778-xwxst"
Jun 01 21:50:39.715623 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.715588    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-776km\" (UniqueName: \"kubernetes.io/projected/501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963-kube-api-access-776km\") pod \"authorino-operator-657f44b778-xwxst\" (UID: \"501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963\") " pod="kuadrant-system/authorino-operator-657f44b778-xwxst"
Jun 01 21:50:39.728695 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.728660    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-776km\" (UniqueName: \"kubernetes.io/projected/501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963-kube-api-access-776km\") pod \"authorino-operator-657f44b778-xwxst\" (UID: \"501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963\") " pod="kuadrant-system/authorino-operator-657f44b778-xwxst"
Jun 01 21:50:39.892589 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:39.892553    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-657f44b778-xwxst"
Jun 01 21:50:40.047819 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:40.047459    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-657f44b778-xwxst"]
Jun 01 21:50:40.050378 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:50:40.050351    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod501ba3fb_0378_4ffb_a2c0_3e1bc8ba8963.slice/crio-674a0655ad25918789c49cf66f44832ff91d67dbf18f27d981c84bfc804e3931 WatchSource:0}: Error finding container 674a0655ad25918789c49cf66f44832ff91d67dbf18f27d981c84bfc804e3931: Status 404 returned error can't find the container with id 674a0655ad25918789c49cf66f44832ff91d67dbf18f27d981c84bfc804e3931
Jun 01 21:50:40.071470 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:40.071435    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-xwxst" event={"ID":"501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963","Type":"ContainerStarted","Data":"674a0655ad25918789c49cf66f44832ff91d67dbf18f27d981c84bfc804e3931"}
Jun 01 21:50:40.072789 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:40.072765    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f" event={"ID":"cb5ba4c7-93a7-4767-92ee-4a6a869a997c","Type":"ContainerStarted","Data":"5f33691d0ccff589e2c6d568316de6a1e8f083b173109106281517a4e7d5a544"}
Jun 01 21:50:40.072899 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:40.072867    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"
Jun 01 21:50:40.110743 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:40.110686    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f" podStartSLOduration=1.698474177 podStartE2EDuration="4.110668799s" podCreationTimestamp="2026-06-01 21:50:36 +0000 UTC" firstStartedPulling="2026-06-01 21:50:36.590595403 +0000 UTC m=+527.897034645" lastFinishedPulling="2026-06-01 21:50:39.002790023 +0000 UTC m=+530.309229267" observedRunningTime="2026-06-01 21:50:40.109324681 +0000 UTC m=+531.415763947" watchObservedRunningTime="2026-06-01 21:50:40.110668799 +0000 UTC m=+531.417108109"
Jun 01 21:50:42.040228 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:42.040195    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:43.085261 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:43.085223    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-657f44b778-xwxst" event={"ID":"501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963","Type":"ContainerStarted","Data":"ea27784b8305bd884c09f98ce2b84682033a75378e0d08f4cc292019ba80ab46"}
Jun 01 21:50:43.085704 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:43.085346    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-657f44b778-xwxst"
Jun 01 21:50:43.126121 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:43.126066    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-657f44b778-xwxst" podStartSLOduration=1.989395632 podStartE2EDuration="4.126051264s" podCreationTimestamp="2026-06-01 21:50:39 +0000 UTC" firstStartedPulling="2026-06-01 21:50:40.05255475 +0000 UTC m=+531.358993993" lastFinishedPulling="2026-06-01 21:50:42.189210377 +0000 UTC m=+533.495649625" observedRunningTime="2026-06-01 21:50:43.124033882 +0000 UTC m=+534.430473173" watchObservedRunningTime="2026-06-01 21:50:43.126051264 +0000 UTC m=+534.432490586"
Jun 01 21:50:51.079323 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:51.079289    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-648d5c98bc-rxd2f"
Jun 01 21:50:53.258435 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.258383    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"]
Jun 01 21:50:53.258853 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.258644    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b" podUID="becdb4f1-8a0c-4ff1-ab85-69e1cac63074" containerName="manager" containerID="cri-o://d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb" gracePeriod=2
Jun 01 21:50:53.271075 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.271047    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"]
Jun 01 21:50:53.285495 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.285465    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"]
Jun 01 21:50:53.285912 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.285899    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="becdb4f1-8a0c-4ff1-ab85-69e1cac63074" containerName="manager"
Jun 01 21:50:53.285954 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.285914    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="becdb4f1-8a0c-4ff1-ab85-69e1cac63074" containerName="manager"
Jun 01 21:50:53.286030 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.285973    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="becdb4f1-8a0c-4ff1-ab85-69e1cac63074" containerName="manager"
Jun 01 21:50:53.289156 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.289137    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"
Jun 01 21:50:53.291390 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.291357    2562 status_manager.go:895] "Failed to get status for pod" podUID="becdb4f1-8a0c-4ff1-ab85-69e1cac63074" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b" err="pods \"limitador-operator-controller-manager-85c4996f8c-zc67b\" is forbidden: User \"system:node:ip-10-0-134-181.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-134-181.ec2.internal' and this object"
Jun 01 21:50:53.297131 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.297096    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"]
Jun 01 21:50:53.329351 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.329322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xsbcq\" (UniqueName: \"kubernetes.io/projected/7dda1021-5ea0-404a-afa0-8ea56d493506-kube-api-access-xsbcq\") pod \"limitador-operator-controller-manager-85c4996f8c-xx4j6\" (UID: \"7dda1021-5ea0-404a-afa0-8ea56d493506\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"
Jun 01 21:50:53.430113 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.430075    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-xsbcq\" (UniqueName: \"kubernetes.io/projected/7dda1021-5ea0-404a-afa0-8ea56d493506-kube-api-access-xsbcq\") pod \"limitador-operator-controller-manager-85c4996f8c-xx4j6\" (UID: \"7dda1021-5ea0-404a-afa0-8ea56d493506\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"
Jun 01 21:50:53.438669 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.438636    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xsbcq\" (UniqueName: \"kubernetes.io/projected/7dda1021-5ea0-404a-afa0-8ea56d493506-kube-api-access-xsbcq\") pod \"limitador-operator-controller-manager-85c4996f8c-xx4j6\" (UID: \"7dda1021-5ea0-404a-afa0-8ea56d493506\") " pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"
Jun 01 21:50:53.494076 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.494045    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:53.530605 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.530527    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5zrd\" (UniqueName: \"kubernetes.io/projected/becdb4f1-8a0c-4ff1-ab85-69e1cac63074-kube-api-access-l5zrd\") pod \"becdb4f1-8a0c-4ff1-ab85-69e1cac63074\" (UID: \"becdb4f1-8a0c-4ff1-ab85-69e1cac63074\") "
Jun 01 21:50:53.532658 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.532626    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/becdb4f1-8a0c-4ff1-ab85-69e1cac63074-kube-api-access-l5zrd" (OuterVolumeSpecName: "kube-api-access-l5zrd") pod "becdb4f1-8a0c-4ff1-ab85-69e1cac63074" (UID: "becdb4f1-8a0c-4ff1-ab85-69e1cac63074"). InnerVolumeSpecName "kube-api-access-l5zrd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 21:50:53.631729 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.631687    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5zrd\" (UniqueName: \"kubernetes.io/projected/becdb4f1-8a0c-4ff1-ab85-69e1cac63074-kube-api-access-l5zrd\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:50:53.643560 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.643525    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"
Jun 01 21:50:53.790598 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:53.790572    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"]
Jun 01 21:50:53.793132 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:50:53.793106    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7dda1021_5ea0_404a_afa0_8ea56d493506.slice/crio-ac88bd2dbbaadc46ad4251f820377e309811e32a1008e9adb8ac2bd404c78236 WatchSource:0}: Error finding container ac88bd2dbbaadc46ad4251f820377e309811e32a1008e9adb8ac2bd404c78236: Status 404 returned error can't find the container with id ac88bd2dbbaadc46ad4251f820377e309811e32a1008e9adb8ac2bd404c78236
Jun 01 21:50:54.090787 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.090694    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-657f44b778-xwxst"
Jun 01 21:50:54.124903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.124866    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6" event={"ID":"7dda1021-5ea0-404a-afa0-8ea56d493506","Type":"ContainerStarted","Data":"9e8ae8c69f04f88c78d2f2302ea9301d9485dfbb4f543c92114cf6da62e3c5b3"}
Jun 01 21:50:54.124903 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.124902    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6" event={"ID":"7dda1021-5ea0-404a-afa0-8ea56d493506","Type":"ContainerStarted","Data":"ac88bd2dbbaadc46ad4251f820377e309811e32a1008e9adb8ac2bd404c78236"}
Jun 01 21:50:54.125145 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.124936    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"
Jun 01 21:50:54.126270 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.126244    2562 generic.go:358] "Generic (PLEG): container finished" podID="becdb4f1-8a0c-4ff1-ab85-69e1cac63074" containerID="d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb" exitCode=0
Jun 01 21:50:54.126423 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.126279    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-zc67b"
Jun 01 21:50:54.126423 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.126292    2562 scope.go:117] "RemoveContainer" containerID="d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb"
Jun 01 21:50:54.135743 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.135659    2562 scope.go:117] "RemoveContainer" containerID="d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb"
Jun 01 21:50:54.136020 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:50:54.136001    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb\": container with ID starting with d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb not found: ID does not exist" containerID="d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb"
Jun 01 21:50:54.136094 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.136031    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb"} err="failed to get container status \"d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb\": rpc error: code = NotFound desc = could not find container \"d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb\": container with ID starting with d0a33b17f964a4ba454e15ebd04631d621a10c6ea0def380f31b99096100ecdb not found: ID does not exist"
Jun 01 21:50:54.148814 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:54.148763    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6" podStartSLOduration=1.1487496369999999 podStartE2EDuration="1.148749637s" podCreationTimestamp="2026-06-01 21:50:53 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 21:50:54.1464525 +0000 UTC m=+545.452891765" watchObservedRunningTime="2026-06-01 21:50:54.148749637 +0000 UTC m=+545.455188901"
Jun 01 21:50:55.306722 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:50:55.306687    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="becdb4f1-8a0c-4ff1-ab85-69e1cac63074" path="/var/lib/kubelet/pods/becdb4f1-8a0c-4ff1-ab85-69e1cac63074/volumes"
Jun 01 21:51:05.132826 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:05.132790    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-85c4996f8c-xx4j6"
Jun 01 21:51:38.767863 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.767822    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"]
Jun 01 21:51:38.771642 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.771618    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.774238 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.774214    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-2b72j\""
Jun 01 21:51:38.782973 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.782949    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"]
Jun 01 21:51:38.839928 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.839887    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840088 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.839957    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840088 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.839982    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840088 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.840003    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.840123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840234 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.840208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsmwk\" (UniqueName: \"kubernetes.io/projected/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-kube-api-access-bsmwk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840334 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.840234    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840334 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.840268    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.840334 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.840301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941169 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941112    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-bsmwk\" (UniqueName: \"kubernetes.io/projected/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-kube-api-access-bsmwk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941169 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941173    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941485 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941194    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941485 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941215    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941485 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941236    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941485 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941280    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941485 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941308    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941485 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941340    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941485 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941384    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941838 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-data\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941838 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941720    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-workload-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941838 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941802    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-credential-socket\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941989 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941919    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-workload-certs\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.941989 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.941983    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.943762 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.943737    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-envoy\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.944151 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.944129    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-podinfo\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.949301 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.949276    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsmwk\" (UniqueName: \"kubernetes.io/projected/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-kube-api-access-bsmwk\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:38.949421 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:38.949327    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22ea6f6b-2a89-480c-b66a-f0a852ce97f0-istio-token\") pod \"maas-default-gateway-openshift-default-7d6f447cf5-9kt8x\" (UID: \"22ea6f6b-2a89-480c-b66a-f0a852ce97f0\") " pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:39.083206 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:39.083100    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:39.225794 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:39.225764    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"]
Jun 01 21:51:39.229437 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:51:39.229394    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22ea6f6b_2a89_480c_b66a_f0a852ce97f0.slice/crio-24cfaf743a40d771b69322e31f7f588f73c7516e85c2aae682c8516b95ac4bdf WatchSource:0}: Error finding container 24cfaf743a40d771b69322e31f7f588f73c7516e85c2aae682c8516b95ac4bdf: Status 404 returned error can't find the container with id 24cfaf743a40d771b69322e31f7f588f73c7516e85c2aae682c8516b95ac4bdf
Jun 01 21:51:39.231784 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:39.231747    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 01 21:51:39.231855 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:39.231830    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 01 21:51:39.231904 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:39.231859    2562 kubelet_resources.go:45] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jun 01 21:51:39.297354 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:39.297300    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x" event={"ID":"22ea6f6b-2a89-480c-b66a-f0a852ce97f0","Type":"ContainerStarted","Data":"24cfaf743a40d771b69322e31f7f588f73c7516e85c2aae682c8516b95ac4bdf"}
Jun 01 21:51:40.302806 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:40.302764    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x" event={"ID":"22ea6f6b-2a89-480c-b66a-f0a852ce97f0","Type":"ContainerStarted","Data":"2103d521ecd01bd0a1ea496238362b508f2893d5f70255551720fcfc1e60c472"}
Jun 01 21:51:40.328009 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:40.327944    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x" podStartSLOduration=2.327924715 podStartE2EDuration="2.327924715s" podCreationTimestamp="2026-06-01 21:51:38 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 21:51:40.327493139 +0000 UTC m=+591.633932404" watchObservedRunningTime="2026-06-01 21:51:40.327924715 +0000 UTC m=+591.634363982"
Jun 01 21:51:41.083296 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:41.083263    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:41.088296 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:41.088271    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:41.307333 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:41.307297    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:41.307802 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:41.307783    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-7d6f447cf5-9kt8x"
Jun 01 21:51:49.248308 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:49.248278    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:51:49.250011 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:49.249990    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:51:49.251045 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:49.251020    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:51:49.252497 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:51:49.252477    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:52:44.330043 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.330008    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 21:52:44.333551 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.333533    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 01 21:52:44.336039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.336012    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tdrqb\""
Jun 01 21:52:44.336039 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.336019    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 01 21:52:44.337107 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.337092    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 01 21:52:44.337169 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.337110    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 01 21:52:44.340653 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.340629    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 21:52:44.428399 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.428357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drqnz\" (UniqueName: \"kubernetes.io/projected/cfe46922-9dd9-49b4-abae-453b2c238266-kube-api-access-drqnz\") pod \"maas-keycloak-0\" (UID: \"cfe46922-9dd9-49b4-abae-453b2c238266\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 21:52:44.529572 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.529539    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-drqnz\" (UniqueName: \"kubernetes.io/projected/cfe46922-9dd9-49b4-abae-453b2c238266-kube-api-access-drqnz\") pod \"maas-keycloak-0\" (UID: \"cfe46922-9dd9-49b4-abae-453b2c238266\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 21:52:44.538349 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.538317    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drqnz\" (UniqueName: \"kubernetes.io/projected/cfe46922-9dd9-49b4-abae-453b2c238266-kube-api-access-drqnz\") pod \"maas-keycloak-0\" (UID: \"cfe46922-9dd9-49b4-abae-453b2c238266\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 21:52:44.644057 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.644025    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 01 21:52:44.777544 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.777516    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 21:52:44.780582 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:52:44.780555    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfe46922_9dd9_49b4_abae_453b2c238266.slice/crio-3fdd1e9fc724b71aec232f1b1b656e3d0a9a6f3245d10073e8954df29eb93030 WatchSource:0}: Error finding container 3fdd1e9fc724b71aec232f1b1b656e3d0a9a6f3245d10073e8954df29eb93030: Status 404 returned error can't find the container with id 3fdd1e9fc724b71aec232f1b1b656e3d0a9a6f3245d10073e8954df29eb93030
Jun 01 21:52:44.782207 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:44.782191    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 01 21:52:45.530174 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:45.530132    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cfe46922-9dd9-49b4-abae-453b2c238266","Type":"ContainerStarted","Data":"3fdd1e9fc724b71aec232f1b1b656e3d0a9a6f3245d10073e8954df29eb93030"}
Jun 01 21:52:49.315286 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:49.315263    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 01 21:52:49.551646 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:49.551601    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cfe46922-9dd9-49b4-abae-453b2c238266","Type":"ContainerStarted","Data":"2d631d0e8adadbe6fee0a2ea395f9f104bf076b1fcf0165271415ac0565a07eb"}
Jun 01 21:52:49.571427 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:49.571285    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.040756463 podStartE2EDuration="5.571269506s" podCreationTimestamp="2026-06-01 21:52:44 +0000 UTC" firstStartedPulling="2026-06-01 21:52:44.782308861 +0000 UTC m=+656.088748103" lastFinishedPulling="2026-06-01 21:52:49.312821899 +0000 UTC m=+660.619261146" observedRunningTime="2026-06-01 21:52:49.57000451 +0000 UTC m=+660.876443774" watchObservedRunningTime="2026-06-01 21:52:49.571269506 +0000 UTC m=+660.877708769"
Jun 01 21:52:49.644718 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:49.644674    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 01 21:52:49.646968 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:49.646925    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:50.645425 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:50.645359    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:51.645017 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:51.644969    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:52.644787 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:52.644729    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:53.645057 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:53.645000    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:54.645008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:54.644245    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 01 21:52:54.645008 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:54.644635    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:55.644723 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:55.644668    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:56.645300 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:56.645239    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:57.644682 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:57.644618    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:58.645384 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:58.645329    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:52:59.644381 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:52:59.644335    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:53:00.645478 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:00.645426    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:53:01.644874 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:01.644825    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused"
Jun 01 21:53:02.733560 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:02.733520    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 01 21:53:02.747542 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:02.747502    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 01 21:53:12.740212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:12.740177    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 01 21:53:19.133690 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.133658    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-598cf545fc-4gh6p"]
Jun 01 21:53:19.137327 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.137311    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:19.139771 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.139752    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jun 01 21:53:19.139962 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.139950    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-2zcnt\""
Jun 01 21:53:19.148614 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.148595    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-598cf545fc-4gh6p"]
Jun 01 21:53:19.183811 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.183790    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfnxc\" (UniqueName: \"kubernetes.io/projected/50119f78-4087-414c-b943-60f910ee2dd2-kube-api-access-jfnxc\") pod \"maas-controller-598cf545fc-4gh6p\" (UID: \"50119f78-4087-414c-b943-60f910ee2dd2\") " pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:19.284765 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.284734    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-jfnxc\" (UniqueName: \"kubernetes.io/projected/50119f78-4087-414c-b943-60f910ee2dd2-kube-api-access-jfnxc\") pod \"maas-controller-598cf545fc-4gh6p\" (UID: \"50119f78-4087-414c-b943-60f910ee2dd2\") " pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:19.297283 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.297261    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfnxc\" (UniqueName: \"kubernetes.io/projected/50119f78-4087-414c-b943-60f910ee2dd2-kube-api-access-jfnxc\") pod \"maas-controller-598cf545fc-4gh6p\" (UID: \"50119f78-4087-414c-b943-60f910ee2dd2\") " pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:19.319068 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.319044    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-78d445d6c6-jpf78"]
Jun 01 21:53:19.322717 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.322700    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78d445d6c6-jpf78"
Jun 01 21:53:19.330446 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.330399    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78d445d6c6-jpf78"]
Jun 01 21:53:19.386447 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.386365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4zpb\" (UniqueName: \"kubernetes.io/projected/7416223d-9148-49d0-bde4-1cdcbb541806-kube-api-access-h4zpb\") pod \"maas-controller-78d445d6c6-jpf78\" (UID: \"7416223d-9148-49d0-bde4-1cdcbb541806\") " pod="opendatahub/maas-controller-78d445d6c6-jpf78"
Jun 01 21:53:19.447422 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.447386    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:19.488185 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.488156    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-h4zpb\" (UniqueName: \"kubernetes.io/projected/7416223d-9148-49d0-bde4-1cdcbb541806-kube-api-access-h4zpb\") pod \"maas-controller-78d445d6c6-jpf78\" (UID: \"7416223d-9148-49d0-bde4-1cdcbb541806\") " pod="opendatahub/maas-controller-78d445d6c6-jpf78"
Jun 01 21:53:19.497269 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.497249    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4zpb\" (UniqueName: \"kubernetes.io/projected/7416223d-9148-49d0-bde4-1cdcbb541806-kube-api-access-h4zpb\") pod \"maas-controller-78d445d6c6-jpf78\" (UID: \"7416223d-9148-49d0-bde4-1cdcbb541806\") " pod="opendatahub/maas-controller-78d445d6c6-jpf78"
Jun 01 21:53:19.577578 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.577552    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-598cf545fc-4gh6p"]
Jun 01 21:53:19.579822 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:53:19.579793    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50119f78_4087_414c_b943_60f910ee2dd2.slice/crio-b2d9abf60bec3318c14e85ce20a230b49f66a8f7a0f8aa8b894e930ac60dcc83 WatchSource:0}: Error finding container b2d9abf60bec3318c14e85ce20a230b49f66a8f7a0f8aa8b894e930ac60dcc83: Status 404 returned error can't find the container with id b2d9abf60bec3318c14e85ce20a230b49f66a8f7a0f8aa8b894e930ac60dcc83
Jun 01 21:53:19.634378 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.634353    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-78d445d6c6-jpf78"
Jun 01 21:53:19.693849 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.693822    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-598cf545fc-4gh6p" event={"ID":"50119f78-4087-414c-b943-60f910ee2dd2","Type":"ContainerStarted","Data":"b2d9abf60bec3318c14e85ce20a230b49f66a8f7a0f8aa8b894e930ac60dcc83"}
Jun 01 21:53:19.760488 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:19.760467    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-78d445d6c6-jpf78"]
Jun 01 21:53:19.762656 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:53:19.762630    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7416223d_9148_49d0_bde4_1cdcbb541806.slice/crio-79e1a75ac8e0d712a922906fd56e87800f31bf62bc6f3bf2a4ba643fdfce1fc8 WatchSource:0}: Error finding container 79e1a75ac8e0d712a922906fd56e87800f31bf62bc6f3bf2a4ba643fdfce1fc8: Status 404 returned error can't find the container with id 79e1a75ac8e0d712a922906fd56e87800f31bf62bc6f3bf2a4ba643fdfce1fc8
Jun 01 21:53:20.700606 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:20.700563    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78d445d6c6-jpf78" event={"ID":"7416223d-9148-49d0-bde4-1cdcbb541806","Type":"ContainerStarted","Data":"79e1a75ac8e0d712a922906fd56e87800f31bf62bc6f3bf2a4ba643fdfce1fc8"}
Jun 01 21:53:22.709426 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:22.709368    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-78d445d6c6-jpf78" event={"ID":"7416223d-9148-49d0-bde4-1cdcbb541806","Type":"ContainerStarted","Data":"28feb94f4062d2d2d2b1d7f15415a4ea501e81e7c226d28561ad5cec13ee5fc4"}
Jun 01 21:53:22.709866 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:22.709490    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-78d445d6c6-jpf78"
Jun 01 21:53:22.710845 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:22.710816    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-598cf545fc-4gh6p" event={"ID":"50119f78-4087-414c-b943-60f910ee2dd2","Type":"ContainerStarted","Data":"b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057"}
Jun 01 21:53:22.710971 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:22.710908    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:22.728083 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:22.728036    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-78d445d6c6-jpf78" podStartSLOduration=1.237960409 podStartE2EDuration="3.728023525s" podCreationTimestamp="2026-06-01 21:53:19 +0000 UTC" firstStartedPulling="2026-06-01 21:53:19.763965201 +0000 UTC m=+691.070404443" lastFinishedPulling="2026-06-01 21:53:22.254028313 +0000 UTC m=+693.560467559" observedRunningTime="2026-06-01 21:53:22.727263198 +0000 UTC m=+694.033702463" watchObservedRunningTime="2026-06-01 21:53:22.728023525 +0000 UTC m=+694.034462791"
Jun 01 21:53:22.743198 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:22.743154    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-controller-598cf545fc-4gh6p" podStartSLOduration=1.063711915 podStartE2EDuration="3.743143122s" podCreationTimestamp="2026-06-01 21:53:19 +0000 UTC" firstStartedPulling="2026-06-01 21:53:19.581499751 +0000 UTC m=+690.887938996" lastFinishedPulling="2026-06-01 21:53:22.26093095 +0000 UTC m=+693.567370203" observedRunningTime="2026-06-01 21:53:22.742120808 +0000 UTC m=+694.048560072" watchObservedRunningTime="2026-06-01 21:53:22.743143122 +0000 UTC m=+694.049582385"
Jun 01 21:53:33.719172 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:33.719141    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-78d445d6c6-jpf78"
Jun 01 21:53:33.719623 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:33.719254    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:33.773798 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:33.773765    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-598cf545fc-4gh6p"]
Jun 01 21:53:33.774006 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:33.773967    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-controller-598cf545fc-4gh6p" podUID="50119f78-4087-414c-b943-60f910ee2dd2" containerName="manager" containerID="cri-o://b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057" gracePeriod=30
Jun 01 21:53:34.010851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.010829    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:34.124992 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.124961    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfnxc\" (UniqueName: \"kubernetes.io/projected/50119f78-4087-414c-b943-60f910ee2dd2-kube-api-access-jfnxc\") pod \"50119f78-4087-414c-b943-60f910ee2dd2\" (UID: \"50119f78-4087-414c-b943-60f910ee2dd2\") "
Jun 01 21:53:34.127057 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.127026    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/50119f78-4087-414c-b943-60f910ee2dd2-kube-api-access-jfnxc" (OuterVolumeSpecName: "kube-api-access-jfnxc") pod "50119f78-4087-414c-b943-60f910ee2dd2" (UID: "50119f78-4087-414c-b943-60f910ee2dd2"). InnerVolumeSpecName "kube-api-access-jfnxc". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 21:53:34.226312 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.226285    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfnxc\" (UniqueName: \"kubernetes.io/projected/50119f78-4087-414c-b943-60f910ee2dd2-kube-api-access-jfnxc\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 21:53:34.755858 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.755781    2562 generic.go:358] "Generic (PLEG): container finished" podID="50119f78-4087-414c-b943-60f910ee2dd2" containerID="b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057" exitCode=0
Jun 01 21:53:34.755858 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.755845    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-598cf545fc-4gh6p"
Jun 01 21:53:34.756295 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.755866    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-598cf545fc-4gh6p" event={"ID":"50119f78-4087-414c-b943-60f910ee2dd2","Type":"ContainerDied","Data":"b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057"}
Jun 01 21:53:34.756295 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.755909    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-598cf545fc-4gh6p" event={"ID":"50119f78-4087-414c-b943-60f910ee2dd2","Type":"ContainerDied","Data":"b2d9abf60bec3318c14e85ce20a230b49f66a8f7a0f8aa8b894e930ac60dcc83"}
Jun 01 21:53:34.756295 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.755929    2562 scope.go:117] "RemoveContainer" containerID="b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057"
Jun 01 21:53:34.764382 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.764366    2562 scope.go:117] "RemoveContainer" containerID="b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057"
Jun 01 21:53:34.764734 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:53:34.764714    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057\": container with ID starting with b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057 not found: ID does not exist" containerID="b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057"
Jun 01 21:53:34.764810 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.764741    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057"} err="failed to get container status \"b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057\": rpc error: code = NotFound desc = could not find container \"b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057\": container with ID starting with b575b8cca44ce15361c95ea45f01d179434a3f75f41d05504bfcb95a9dcfc057 not found: ID does not exist"
Jun 01 21:53:34.775993 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.775969    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-598cf545fc-4gh6p"]
Jun 01 21:53:34.781357 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:34.781335    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-598cf545fc-4gh6p"]
Jun 01 21:53:35.306828 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:35.306787    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="50119f78-4087-414c-b943-60f910ee2dd2" path="/var/lib/kubelet/pods/50119f78-4087-414c-b943-60f910ee2dd2/volumes"
Jun 01 21:53:55.608969 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.608928    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-7f7cddb5b9-bfdqc"]
Jun 01 21:53:55.609458 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.609394    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="50119f78-4087-414c-b943-60f910ee2dd2" containerName="manager"
Jun 01 21:53:55.609458 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.609425    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="50119f78-4087-414c-b943-60f910ee2dd2" containerName="manager"
Jun 01 21:53:55.609540 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.609507    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="50119f78-4087-414c-b943-60f910ee2dd2" containerName="manager"
Jun 01 21:53:55.614618 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.614600    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.617086 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.617053    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-96mhz\""
Jun 01 21:53:55.617212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.617126    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jun 01 21:53:55.620851 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.620825    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7f7cddb5b9-bfdqc"]
Jun 01 21:53:55.697694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.697655    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vrzm\" (UniqueName: \"kubernetes.io/projected/db420e7a-78d9-4ab1-9edf-906c8631847d-kube-api-access-7vrzm\") pod \"maas-api-7f7cddb5b9-bfdqc\" (UID: \"db420e7a-78d9-4ab1-9edf-906c8631847d\") " pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.697887 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.697803    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db420e7a-78d9-4ab1-9edf-906c8631847d-maas-api-tls\") pod \"maas-api-7f7cddb5b9-bfdqc\" (UID: \"db420e7a-78d9-4ab1-9edf-906c8631847d\") " pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.798713 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.798669    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db420e7a-78d9-4ab1-9edf-906c8631847d-maas-api-tls\") pod \"maas-api-7f7cddb5b9-bfdqc\" (UID: \"db420e7a-78d9-4ab1-9edf-906c8631847d\") " pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.798920 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.798747    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7vrzm\" (UniqueName: \"kubernetes.io/projected/db420e7a-78d9-4ab1-9edf-906c8631847d-kube-api-access-7vrzm\") pod \"maas-api-7f7cddb5b9-bfdqc\" (UID: \"db420e7a-78d9-4ab1-9edf-906c8631847d\") " pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.801714 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.801684    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db420e7a-78d9-4ab1-9edf-906c8631847d-maas-api-tls\") pod \"maas-api-7f7cddb5b9-bfdqc\" (UID: \"db420e7a-78d9-4ab1-9edf-906c8631847d\") " pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.806899 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.806875    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vrzm\" (UniqueName: \"kubernetes.io/projected/db420e7a-78d9-4ab1-9edf-906c8631847d-kube-api-access-7vrzm\") pod \"maas-api-7f7cddb5b9-bfdqc\" (UID: \"db420e7a-78d9-4ab1-9edf-906c8631847d\") " pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.927212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.927176    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:55.984862 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.984832    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7fwms"]
Jun 01 21:53:55.991394 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.991363    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms"
Jun 01 21:53:55.995475 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.995292    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jun 01 21:53:55.996196 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.996000    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4t2d2\""
Jun 01 21:53:55.998677 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:55.998633    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7fwms"]
Jun 01 21:53:56.070960 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.070934    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-7f7cddb5b9-bfdqc"]
Jun 01 21:53:56.073706 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:53:56.073677    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb420e7a_78d9_4ab1_9edf_906c8631847d.slice/crio-142442ba059883edef7f2aab7d04dffcd92d36a332ae07862881ad5dffe9a979 WatchSource:0}: Error finding container 142442ba059883edef7f2aab7d04dffcd92d36a332ae07862881ad5dffe9a979: Status 404 returned error can't find the container with id 142442ba059883edef7f2aab7d04dffcd92d36a332ae07862881ad5dffe9a979
Jun 01 21:53:56.102764 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.102729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdpw6\" (UniqueName: \"kubernetes.io/projected/37cc8051-0fd6-4461-a7a0-be35d5e26ff6-kube-api-access-hdpw6\") pod \"payload-processing-58b6c8fdc7-7fwms\" (UID: \"37cc8051-0fd6-4461-a7a0-be35d5e26ff6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms"
Jun 01 21:53:56.203688 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.203584    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-hdpw6\" (UniqueName: \"kubernetes.io/projected/37cc8051-0fd6-4461-a7a0-be35d5e26ff6-kube-api-access-hdpw6\") pod \"payload-processing-58b6c8fdc7-7fwms\" (UID: \"37cc8051-0fd6-4461-a7a0-be35d5e26ff6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms"
Jun 01 21:53:56.213080 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.213040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdpw6\" (UniqueName: \"kubernetes.io/projected/37cc8051-0fd6-4461-a7a0-be35d5e26ff6-kube-api-access-hdpw6\") pod \"payload-processing-58b6c8fdc7-7fwms\" (UID: \"37cc8051-0fd6-4461-a7a0-be35d5e26ff6\") " pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms"
Jun 01 21:53:56.306310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.306277    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms"
Jun 01 21:53:56.440617 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.440591    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58b6c8fdc7-7fwms"]
Jun 01 21:53:56.442526 ip-10-0-134-181 kubenswrapper[2562]: W0601 21:53:56.442487    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cc8051_0fd6_4461_a7a0_be35d5e26ff6.slice/crio-02c1802ffb5c0476753b9e0fa69c69b062ffd433b35ae95806c49f64fdf27b3c WatchSource:0}: Error finding container 02c1802ffb5c0476753b9e0fa69c69b062ffd433b35ae95806c49f64fdf27b3c: Status 404 returned error can't find the container with id 02c1802ffb5c0476753b9e0fa69c69b062ffd433b35ae95806c49f64fdf27b3c
Jun 01 21:53:56.837624 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.837585    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"142442ba059883edef7f2aab7d04dffcd92d36a332ae07862881ad5dffe9a979"}
Jun 01 21:53:56.838637 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:56.838611    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms" event={"ID":"37cc8051-0fd6-4461-a7a0-be35d5e26ff6","Type":"ContainerStarted","Data":"02c1802ffb5c0476753b9e0fa69c69b062ffd433b35ae95806c49f64fdf27b3c"}
Jun 01 21:53:58.847091 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:58.846990    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"143aac227f0acd2eb87e494ee5f01ab35c88b436e279e3c00c242938894362cf"}
Jun 01 21:53:58.847512 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:58.847105    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:53:58.848327 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:58.848304    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms" event={"ID":"37cc8051-0fd6-4461-a7a0-be35d5e26ff6","Type":"ContainerStarted","Data":"63791e52304d8f149f210edc25e6e83cc1a1013f7239dd6e0f5e8db27e347697"}
Jun 01 21:53:58.848472 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:58.848456    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms"
Jun 01 21:53:58.862920 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:58.862870    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podStartSLOduration=1.5460856779999999 podStartE2EDuration="3.862859032s" podCreationTimestamp="2026-06-01 21:53:55 +0000 UTC" firstStartedPulling="2026-06-01 21:53:56.075060189 +0000 UTC m=+727.381499431" lastFinishedPulling="2026-06-01 21:53:58.391833536 +0000 UTC m=+729.698272785" observedRunningTime="2026-06-01 21:53:58.861594858 +0000 UTC m=+730.168034123" watchObservedRunningTime="2026-06-01 21:53:58.862859032 +0000 UTC m=+730.169298295"
Jun 01 21:53:58.877948 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:53:58.877887    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms" podStartSLOduration=1.927898376 podStartE2EDuration="3.877869364s" podCreationTimestamp="2026-06-01 21:53:55 +0000 UTC" firstStartedPulling="2026-06-01 21:53:56.444313359 +0000 UTC m=+727.750752600" lastFinishedPulling="2026-06-01 21:53:58.394284329 +0000 UTC m=+729.700723588" observedRunningTime="2026-06-01 21:53:58.875626083 +0000 UTC m=+730.182065350" watchObservedRunningTime="2026-06-01 21:53:58.877869364 +0000 UTC m=+730.184308628"
Jun 01 21:54:04.854574 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:04.854521    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:09.853537 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:09.853492    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:09.854969 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:09.854945    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58b6c8fdc7-7fwms"
Jun 01 21:54:14.852974 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:14.852927    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:19.853530 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:19.853485    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:24.853623 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:24.853575    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:29.853346 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:29.853290    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:34.853474 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:34.853392    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:35.927972 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:35.927923    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:39.853006 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:39.852953    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:44.853018 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:44.852969    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:45.928563 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:45.928522    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:49.853374 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:49.853333    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:54.853436 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:54.853359    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:55.927979 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:55.927926    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:55.928367 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:55.928014    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:54:55.928442 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:55.928382    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"143aac227f0acd2eb87e494ee5f01ab35c88b436e279e3c00c242938894362cf"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 21:54:55.928442 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:55.928435    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://143aac227f0acd2eb87e494ee5f01ab35c88b436e279e3c00c242938894362cf" gracePeriod=30
Jun 01 21:54:55.928524 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:55.928463    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:54:56.066921 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:56.066882    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="143aac227f0acd2eb87e494ee5f01ab35c88b436e279e3c00c242938894362cf" exitCode=2
Jun 01 21:54:56.067051 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:56.066951    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"143aac227f0acd2eb87e494ee5f01ab35c88b436e279e3c00c242938894362cf"}
Jun 01 21:54:57.072669 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:57.072629    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"f8206cce3fca4b0cf9dc558f60878c0e31d5e6bb1b01137e57cf36bd2850adf3"}
Jun 01 21:54:57.073057 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:54:57.072706    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:55:03.076650 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:03.076599    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:08.076960 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:08.076863    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:13.077369 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:13.077320    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:18.076535 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:18.076483    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:23.077271 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:23.077217    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:28.076969 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:28.076923    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:33.076988 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:33.076946    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:35.928297 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:35.928254    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:38.076610 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:38.076569    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:43.076438 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:43.076380    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:45.927762 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:45.927723    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:48.077327 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:48.077285    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:53.076824 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:53.076774    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:55.928052 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:55.928015    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:55.928526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:55.928075    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:55:55.928526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:55.928510    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"f8206cce3fca4b0cf9dc558f60878c0e31d5e6bb1b01137e57cf36bd2850adf3"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 21:55:55.928614 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:55.928518    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:55:55.928614 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:55.928539    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://f8206cce3fca4b0cf9dc558f60878c0e31d5e6bb1b01137e57cf36bd2850adf3" gracePeriod=30
Jun 01 21:55:56.298700 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:56.298617    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="f8206cce3fca4b0cf9dc558f60878c0e31d5e6bb1b01137e57cf36bd2850adf3" exitCode=2
Jun 01 21:55:56.298700 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:56.298686    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"f8206cce3fca4b0cf9dc558f60878c0e31d5e6bb1b01137e57cf36bd2850adf3"}
Jun 01 21:55:56.298896 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:56.298730    2562 scope.go:117] "RemoveContainer" containerID="143aac227f0acd2eb87e494ee5f01ab35c88b436e279e3c00c242938894362cf"
Jun 01 21:55:57.306694 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:57.306663    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"60b30ee9afde5dfb971b1a4b0e806c1a0c86e7a4a52c7b0a7f55a3e428d0d93e"}
Jun 01 21:55:57.307090 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:55:57.306706    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:56:03.307755 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:03.307719    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:08.308282 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:08.308240    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:13.308261 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:13.308218    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:18.307987 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:18.307944    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:23.308373 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:23.308326    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:28.307950 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:28.307909    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:33.307828 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:33.307792    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:35.927840 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:35.927755    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:38.308522 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:38.308474    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:43.308528 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:43.308492    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:45.927562 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:45.927518    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:48.307783 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:48.307740    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:49.276665 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:49.276632    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:56:49.278899 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:49.278873    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:56:49.280757 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:49.280739    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 21:56:49.283120 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:49.283105    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 21:56:53.308486 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:53.308443    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:55.928054 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:55.928015    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:55.928526 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:55.928091    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:56:55.928577 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:55.928566    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"60b30ee9afde5dfb971b1a4b0e806c1a0c86e7a4a52c7b0a7f55a3e428d0d93e"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 21:56:55.928613 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:55.928564    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:56:55.928613 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:55.928602    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://60b30ee9afde5dfb971b1a4b0e806c1a0c86e7a4a52c7b0a7f55a3e428d0d93e" gracePeriod=30
Jun 01 21:56:56.525212 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:56.525182    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="60b30ee9afde5dfb971b1a4b0e806c1a0c86e7a4a52c7b0a7f55a3e428d0d93e" exitCode=2
Jun 01 21:56:56.525338 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:56.525260    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"60b30ee9afde5dfb971b1a4b0e806c1a0c86e7a4a52c7b0a7f55a3e428d0d93e"}
Jun 01 21:56:56.525338 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:56.525313    2562 scope.go:117] "RemoveContainer" containerID="f8206cce3fca4b0cf9dc558f60878c0e31d5e6bb1b01137e57cf36bd2850adf3"
Jun 01 21:56:57.530801 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:57.530762    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"35e6859224844cb67553086d9b32033b4e3f08bd3333349cd9ea555e325fcb7c"}
Jun 01 21:56:57.531172 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:56:57.530840    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:57:03.535878 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:03.535832    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:08.535735 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:08.535688    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:13.535458 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:13.535389    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:18.534871 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:18.534823    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:23.535214 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:23.535167    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:28.535457 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:28.535382    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:33.535083 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:33.535025    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:35.928359 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:35.928313    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:38.535739 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:38.535692    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:43.535285 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:43.535241    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:45.928292 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:45.928249    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:48.535208 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:48.535161    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:53.535663 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:53.535616    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:55.927646 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:55.927606    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:55.928032 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:55.927684    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:57:55.928121 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:55.928104    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"35e6859224844cb67553086d9b32033b4e3f08bd3333349cd9ea555e325fcb7c"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 21:57:55.928158 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:55.928135    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://35e6859224844cb67553086d9b32033b4e3f08bd3333349cd9ea555e325fcb7c" gracePeriod=30
Jun 01 21:57:55.928158 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:55.928131    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:57:56.046173 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:56.046155    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 01 21:57:56.752919 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:56.752827    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="35e6859224844cb67553086d9b32033b4e3f08bd3333349cd9ea555e325fcb7c" exitCode=2
Jun 01 21:57:56.752919 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:56.752894    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"35e6859224844cb67553086d9b32033b4e3f08bd3333349cd9ea555e325fcb7c"}
Jun 01 21:57:56.753153 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:56.752933    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"293b02dcc2e927236dd6ccb829921f256a940c21c6211498066d61aebb478212"}
Jun 01 21:57:56.753153 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:56.752954    2562 scope.go:117] "RemoveContainer" containerID="60b30ee9afde5dfb971b1a4b0e806c1a0c86e7a4a52c7b0a7f55a3e428d0d93e"
Jun 01 21:57:56.753153 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:57:56.753122    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:58:02.758889 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:02.758842    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:07.758366 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:07.758284    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:12.758310 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:12.758265    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:17.758818 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:17.758771    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:22.758930 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:22.758884    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:27.759276 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:27.759231    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:32.759097 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:32.759050    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:35.928134 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:35.928089    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:37.758644 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:37.758596    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:42.758748 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:42.758707    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:45.928279 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:45.928243    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:47.759240 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:47.759185    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:52.758833 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:52.758791    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:55.928401 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:55.928359    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:55.928795 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:55.928450    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:58:55.928912 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:55.928894    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"293b02dcc2e927236dd6ccb829921f256a940c21c6211498066d61aebb478212"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 21:58:55.928950 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:55.928932    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://293b02dcc2e927236dd6ccb829921f256a940c21c6211498066d61aebb478212" gracePeriod=30
Jun 01 21:58:55.928987 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:55.928940    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:58:56.973699 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:56.973667    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="293b02dcc2e927236dd6ccb829921f256a940c21c6211498066d61aebb478212" exitCode=2
Jun 01 21:58:56.974107 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:56.973743    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"293b02dcc2e927236dd6ccb829921f256a940c21c6211498066d61aebb478212"}
Jun 01 21:58:56.974107 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:56.973785    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"}
Jun 01 21:58:56.974107 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:56.973807    2562 scope.go:117] "RemoveContainer" containerID="35e6859224844cb67553086d9b32033b4e3f08bd3333349cd9ea555e325fcb7c"
Jun 01 21:58:56.974107 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:58:56.973931    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:59:02.980647 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:02.980605    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:07.980197 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:07.980153    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:12.980040 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:12.979998    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:17.980297 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:17.980245    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:22.980953 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:22.980910    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:27.980741 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:27.980693    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:32.980328 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:32.980279    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:35.928057 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:35.927960    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:37.980648 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:37.980603    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:42.980391 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:42.980347    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:45.928046 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:45.928001    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:47.980661 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:47.980620    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:52.980152 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:52.980112    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:55.928587 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:55.928544    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:55.928941 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:55.928624    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 21:59:55.929063 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:55.929043    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 21:59:55.929104 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:55.929084    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31" gracePeriod=30
Jun 01 21:59:55.929138 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:55.929041    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 21:59:56.045834 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:59:56.045809    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 21:59:56.199192 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:56.199108    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31" exitCode=2
Jun 01 21:59:56.199192 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:56.199177    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"}
Jun 01 21:59:56.199402 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:56.199232    2562 scope.go:117] "RemoveContainer" containerID="293b02dcc2e927236dd6ccb829921f256a940c21c6211498066d61aebb478212"
Jun 01 21:59:56.199648 ip-10-0-134-181 kubenswrapper[2562]: I0601 21:59:56.199635    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 21:59:56.199851 ip-10-0-134-181 kubenswrapper[2562]: E0601 21:59:56.199834    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:00:08.302786 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:00:08.302753    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:00:08.303231 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:00:08.302948    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:00:19.305252 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:00:19.305222    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:00:19.305763 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:00:19.305525    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:00:34.302332 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:00:34.302303    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:00:34.302721 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:00:34.302537    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:00:45.302576 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:00:45.302543    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:00:45.303308 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:00:45.302769    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:00:57.303154 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:00:57.303113    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:00:57.303584 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:00:57.303284    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:01:09.305607 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:09.305513    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:01:09.305979 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:01:09.305751    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:01:22.302429 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:22.302376    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:01:23.517478 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:23.517434    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"}
Jun 01 22:01:23.517888 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:23.517677    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:01:29.525191 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:29.525151    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:01:34.524212 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:34.524170    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:01:39.524603 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:39.524554    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:01:44.524219 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:44.524174    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:01:49.309433 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:49.309378    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:01:49.312058 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:49.312035    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:01:49.313461 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:49.313442    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:01:49.315963 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:49.315945    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:01:49.524384 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:49.524343    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:01:54.523680 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:54.523640    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:01:55.928271 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:55.928233    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:01:59.524169 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:01:59.524126    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:02:04.524326 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:04.524288    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:02:05.927966 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:05.927916    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:02:09.524313 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:09.524272    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:02:14.524010 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:14.523963    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:02:15.928534 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:15.928487    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:02:15.929014 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:15.928584    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:02:15.929118 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:15.929034    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 22:02:15.929118 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:15.929078    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a" gracePeriod=30
Jun 01 22:02:15.929227 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:15.929112    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:02:16.046702 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:02:16.046675    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:02:16.720182 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:16.720150    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a" exitCode=2
Jun 01 22:02:16.720360 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:16.720213    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"}
Jun 01 22:02:16.720360 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:16.720244    2562 scope.go:117] "RemoveContainer" containerID="e2624af642934fe6867f8a6beb6194c80fe5b52b70146ead42fd757ba5ae4c31"
Jun 01 22:02:16.720612 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:16.720595    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:02:16.720833 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:02:16.720815    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:02:31.302309 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:31.302273    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:02:31.304853 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:02:31.302521    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:02:43.302773 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:43.302678    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:02:43.303265 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:02:43.302900    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:02:55.302835 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:02:55.302798    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:02:55.303312 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:02:55.303067    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:03:06.302654 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:03:06.302622    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:03:06.303093 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:03:06.302804    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:03:17.302871 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:03:17.302825    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:03:17.303370 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:03:17.303112    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:03:28.302226 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:03:28.302197    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:03:28.302717 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:03:28.302513    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:03:43.302945 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:03:43.302908    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:03:43.303474 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:03:43.303142    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:03:56.302465 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:03:56.302397    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:03:56.302887 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:03:56.302651    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:04:10.302596 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:04:10.302516    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:04:10.302967 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:04:10.302699    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:04:23.302743 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:04:23.302711    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:04:23.303206 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:04:23.302918    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:04:38.302983 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:04:38.302945    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:04:38.303400 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:04:38.303113    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:04:51.302596 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:04:51.302562    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:04:51.302968 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:04:51.302842    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:05:04.302283 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:04.302242    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:05:04.302885 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:04.302577    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 01 22:05:05.356615 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:05.356580    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"}
Jun 01 22:05:05.356998 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:05.356796    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:05:11.362020 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:11.361971    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:16.361399 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:16.361352    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:21.361599 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:21.361558    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:26.361858 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:26.361797    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:31.361660 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:31.361610    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:35.928660 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:35.928567    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:36.361632 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:36.361534    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:41.361365 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:41.361323    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:45.927804 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:45.927754    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:46.360911 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:46.360807    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:51.361663 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:51.361612    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:55.928509 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:55.928468    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:55.928940 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:55.928537    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:05:55.929024 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:55.928966    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 22:05:55.929024 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:55.928997    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92" gracePeriod=30
Jun 01 22:05:55.929119 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:55.929009    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:05:56.048373 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:05:56.048343    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:05:56.543520 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:56.543488    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92" exitCode=2
Jun 01 22:05:56.543704 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:56.543565    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"}
Jun 01 22:05:56.543704 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:56.543609    2562 scope.go:117] "RemoveContainer" containerID="cca97df139ab2571fe3a672ae8c0cd2ff5ec2df9bd8aa20219fc1f44839b854a"
Jun 01 22:05:56.543992 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:05:56.543977    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:05:56.544234 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:05:56.544210    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:06:09.305376 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:09.305340    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:06:09.306101 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:06:09.305582    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:06:24.302682 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:24.302649    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:06:24.303092 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:06:24.302857    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:06:38.302724 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:38.302689    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:06:38.303161 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:06:38.302930    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:06:49.339528 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:49.339503    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:06:49.342133 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:49.342108    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:06:49.343922 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:49.343901    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:06:49.346685 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:49.346662    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:06:50.302167 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:06:50.302137    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:06:50.302380 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:06:50.302362    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:07:01.302365 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:07:01.302328    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:07:01.302804 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:07:01.302569    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:07:16.302855 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:07:16.302822    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:07:16.303248 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:07:16.303038    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:07:30.302188 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:07:30.302155    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:07:30.302712 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:07:30.302398    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:07:42.302755 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:07:42.302722    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:07:42.305179 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:07:42.302933    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:07:53.312956 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:07:53.310139    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:07:53.312956 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:07:53.310454    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:08:06.302789 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:08:06.302753    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:08:06.303236 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:08:06.302943    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:08:17.302875 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:08:17.302834    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:08:17.303317 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:08:17.303081    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:08:28.302120 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:08:28.302085    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:08:28.302536 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:08:28.302253    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:08:41.303086 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:08:41.303012    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:08:41.303565 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:08:41.303202    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:08:55.302263 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:08:55.302232    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:08:55.302777 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:08:55.302488    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:09:08.302435 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:09:08.302370    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:09:08.302915 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:09:08.302651    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:09:20.302277 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:09:20.302245    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:09:20.302685 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:09:20.302518    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:09:34.303103 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:09:34.303066    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:09:34.303661 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:09:34.303296    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:09:45.302565 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:09:45.302526    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:09:45.303041 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:09:45.302788    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:09:58.302826 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:09:58.302793    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:09:58.303209 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:09:58.303002    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:10:11.303109 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:10:11.303016    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:10:11.303679 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:10:11.303243    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:10:22.302985 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:10:22.302954    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:10:22.303482 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:10:22.303158    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:10:33.302631 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:10:33.302600    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:10:33.303011 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:10:33.302829    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:10:47.302321 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:10:47.302285    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:10:47.302829 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:10:47.302471    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:11:00.302399 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:00.302365    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:11:00.302820 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:00.302709    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 01 22:11:01.676656 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:01.676622    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"2f8e3248bfcb2aefff0cf13c92752770897c66e93e6e4dcc0374c9e36921efec"}
Jun 01 22:11:01.677093 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:01.676824    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:11:07.681381 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:07.681333    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:12.680646 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:12.680588    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:17.681254 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:17.681205    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:22.686860 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:22.680707    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:27.680470 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:27.680392    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:32.681006 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:32.680959    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:35.928088 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:35.928003    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:37.681517 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:37.681468    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:42.680991 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:42.680948    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:45.927516 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:45.927476    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:47.681485 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:47.681437    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:49.377921 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:49.377886    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:11:49.380602 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:49.380574    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:11:49.382056 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:49.382035    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:11:49.384557 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:49.384539    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:11:52.681390 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:52.681345    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:55.927715 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:55.927676    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:55.928219 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:55.927759    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:11:55.928219 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:55.928185    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"2f8e3248bfcb2aefff0cf13c92752770897c66e93e6e4dcc0374c9e36921efec"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 22:11:55.928219 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:55.928203    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:11:55.928391 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:55.928218    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://2f8e3248bfcb2aefff0cf13c92752770897c66e93e6e4dcc0374c9e36921efec" gracePeriod=30
Jun 01 22:11:56.880685 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:56.880648    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="2f8e3248bfcb2aefff0cf13c92752770897c66e93e6e4dcc0374c9e36921efec" exitCode=2
Jun 01 22:11:56.880892 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:56.880720    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"2f8e3248bfcb2aefff0cf13c92752770897c66e93e6e4dcc0374c9e36921efec"}
Jun 01 22:11:56.880892 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:56.880758    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"}
Jun 01 22:11:56.880892 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:56.880775    2562 scope.go:117] "RemoveContainer" containerID="ebddd2c560b79adf79567062de5e0bb0b7cce45523a2da388c3d862803109d92"
Jun 01 22:11:56.881076 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:11:56.880926    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:12:02.888007 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:02.887959    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:07.888229 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:07.888179    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:12.888224 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:12.888181    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:17.888333 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:17.888289    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:22.888199 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:22.888152    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:27.888359 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:27.888321    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:32.887941 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:32.887890    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:35.928326 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:35.928285    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:37.888161 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:37.888115    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:42.888275 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:42.888235    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:45.928203 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:45.928166    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:47.888253 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:47.888216    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:52.887953 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:52.887909    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:55.927996 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:55.927950    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:55.928391 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:55.928024    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:12:55.928526 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:55.928505    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 22:12:55.928586 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:55.928544    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176" gracePeriod=30
Jun 01 22:12:55.928642 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:55.928603    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:12:56.045548 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:12:56.045521    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:12:56.103529 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:56.103493    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176" exitCode=2
Jun 01 22:12:56.103712 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:56.103556    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"}
Jun 01 22:12:56.103712 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:56.103588    2562 scope.go:117] "RemoveContainer" containerID="2f8e3248bfcb2aefff0cf13c92752770897c66e93e6e4dcc0374c9e36921efec"
Jun 01 22:12:56.103978 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:12:56.103959    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:12:56.104201 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:12:56.104176    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:13:10.302188 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:10.302094    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:13:10.302678 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:13:10.302300    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:13:23.302745 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:23.302710    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:13:23.303149 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:13:23.302941    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:13:30.820331 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:30.820291    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 22:13:30.820752 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:30.820545    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak" containerID="cri-o://2d631d0e8adadbe6fee0a2ea395f9f104bf076b1fcf0165271415ac0565a07eb" gracePeriod=30
Jun 01 22:13:32.241525 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:32.241491    2562 generic.go:358] "Generic (PLEG): container finished" podID="cfe46922-9dd9-49b4-abae-453b2c238266" containerID="2d631d0e8adadbe6fee0a2ea395f9f104bf076b1fcf0165271415ac0565a07eb" exitCode=143
Jun 01 22:13:32.241835 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:32.241568    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cfe46922-9dd9-49b4-abae-453b2c238266","Type":"ContainerDied","Data":"2d631d0e8adadbe6fee0a2ea395f9f104bf076b1fcf0165271415ac0565a07eb"}
Jun 01 22:13:32.382234 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:32.382205    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:32.433001 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:32.432969    2562 reconciler_common.go:162] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drqnz\" (UniqueName: \"kubernetes.io/projected/cfe46922-9dd9-49b4-abae-453b2c238266-kube-api-access-drqnz\") pod \"cfe46922-9dd9-49b4-abae-453b2c238266\" (UID: \"cfe46922-9dd9-49b4-abae-453b2c238266\") "
Jun 01 22:13:32.435281 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:32.435255    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfe46922-9dd9-49b4-abae-453b2c238266-kube-api-access-drqnz" (OuterVolumeSpecName: "kube-api-access-drqnz") pod "cfe46922-9dd9-49b4-abae-453b2c238266" (UID: "cfe46922-9dd9-49b4-abae-453b2c238266"). InnerVolumeSpecName "kube-api-access-drqnz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jun 01 22:13:32.534692 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:32.534598    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drqnz\" (UniqueName: \"kubernetes.io/projected/cfe46922-9dd9-49b4-abae-453b2c238266-kube-api-access-drqnz\") on node \"ip-10-0-134-181.ec2.internal\" DevicePath \"\""
Jun 01 22:13:33.249347 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.249307    2562 util.go:48] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.249827 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.249356    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"cfe46922-9dd9-49b4-abae-453b2c238266","Type":"ContainerDied","Data":"3fdd1e9fc724b71aec232f1b1b656e3d0a9a6f3245d10073e8954df29eb93030"}
Jun 01 22:13:33.249827 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.249425    2562 scope.go:117] "RemoveContainer" containerID="2d631d0e8adadbe6fee0a2ea395f9f104bf076b1fcf0165271415ac0565a07eb"
Jun 01 22:13:33.271211 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.271183    2562 kubelet.go:2553] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 22:13:33.273003 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.272983    2562 kubelet.go:2547] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 22:13:33.293312 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.293283    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 22:13:33.293775 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.293759    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak"
Jun 01 22:13:33.293855 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.293776    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak"
Jun 01 22:13:33.293897 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.293855    2562 memory_manager.go:356] "RemoveStaleState removing state" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" containerName="keycloak"
Jun 01 22:13:33.298644 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.298629    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.301354 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.301311    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\""
Jun 01 22:13:33.301354 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.301341    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\""
Jun 01 22:13:33.301579 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.301375    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\""
Jun 01 22:13:33.301579 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.301375    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\""
Jun 01 22:13:33.301579 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.301384    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-tdrqb\""
Jun 01 22:13:33.308905 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.308872    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfe46922-9dd9-49b4-abae-453b2c238266" path="/var/lib/kubelet/pods/cfe46922-9dd9-49b4-abae-453b2c238266/volumes"
Jun 01 22:13:33.309272 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.309252    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 22:13:33.441502 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.441464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1b1117d9-135d-447b-911b-160fc5dcdad8-test-realms\") pod \"maas-keycloak-0\" (UID: \"1b1117d9-135d-447b-911b-160fc5dcdad8\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.441679 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.441613    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgnl\" (UniqueName: \"kubernetes.io/projected/1b1117d9-135d-447b-911b-160fc5dcdad8-kube-api-access-2sgnl\") pod \"maas-keycloak-0\" (UID: \"1b1117d9-135d-447b-911b-160fc5dcdad8\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.542330 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.542234    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1b1117d9-135d-447b-911b-160fc5dcdad8-test-realms\") pod \"maas-keycloak-0\" (UID: \"1b1117d9-135d-447b-911b-160fc5dcdad8\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.542504 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.542344    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgnl\" (UniqueName: \"kubernetes.io/projected/1b1117d9-135d-447b-911b-160fc5dcdad8-kube-api-access-2sgnl\") pod \"maas-keycloak-0\" (UID: \"1b1117d9-135d-447b-911b-160fc5dcdad8\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.542965 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.542944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/1b1117d9-135d-447b-911b-160fc5dcdad8-test-realms\") pod \"maas-keycloak-0\" (UID: \"1b1117d9-135d-447b-911b-160fc5dcdad8\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.550083 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.550058    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgnl\" (UniqueName: \"kubernetes.io/projected/1b1117d9-135d-447b-911b-160fc5dcdad8-kube-api-access-2sgnl\") pod \"maas-keycloak-0\" (UID: \"1b1117d9-135d-447b-911b-160fc5dcdad8\") " pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.611238 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.611198    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:33.743020 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:33.742990    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"]
Jun 01 22:13:33.746009 ip-10-0-134-181 kubenswrapper[2562]: W0601 22:13:33.745983    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b1117d9_135d_447b_911b_160fc5dcdad8.slice/crio-f8633a55f7c862b50ae17ef3991c33d5f58621d9fe9fab3699fe0af0b0f2dccf WatchSource:0}: Error finding container f8633a55f7c862b50ae17ef3991c33d5f58621d9fe9fab3699fe0af0b0f2dccf: Status 404 returned error can't find the container with id f8633a55f7c862b50ae17ef3991c33d5f58621d9fe9fab3699fe0af0b0f2dccf
Jun 01 22:13:34.255961 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:34.255928    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1b1117d9-135d-447b-911b-160fc5dcdad8","Type":"ContainerStarted","Data":"256f8e46b45e02d3f1034a7a4a710956d8b4abcc20f5829fc03c0f406db36f88"}
Jun 01 22:13:34.255961 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:34.255963    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"1b1117d9-135d-447b-911b-160fc5dcdad8","Type":"ContainerStarted","Data":"f8633a55f7c862b50ae17ef3991c33d5f58621d9fe9fab3699fe0af0b0f2dccf"}
Jun 01 22:13:34.272170 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:34.272103    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=0.988849065 podStartE2EDuration="1.272083895s" podCreationTimestamp="2026-06-01 22:13:33 +0000 UTC" firstStartedPulling="2026-06-01 22:13:33.747229845 +0000 UTC m=+1905.053669088" lastFinishedPulling="2026-06-01 22:13:34.03046466 +0000 UTC m=+1905.336903918" observedRunningTime="2026-06-01 22:13:34.271067515 +0000 UTC m=+1905.577506788" watchObservedRunningTime="2026-06-01 22:13:34.272083895 +0000 UTC m=+1905.578523159"
Jun 01 22:13:34.611825 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:34.611778    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:34.613542 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:34.613504    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:35.612566 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:35.612519    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:36.303100 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:36.303068    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:13:36.303361 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:13:36.303335    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:13:36.612087 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:36.611978    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:37.612336 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:37.612282    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:38.612131 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:38.612081    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:39.613017 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:39.612565    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:40.611951 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:40.611901    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:41.612122 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:41.612060    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:42.612611 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:42.612508    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:43.612188 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:43.612149    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:43.612506 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:43.612477    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:44.612312 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:44.612258    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:45.612369 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:45.612314    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:46.611792 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:46.611746    2562 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.41:9000/health/started\": dial tcp 10.134.0.41:9000: connect: connection refused"
Jun 01 22:13:47.739112 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:47.739079    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:13:47.759301 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:47.759262    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="1b1117d9-135d-447b-911b-160fc5dcdad8" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jun 01 22:13:49.306919 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:49.306880    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:13:49.307907 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:13:49.307868    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:13:57.745085 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:13:57.745049    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0"
Jun 01 22:14:03.302985 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:03.302954    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:14:03.303526 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:14:03.303239    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:14:15.303178 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:15.303139    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:14:15.303690 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:14:15.303456    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:14:19.842095 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:19.842052    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"]
Jun 01 22:14:19.846479 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:19.846454    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:19.849035 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:19.848907    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jun 01 22:14:19.849813 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:19.849791    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jun 01 22:14:19.849982 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:19.849846    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jun 01 22:14:19.850172 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:19.849994    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-lnk8n\""
Jun 01 22:14:19.856887 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:19.856858    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"]
Jun 01 22:14:20.016354 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.016314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.016585 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.016359    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.016585 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.016492    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.016585 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.016530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7cvkt\" (UniqueName: \"kubernetes.io/projected/6160cf3b-66ba-4053-a765-630bf69b11ea-kube-api-access-7cvkt\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.016585 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.016559    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.016733 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.016625    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6160cf3b-66ba-4053-a765-630bf69b11ea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.117970 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.117940    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118145 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.117982    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-7cvkt\" (UniqueName: \"kubernetes.io/projected/6160cf3b-66ba-4053-a765-630bf69b11ea-kube-api-access-7cvkt\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118145 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.118009    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118145 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.118039    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6160cf3b-66ba-4053-a765-630bf69b11ea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118145 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.118099    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118145 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.118118    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118557 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.118529    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118557 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.118533    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-model-cache\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.118718 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.118566    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-home\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.120393 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.120373    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6160cf3b-66ba-4053-a765-630bf69b11ea-dshm\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.120598 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.120581    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6160cf3b-66ba-4053-a765-630bf69b11ea-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.125175 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.125154    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7cvkt\" (UniqueName: \"kubernetes.io/projected/6160cf3b-66ba-4053-a765-630bf69b11ea-kube-api-access-7cvkt\") pod \"e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz\" (UID: \"6160cf3b-66ba-4053-a765-630bf69b11ea\") " pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.161449 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.161394    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:20.298319 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.298291    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"]
Jun 01 22:14:20.301374 ip-10-0-134-181 kubenswrapper[2562]: W0601 22:14:20.301314    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6160cf3b_66ba_4053_a765_630bf69b11ea.slice/crio-00d1bb5aa7693bfd88b88b84d78527928fa0184f157e070f89d8dcb813d3897b WatchSource:0}: Error finding container 00d1bb5aa7693bfd88b88b84d78527928fa0184f157e070f89d8dcb813d3897b: Status 404 returned error can't find the container with id 00d1bb5aa7693bfd88b88b84d78527928fa0184f157e070f89d8dcb813d3897b
Jun 01 22:14:20.443699 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:20.443612    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz" event={"ID":"6160cf3b-66ba-4053-a765-630bf69b11ea","Type":"ContainerStarted","Data":"00d1bb5aa7693bfd88b88b84d78527928fa0184f157e070f89d8dcb813d3897b"}
Jun 01 22:14:24.464898 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:24.464797    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz" event={"ID":"6160cf3b-66ba-4053-a765-630bf69b11ea","Type":"ContainerStarted","Data":"4d73fd41c04bfe938fd46b2be4980984d813b41c006e5da3beb19ff288bcf0d2"}
Jun 01 22:14:26.473580 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:26.473547    2562 generic.go:358] "Generic (PLEG): container finished" podID="6160cf3b-66ba-4053-a765-630bf69b11ea" containerID="4d73fd41c04bfe938fd46b2be4980984d813b41c006e5da3beb19ff288bcf0d2" exitCode=0
Jun 01 22:14:26.474091 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:26.473608    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz" event={"ID":"6160cf3b-66ba-4053-a765-630bf69b11ea","Type":"ContainerDied","Data":"4d73fd41c04bfe938fd46b2be4980984d813b41c006e5da3beb19ff288bcf0d2"}
Jun 01 22:14:28.302427 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:28.302385    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:14:28.302842 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:14:28.302629    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:14:28.484922 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:28.484884    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz" event={"ID":"6160cf3b-66ba-4053-a765-630bf69b11ea","Type":"ContainerStarted","Data":"37fc93ea096c612024b64072cbd697849a486ce7fd3865b840f75a94dfdae46a"}
Jun 01 22:14:28.507760 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:28.507709    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz" podStartSLOduration=2.146739696 podStartE2EDuration="9.50769059s" podCreationTimestamp="2026-06-01 22:14:19 +0000 UTC" firstStartedPulling="2026-06-01 22:14:20.303962838 +0000 UTC m=+1951.610402096" lastFinishedPulling="2026-06-01 22:14:27.664913748 +0000 UTC m=+1958.971352990" observedRunningTime="2026-06-01 22:14:28.504535839 +0000 UTC m=+1959.810975104" watchObservedRunningTime="2026-06-01 22:14:28.50769059 +0000 UTC m=+1959.814129885"
Jun 01 22:14:30.162450 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:30.162388    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:30.162840 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:30.162463    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:30.174760 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:30.174735    2562 kubelet.go:2658] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:30.504153 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:30.504068    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz"
Jun 01 22:14:43.302774 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:43.302740    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:14:43.303169 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:14:43.302975    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:14:58.302846 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:14:58.302814    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:14:58.303328 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:14:58.303009    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:15:08.126151 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.126115    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"]
Jun 01 22:15:08.130115 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.130089    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.132616 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.132597    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jun 01 22:15:08.137735 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.137711    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"]
Jun 01 22:15:08.182241 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.182200    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8kvh\" (UniqueName: \"kubernetes.io/projected/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-kube-api-access-m8kvh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.182474 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.182259    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.182474 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.182329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.182474 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.182367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.182474 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.182444    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.182720 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.182532    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.283803 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.283766    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-m8kvh\" (UniqueName: \"kubernetes.io/projected/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-kube-api-access-m8kvh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.283803 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.283814    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.284080 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.283867    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.284080 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.283890    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.284080 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.283930    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.284080 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.283947    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.284315 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.284285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.284382 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.284361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-model-cache\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.284471 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.284454    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-home\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.286333 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.286311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-dshm\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.286630 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.286611    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.292285 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.292258    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8kvh\" (UniqueName: \"kubernetes.io/projected/80fa4625-219b-4e3e-99fd-0cfbe5236ed6-kube-api-access-m8kvh\") pod \"premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx\" (UID: \"80fa4625-219b-4e3e-99fd-0cfbe5236ed6\") " pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.441671 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.441585    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"
Jun 01 22:15:08.579342 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.579315    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx"]
Jun 01 22:15:08.582192 ip-10-0-134-181 kubenswrapper[2562]: W0601 22:15:08.582163    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod80fa4625_219b_4e3e_99fd_0cfbe5236ed6.slice/crio-0868316b45bf649edac681084c59e8777d5d5914f24fb8a81486663812998d93 WatchSource:0}: Error finding container 0868316b45bf649edac681084c59e8777d5d5914f24fb8a81486663812998d93: Status 404 returned error can't find the container with id 0868316b45bf649edac681084c59e8777d5d5914f24fb8a81486663812998d93
Jun 01 22:15:08.629930 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:08.629902    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx" event={"ID":"80fa4625-219b-4e3e-99fd-0cfbe5236ed6","Type":"ContainerStarted","Data":"0868316b45bf649edac681084c59e8777d5d5914f24fb8a81486663812998d93"}
Jun 01 22:15:09.307677 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:09.307648    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:15:09.308058 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:15:09.307842    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:15:09.634427 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:09.634370    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx" event={"ID":"80fa4625-219b-4e3e-99fd-0cfbe5236ed6","Type":"ContainerStarted","Data":"e063cdc4455bbcada2fde8bc942bb372cca46d52df398a7b3ee80ccda79321e3"}
Jun 01 22:15:21.302496 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:21.302458    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:15:21.302921 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:15:21.302643    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:15:32.302880 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:32.302844    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:15:32.303370 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:15:32.303071    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:15:47.302112 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:47.302072    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:15:47.302604 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:15:47.302384    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:15:59.306790 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:15:59.306759    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:15:59.307258 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:15:59.307039    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:16:10.302375 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:10.302286    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:16:10.302859 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:16:10.302509    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:16:23.302147 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:23.302107    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:16:23.302675 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:16:23.302336    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:16:36.302227 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:36.302188    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:16:36.302754 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:16:36.302397    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:16:49.406040 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:49.406012    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:16:49.408544 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:49.408523    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:16:49.410609 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:49.410587    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:16:49.413081 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:49.413066    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-cbn52_125de1d5-be72-4d3b-b32e-15ad4df1d3a9/ovn-acl-logging/0.log"
Jun 01 22:16:50.302841 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:16:50.302807    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:16:50.303041 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:16:50.303023    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:17:04.302945 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:17:04.302914    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:17:04.303362 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:17:04.303128    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:17:15.302587 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:17:15.302550    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:17:15.303200 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:17:15.302762    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:17:30.302624 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:17:30.302592    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:17:30.303091 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:17:30.302833    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:17:43.303129 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:17:43.303081    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:17:43.305623 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:17:43.303401    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:17:54.302347 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:17:54.302310    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:17:54.302860 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:17:54.302557    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:18:06.302603 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:06.302573    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:18:06.303078 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:06.302901    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jun 01 22:18:07.307726 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:07.307691    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"e03bd7427acbdc4c6662f7fa21b669ddd72d19b4909e1e36c23de215945324b5"}
Jun 01 22:18:07.308105 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:07.307887    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:18:13.312839 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:13.312800    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:18.311777 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:18.311740    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:23.311572 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:23.311530    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:28.311769 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:28.311723    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:33.311157 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:33.311108    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:38.311245 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:38.311204    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:43.311541 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:43.311503    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:45.928191 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:45.928149    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:48.311924 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:48.311882    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:53.311717 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:53.311677    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:55.927982 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:55.927932    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:18:58.311380 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:18:58.311331    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:03.311029 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:03.310992    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:05.928055 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:05.927957    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:05.928055 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:05.928031    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:19:05.928572 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:05.928553    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"e03bd7427acbdc4c6662f7fa21b669ddd72d19b4909e1e36c23de215945324b5"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 22:19:05.928642 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:05.928591    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://e03bd7427acbdc4c6662f7fa21b669ddd72d19b4909e1e36c23de215945324b5" gracePeriod=30
Jun 01 22:19:05.928701 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:05.928659    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:06.540026 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:06.539994    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="e03bd7427acbdc4c6662f7fa21b669ddd72d19b4909e1e36c23de215945324b5" exitCode=2
Jun 01 22:19:06.540208 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:06.540075    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"e03bd7427acbdc4c6662f7fa21b669ddd72d19b4909e1e36c23de215945324b5"}
Jun 01 22:19:06.540208 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:06.540115    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerStarted","Data":"a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"}
Jun 01 22:19:06.540208 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:06.540129    2562 scope.go:117] "RemoveContainer" containerID="08506deea35a282ed11e3df5f52e1a97256d55cd700fa0e806b81b0089bf7176"
Jun 01 22:19:06.540350 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:06.540272    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:19:12.546826 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:12.546778    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:17.547072 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:17.547024    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:22.546742 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:22.546702    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:27.546360 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:27.546311    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:32.546617 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:32.546573    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:37.546725 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:37.546675    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:42.546524 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:42.546465    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:45.928551 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:45.928505    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:47.546766 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:47.546721    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:52.546831 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:52.546782    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:55.928108 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:55.928069    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:19:57.546836 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:19:57.546793    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:20:02.546915 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:02.546869    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:20:05.928341 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:05.928299    2562 prober.go:120] "Probe failed" probeType="Liveness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:20:05.928762 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:05.928373    2562 kubelet.go:2658] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc"
Jun 01 22:20:05.928912 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:05.928891    2562 kuberuntime_manager.go:1107] "Message for Container of pod" containerName="maas-api" containerStatusID={"Type":"cri-o","ID":"a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"} pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" containerMessage="Container maas-api failed liveness probe, will be restarted"
Jun 01 22:20:05.928954 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:05.928929    2562 kuberuntime_container.go:864] "Killing container with a grace period" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" containerID="cri-o://a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea" gracePeriod=30
Jun 01 22:20:05.928996 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:05.928938    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerName="maas-api" probeResult="failure" output="Get \"https://10.134.0.39:8443/health\": dial tcp 10.134.0.39:8443: connect: connection refused"
Jun 01 22:20:06.046264 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:20:06.046238    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:20:06.774059 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:06.774020    2562 generic.go:358] "Generic (PLEG): container finished" podID="db420e7a-78d9-4ab1-9edf-906c8631847d" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea" exitCode=2
Jun 01 22:20:06.774263 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:06.774092    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" event={"ID":"db420e7a-78d9-4ab1-9edf-906c8631847d","Type":"ContainerDied","Data":"a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"}
Jun 01 22:20:06.774263 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:06.774138    2562 scope.go:117] "RemoveContainer" containerID="e03bd7427acbdc4c6662f7fa21b669ddd72d19b4909e1e36c23de215945324b5"
Jun 01 22:20:06.774601 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:06.774580    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:20:06.774842 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:20:06.774823    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:20:18.302116 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:18.302084    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:20:18.302629 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:20:18.302302    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:20:31.303107 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:31.303067    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:20:31.303614 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:20:31.303251    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:20:46.303021 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:46.302939    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:20:46.303390 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:20:46.303153    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:20:58.861361 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:20:58.861325    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx_80fa4625-219b-4e3e-99fd-0cfbe5236ed6/storage-initializer/0.log"
Jun 01 22:21:01.302465 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:01.302426    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:21:01.302900 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:21:01.302719    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:21:04.515825 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:04.515758    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8c87cb59-cfhdp_3e3cc008-f299-4764-8639-687bbf183884/nginx/0.log"
Jun 01 22:21:05.004220 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:05.004191    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7f7cddb5b9-bfdqc_db420e7a-78d9-4ab1-9edf-906c8631847d/maas-api/11.log"
Jun 01 22:21:05.135702 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:05.135669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78d445d6c6-jpf78_7416223d-9148-49d0-bde4-1cdcbb541806/manager/0.log"
Jun 01 22:21:05.763346 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:05.763319    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5568c4bcd5-vtqct_cbd81485-ac02-413f-94ca-80c712dd3527/copy-manifests/0.log"
Jun 01 22:21:05.776978 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:05.776952    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5568c4bcd5-vtqct_cbd81485-ac02-413f-94ca-80c712dd3527/manager/0.log"
Jun 01 22:21:07.416447 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:07.416393    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-xwxst_501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963/manager/0.log"
Jun 01 22:21:07.541205 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:07.541173    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-rxd2f_cb5ba4c7-93a7-4767-92ee-4a6a869a997c/manager/0.log"
Jun 01 22:21:07.790701 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:07.790613    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vt67s_70d678eb-52a2-46ed-8d6c-5be7c9a45f11/registry-server/0.log"
Jun 01 22:21:08.161001 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:08.160968    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xx4j6_7dda1021-5ea0-404a-afa0-8ea56d493506/manager/0.log"
Jun 01 22:21:08.518690 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:08.518613    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bzt665_aff5ea39-74c7-4ab5-9a33-0d849b311e7e/istio-proxy/0.log"
Jun 01 22:21:09.013441 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:09.013393    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-9kt8x_22ea6f6b-2a89-480c-b66a-f0a852ce97f0/istio-proxy/0.log"
Jun 01 22:21:09.125212 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:09.125178    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7fwms_37cc8051-0fd6-4461-a7a0-be35d5e26ff6/payload-processing/0.log"
Jun 01 22:21:09.240581 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:09.240539    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d67cf6f97-g2knr_22a06d56-4027-4ec8-9365-aacb746bbcc0/router/0.log"
Jun 01 22:21:09.590908 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:09.590875    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz_6160cf3b-66ba-4053-a765-630bf69b11ea/storage-initializer/0.log"
Jun 01 22:21:09.598834 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:09.598809    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-8595bdc8d4-ktmdz_6160cf3b-66ba-4053-a765-630bf69b11ea/main/0.log"
Jun 01 22:21:10.241768 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:10.241737    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-d8bdbcb5c-88fdx_80fa4625-219b-4e3e-99fd-0cfbe5236ed6/storage-initializer/0.log"
Jun 01 22:21:15.302870 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:15.302839    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:21:15.303248 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:21:15.303090    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:21:18.201944 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:18.201911    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-zdqwj_e89a157a-c422-437f-a8b8-0d40d73aaf53/global-pull-secret-syncer/0.log"
Jun 01 22:21:18.397251 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:18.397215    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qm4bj_3123e555-e462-42c0-8c96-96f4f5fd50b9/konnectivity-agent/0.log"
Jun 01 22:21:18.436970 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:18.436941    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-134-181.ec2.internal_6401c04a440f4f89d2d403cc6c765190/haproxy/0.log"
Jun 01 22:21:23.402938 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:23.402908    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-657f44b778-xwxst_501ba3fb-0378-4ffb-a2c0-3e1bc8ba8963/manager/0.log"
Jun 01 22:21:23.480456 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:23.480388    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-648d5c98bc-rxd2f_cb5ba4c7-93a7-4767-92ee-4a6a869a997c/manager/0.log"
Jun 01 22:21:23.603612 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:23.603576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-vt67s_70d678eb-52a2-46ed-8d6c-5be7c9a45f11/registry-server/0.log"
Jun 01 22:21:23.757948 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:23.757864    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-85c4996f8c-xx4j6_7dda1021-5ea0-404a-afa0-8ea56d493506/manager/0.log"
Jun 01 22:21:25.197516 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.197489    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ddc088b8-cf6e-46b6-b816-306f1d0f7be6/alertmanager/0.log"
Jun 01 22:21:25.266879 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.266853    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ddc088b8-cf6e-46b6-b816-306f1d0f7be6/config-reloader/0.log"
Jun 01 22:21:25.305802 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.305771    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ddc088b8-cf6e-46b6-b816-306f1d0f7be6/kube-rbac-proxy-web/0.log"
Jun 01 22:21:25.358941 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.358917    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ddc088b8-cf6e-46b6-b816-306f1d0f7be6/kube-rbac-proxy/0.log"
Jun 01 22:21:25.432867 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.432840    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ddc088b8-cf6e-46b6-b816-306f1d0f7be6/kube-rbac-proxy-metric/0.log"
Jun 01 22:21:25.486877 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.486790    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ddc088b8-cf6e-46b6-b816-306f1d0f7be6/prom-label-proxy/0.log"
Jun 01 22:21:25.551747 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.551720    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ddc088b8-cf6e-46b6-b816-306f1d0f7be6/init-config-reloader/0.log"
Jun 01 22:21:25.932647 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.932621    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6f857d9dc4-g9cpj_7830270f-ba79-4c68-91fd-4e7bbc8ed9eb/metrics-server/0.log"
Jun 01 22:21:25.995580 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:25.995554    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5768fcc9dd-f85kn_caedf641-1e6a-413f-a6c2-790692116512/monitoring-plugin/0.log"
Jun 01 22:21:26.302657 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.302572    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:21:26.303004 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:21:26.302789    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:21:26.419058 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.419026    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvz4d_1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f/node-exporter/0.log"
Jun 01 22:21:26.465477 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.465439    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvz4d_1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f/kube-rbac-proxy/0.log"
Jun 01 22:21:26.516422 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.516390    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-wvz4d_1f62b7fd-4ba7-4e6b-ab5f-cec4c2179c2f/init-textfile/0.log"
Jun 01 22:21:26.580673 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.580594    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-jd8bl_15543026-23b0-44ba-8564-5cd9e348cc69/kube-rbac-proxy-main/0.log"
Jun 01 22:21:26.634180 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.634146    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-jd8bl_15543026-23b0-44ba-8564-5cd9e348cc69/kube-rbac-proxy-self/0.log"
Jun 01 22:21:26.695251 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.695217    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-85658796db-jd8bl_15543026-23b0-44ba-8564-5cd9e348cc69/openshift-state-metrics/0.log"
Jun 01 22:21:26.759168 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.759141    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eeee4026-4665-4fa7-b717-ecc0be89f6f1/prometheus/0.log"
Jun 01 22:21:26.833666 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.833576    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eeee4026-4665-4fa7-b717-ecc0be89f6f1/config-reloader/0.log"
Jun 01 22:21:26.910946 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.910921    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eeee4026-4665-4fa7-b717-ecc0be89f6f1/thanos-sidecar/0.log"
Jun 01 22:21:26.965144 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:26.965118    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eeee4026-4665-4fa7-b717-ecc0be89f6f1/kube-rbac-proxy-web/0.log"
Jun 01 22:21:27.026286 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.026256    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eeee4026-4665-4fa7-b717-ecc0be89f6f1/kube-rbac-proxy/0.log"
Jun 01 22:21:27.051159 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.051133    2562 kubelet.go:2537] "SyncLoop ADD" source="api" pods=["openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"]
Jun 01 22:21:27.054925 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.054905    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.058903 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.058880    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9gp2\"/\"kube-root-ca.crt\""
Jun 01 22:21:27.059027 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.058902    2562 reflector.go:430] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-q9gp2\"/\"default-dockercfg-5t7cj\""
Jun 01 22:21:27.059934 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.059916    2562 reflector.go:430] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-q9gp2\"/\"openshift-service-ca.crt\""
Jun 01 22:21:27.068669 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.068648    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"]
Jun 01 22:21:27.107396 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.107298    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eeee4026-4665-4fa7-b717-ecc0be89f6f1/kube-rbac-proxy-thanos/0.log"
Jun 01 22:21:27.159845 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.159819    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_eeee4026-4665-4fa7-b717-ecc0be89f6f1/init-config-reloader/0.log"
Jun 01 22:21:27.183137 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.183108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kjlck\" (UniqueName: \"kubernetes.io/projected/33c86da7-1681-44cf-92a4-ce2589a2e3e4-kube-api-access-kjlck\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.183247 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.183158    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-sys\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.183247 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.183179    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-podres\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.183247 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.183199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-lib-modules\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.183247 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.183231    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-proc\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.284634 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284603    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"kube-api-access-kjlck\" (UniqueName: \"kubernetes.io/projected/33c86da7-1681-44cf-92a4-ce2589a2e3e4-kube-api-access-kjlck\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.284845 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284652    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-sys\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.284845 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284682    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-podres\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.284845 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284726    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-lib-modules\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.284845 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284746    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-sys\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.284845 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284772    2562 reconciler_common.go:224] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-proc\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.284845 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284816    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-podres\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.285122 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284862    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-lib-modules\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.285122 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.284863    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/33c86da7-1681-44cf-92a4-ce2589a2e3e4-proc\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.297673 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.297648    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kjlck\" (UniqueName: \"kubernetes.io/projected/33c86da7-1681-44cf-92a4-ce2589a2e3e4-kube-api-access-kjlck\") pod \"perf-node-gather-daemonset-9thd9\" (UID: \"33c86da7-1681-44cf-92a4-ce2589a2e3e4\") " pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.357725 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.357627    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-59b7f8756b-flc48_aae2e291-860b-4427-88fe-f044b6b1aba9/prometheus-operator-admission-webhook/0.log"
Jun 01 22:21:27.365117 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.365096    2562 util.go:30] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:27.527643 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.527519    2562 kubelet.go:2544] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"]
Jun 01 22:21:27.530626 ip-10-0-134-181 kubenswrapper[2562]: W0601 22:21:27.530588    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod33c86da7_1681_44cf_92a4_ce2589a2e3e4.slice/crio-ea5a513487d71e3aba6d2c59feeb7492b1917acc6ed6ce37cb7faaf3a4e20838 WatchSource:0}: Error finding container ea5a513487d71e3aba6d2c59feeb7492b1917acc6ed6ce37cb7faaf3a4e20838: Status 404 returned error can't find the container with id ea5a513487d71e3aba6d2c59feeb7492b1917acc6ed6ce37cb7faaf3a4e20838
Jun 01 22:21:27.631089 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.631053    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c78bb6b7b-n7wkw_6d78942d-e136-42e8-be2c-7c547d42db20/thanos-query/0.log"
Jun 01 22:21:27.698945 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.698920    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c78bb6b7b-n7wkw_6d78942d-e136-42e8-be2c-7c547d42db20/kube-rbac-proxy-web/0.log"
Jun 01 22:21:27.766986 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.766952    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c78bb6b7b-n7wkw_6d78942d-e136-42e8-be2c-7c547d42db20/kube-rbac-proxy/0.log"
Jun 01 22:21:27.848204 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.848176    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c78bb6b7b-n7wkw_6d78942d-e136-42e8-be2c-7c547d42db20/prom-label-proxy/0.log"
Jun 01 22:21:27.921297 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.921212    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c78bb6b7b-n7wkw_6d78942d-e136-42e8-be2c-7c547d42db20/kube-rbac-proxy-rules/0.log"
Jun 01 22:21:27.965052 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:27.965022    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7c78bb6b7b-n7wkw_6d78942d-e136-42e8-be2c-7c547d42db20/kube-rbac-proxy-metrics/0.log"
Jun 01 22:21:28.083318 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:28.083285    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9" event={"ID":"33c86da7-1681-44cf-92a4-ce2589a2e3e4","Type":"ContainerStarted","Data":"541d4ba183776fe9e6f1eecc43778ef8979b075413c7012ec0f169f620c41470"}
Jun 01 22:21:28.083318 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:28.083326    2562 kubelet.go:2569] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9" event={"ID":"33c86da7-1681-44cf-92a4-ce2589a2e3e4","Type":"ContainerStarted","Data":"ea5a513487d71e3aba6d2c59feeb7492b1917acc6ed6ce37cb7faaf3a4e20838"}
Jun 01 22:21:28.083576 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:28.083363    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:28.128483 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:28.128431    2562 pod_startup_latency_tracker.go:104] "Observed pod startup duration" pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9" podStartSLOduration=1.128401381 podStartE2EDuration="1.128401381s" podCreationTimestamp="2026-06-01 22:21:27 +0000 UTC" firstStartedPulling="0001-01-01 00:00:00 +0000 UTC" lastFinishedPulling="0001-01-01 00:00:00 +0000 UTC" observedRunningTime="2026-06-01 22:21:28.127981136 +0000 UTC m=+2379.434420399" watchObservedRunningTime="2026-06-01 22:21:28.128401381 +0000 UTC m=+2379.434840645"
Jun 01 22:21:29.623079 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:29.623043    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/2.log"
Jun 01 22:21:29.630285 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:29.630254    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-86d7c6cc77-hdt9q_bdfccc11-1004-479b-9687-1d056ee1b5c4/console-operator/3.log"
Jun 01 22:21:30.701430 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:30.701382    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-7598fd5bd-nm8z2_1e447f32-6a9e-49f5-b25d-fbcc33f6b783/volume-data-source-validator/0.log"
Jun 01 22:21:31.520989 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:31.520959    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8nhns_39aea332-d0c6-40b9-b9df-9e38e7abea05/dns/0.log"
Jun 01 22:21:31.544385 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:31.544357    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-8nhns_39aea332-d0c6-40b9-b9df-9e38e7abea05/kube-rbac-proxy/0.log"
Jun 01 22:21:31.649696 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:31.649665    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fdt8z_9ea91858-06b1-4def-baf4-504ef8ed92f9/dns-node-resolver/0.log"
Jun 01 22:21:32.183135 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:32.183103    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2fq6l_011bd4d5-d3f7-4fde-a2b9-98c89b43b8cd/node-ca/0.log"
Jun 01 22:21:33.073666 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:33.073634    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-686dffbf4bzt665_aff5ea39-74c7-4ab5-9a33-0d849b311e7e/istio-proxy/0.log"
Jun 01 22:21:33.220284 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:33.220251    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-7d6f447cf5-9kt8x_22ea6f6b-2a89-480c-b66a-f0a852ce97f0/istio-proxy/0.log"
Jun 01 22:21:33.241531 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:33.241500    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58b6c8fdc7-7fwms_37cc8051-0fd6-4461-a7a0-be35d5e26ff6/payload-processing/0.log"
Jun 01 22:21:33.266025 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:33.266002    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-7d67cf6f97-g2knr_22a06d56-4027-4ec8-9365-aacb746bbcc0/router/0.log"
Jun 01 22:21:33.785803 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:33.785742    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-kbh6p_19155057-e59a-46c6-8d0d-6550843180dd/serve-healthcheck-canary/0.log"
Jun 01 22:21:34.097667 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:34.097585    2562 kubelet.go:2658] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-q9gp2/perf-node-gather-daemonset-9thd9"
Jun 01 22:21:34.357532 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:34.357449    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4qg9t_d65bde5a-51e5-4599-9656-3f3aa8faaca7/kube-rbac-proxy/0.log"
Jun 01 22:21:34.388380 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:34.388355    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4qg9t_d65bde5a-51e5-4599-9656-3f3aa8faaca7/exporter/0.log"
Jun 01 22:21:34.420630 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:34.420604    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4qg9t_d65bde5a-51e5-4599-9656-3f3aa8faaca7/extractor/0.log"
Jun 01 22:21:36.958573 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:36.958491    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-8c87cb59-cfhdp_3e3cc008-f299-4764-8639-687bbf183884/nginx/0.log"
Jun 01 22:21:37.066062 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:37.066032    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7f7cddb5b9-bfdqc_db420e7a-78d9-4ab1-9edf-906c8631847d/maas-api/11.log"
Jun 01 22:21:37.066252 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:37.066077    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-7f7cddb5b9-bfdqc_db420e7a-78d9-4ab1-9edf-906c8631847d/maas-api/11.log"
Jun 01 22:21:37.097994 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:37.097964    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-78d445d6c6-jpf78_7416223d-9148-49d0-bde4-1cdcbb541806/manager/0.log"
Jun 01 22:21:37.336754 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:37.336670    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5568c4bcd5-vtqct_cbd81485-ac02-413f-94ca-80c712dd3527/manager/0.log"
Jun 01 22:21:37.360609 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:37.360580    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5568c4bcd5-vtqct_cbd81485-ac02-413f-94ca-80c712dd3527/copy-manifests/0.log"
Jun 01 22:21:38.302673 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:38.302642    2562 scope.go:117] "RemoveContainer" containerID="a67f54d704c64d17cfb48fcd72a755ac366e39f98233ecf68dfb70b446c0edea"
Jun 01 22:21:38.303163 ip-10-0-134-181 kubenswrapper[2562]: E0601 22:21:38.302860    2562 pod_workers.go:1301] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"maas-api\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=maas-api pod=maas-api-7f7cddb5b9-bfdqc_opendatahub(db420e7a-78d9-4ab1-9edf-906c8631847d)\"" pod="opendatahub/maas-api-7f7cddb5b9-bfdqc" podUID="db420e7a-78d9-4ab1-9edf-906c8631847d"
Jun 01 22:21:38.825604 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:38.825572    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-64fd4455d7-fmbpz_aa85b75c-13a3-49e2-82ae-73308bd158e4/manager/0.log"
Jun 01 22:21:43.552307 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:43.552273    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-l6vr9_0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2/migrator/0.log"
Jun 01 22:21:43.573795 ip-10-0-134-181 kubenswrapper[2562]: I0601 22:21:43.573765    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-96c6f749-l6vr9_0cb907c3-92c3-4c4d-82a1-f4dbb71fbfc2/graceful-termination/0.log"